2023-12-02T01:17:48.684 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-02T01:17:48.684 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474690 -- /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474690/orig.config.yaml 2023-12-02T01:17:48.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:17:48.813 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474690 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7474690' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: bed7681480ccb0192b91a35e691658867e1e96b7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bed7681480ccb0192b91a35e691658867e1e96b7 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: bed7681480ccb0192b91a35e691658867e1e96b7 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1991 sha1: bed7681480ccb0192b91a35e691658867e1e96b7 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: bed7681480ccb0192b91a35e691658867e1e96b7 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKMOqRhUMzD7tBFZ+s2VhR5buspxbKXCSUd2Sy6WSJgzRfWzCtEQxyRViqMPBpY8vqdbm8xhdW/YCmP6QlMGn0= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMx/y8abdAAMZBvrX7yzmISe8AJ15d4CDALsOQREw9fUmrnrk0kmJ8iLgeUbTmm+OCd/lOCuq5NujbDpVbM11R0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-01_17:57:53 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-02T01:17:48.813 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa; will attempt to use it 2023-12-02T01:17:48.814 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks 2023-12-02T01:17:48.814 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-02T01:17:48.816 INFO:teuthology.task.internal:Checking packages... 2023-12-02T01:17:48.838 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bed7681480ccb0192b91a35e691658867e1e96b7' 2023-12-02T01:17:48.839 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-02T01:17:48.839 INFO:teuthology.packaging:ref: None 2023-12-02T01:17:48.839 INFO:teuthology.packaging:tag: None 2023-12-02T01:17:48.839 INFO:teuthology.packaging:branch: main 2023-12-02T01:17:48.839 INFO:teuthology.packaging:sha1: bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-02T01:17:48.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-12-02T01:17:49.146 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7660.gb27938f5 2023-12-02T01:17:49.146 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-02T01:17:49.153 INFO:teuthology.task.internal:no buildpackages task found 2023-12-02T01:17:49.153 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-02T01:17:49.173 INFO:teuthology.task.internal:Saving configuration 2023-12-02T01:17:49.192 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-02T01:17:49.199 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T01:17:49.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474690', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 01:12:27.987423', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKMOqRhUMzD7tBFZ+s2VhR5buspxbKXCSUd2Sy6WSJgzRfWzCtEQxyRViqMPBpY8vqdbm8xhdW/YCmP6QlMGn0='} 2023-12-02T01:17:49.251 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474690', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 01:12:27.988874', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMx/y8abdAAMZBvrX7yzmISe8AJ15d4CDALsOQREw9fUmrnrk0kmJ8iLgeUbTmm+OCd/lOCuq5NujbDpVbM11R0='} 2023-12-02T01:17:49.251 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-02T01:17:49.257 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-02T01:17:49.257 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-02T01:17:49.257 INFO:teuthology.run_tasks:Running task console_log... 2023-12-02T01:17:49.334 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6d4c30b040>, signals=[15]) 2023-12-02T01:17:49.335 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-02T01:17:49.341 INFO:teuthology.task.internal:Opening connections... 2023-12-02T01:17:49.341 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:17:49.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:17:49.445 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:17:49.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:17:49.529 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-02T01:17:49.536 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2023-12-02T01:17:49.553 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2023-12-02T01:17:49.553 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-12-02T01:17:49.609 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2023-12-02T01:17:49.609 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2023-12-02T01:17:49.609 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2023-12-02T01:17:49.609 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-02T01:17:49.610 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-02T01:17:49.611 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-12-02T01:17:49.628 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-12-02T01:17:49.647 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-12-02T01:17:49.647 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-12-02T01:17:49.701 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-02T01:17:49.702 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-02T01:17:49.703 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-02T01:17:49.703 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-12-02T01:17:49.728 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-02T01:17:49.740 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-02T01:17:49.746 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-02T01:17:49.746 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2023-12-02T01:17:49.749 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2023-12-02T01:17:49.766 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-02T01:17:49.772 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-02T01:17:49.773 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2023-12-02T01:17:49.805 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2023-12-02T01:17:49.843 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-02T01:17:49.901 INFO:teuthology.run_tasks:Running task kernel... 2023-12-02T01:17:49.918 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-02T01:17:49.918 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-02T01:17:49.919 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-02T01:17:49.919 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-02T01:17:49.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T01:17:49.936 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-12-02T01:17:49.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T01:17:49.937 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2023-12-02T01:17:49.994 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-361.el9.x86_64 2023-12-02T01:17:49.994 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-361.el9.x86_64 2023-12-02T01:17:49.995 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2023-12-02T01:17:49.996 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-361.el9.x86_64 2023-12-02T01:17:49.996 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-361.el9.x86_64 2023-12-02T01:17:49.996 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2023-12-02T01:17:52.529 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS-9 - AppStream 7.7 MB/s | 6.4 MB 00:00 2023-12-02T01:17:52.988 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - AppStream 4.6 MB/s | 6.4 MB 00:01 2023-12-02T01:17:54.020 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2023-12-02T01:17:54.647 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2023-12-02T01:17:54.869 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 7.9 MB 00:00 2023-12-02T01:17:55.838 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 7.9 MB 00:00 2023-12-02T01:17:57.278 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 14 MB/s | 18 MB 00:01 2023-12-02T01:18:00.480 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 18 MB 00:03 2023-12-02T01:18:01.537 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 5.8 MB 00:00 2023-12-02T01:18:03.196 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2023-12-02T01:18:04.989 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-02T01:18:05.172 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 5.8 MB 00:01 2023-12-02T01:18:06.748 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2023-12-02T01:18:09.922 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-02T01:18:12.354 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-02T01:18:12.355 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-02T01:18:12.441 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2023-12-02T01:18:12.445 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2023-12-02T01:18:12.445 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2023-12-02T01:18:12.445 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout:Install 4 Packages 2023-12-02T01:18:12.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:18:12.447 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 96 M 2023-12-02T01:18:12.447 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 121 M 2023-12-02T01:18:12.447 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2023-12-02T01:18:14.117 INFO:teuthology.orchestra.run.smithi001.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 3.4 MB/s | 5.6 MB 00:01 2023-12-02T01:18:14.949 INFO:teuthology.orchestra.run.smithi001.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 8.3 MB/s | 20 MB 00:02 2023-12-02T01:18:15.666 INFO:teuthology.orchestra.run.smithi001.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 12 MB/s | 38 MB 00:03 2023-12-02T01:18:17.841 INFO:teuthology.orchestra.run.smithi001.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 8.7 MB/s | 32 MB 00:03 2023-12-02T01:18:17.841 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2023-12-02T01:18:17.841 INFO:teuthology.orchestra.run.smithi001.stdout:Total 18 MB/s | 96 MB 00:05 2023-12-02T01:18:18.168 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 1.7 MB/s | 20 MB 00:11 2023-12-02T01:18:18.735 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2023-12-02T01:18:19.165 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2023-12-02T01:18:19.165 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2023-12-02T01:18:20.540 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2023-12-02T01:18:20.541 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2023-12-02T01:18:22.990 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-02T01:18:23.331 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2023-12-02T01:18:24.025 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-02T01:18:24.158 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-02T01:18:25.330 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-02T01:18:25.330 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-02T01:18:25.474 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-12-02T01:18:25.483 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-12-02T01:18:25.483 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2023-12-02T01:18:25.483 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2023-12-02T01:18:25.484 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:18:25.485 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 96 M 2023-12-02T01:18:25.485 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 121 M 2023-12-02T01:18:25.485 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-12-02T01:18:27.051 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-02T01:18:27.234 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-02T01:18:27.533 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 3.3 MB/s | 5.6 MB 00:01 2023-12-02T01:18:28.791 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 13 MB/s | 38 MB 00:02 2023-12-02T01:18:29.383 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): kernel-core-5.14.0-388.el9.x86_64.rpm 5.7 MB/s | 20 MB 00:03 2023-12-02T01:18:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 7.1 MB/s | 32 MB 00:04 2023-12-02T01:18:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-12-02T01:18:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:Total 15 MB/s | 96 MB 00:06 2023-12-02T01:18:32.182 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-02T01:18:32.304 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:18:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-12-02T01:18:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-12-02T01:18:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-12-02T01:18:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-12-02T01:18:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-12-02T01:18:37.296 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:18:37.338 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-12-02T01:18:37.972 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-02T01:18:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-02T01:18:40.894 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-02T01:18:41.070 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-02T01:18:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-02T01:18:46.070 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:18:50.711 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:07.788 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:07.833 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:08.210 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:08.210 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-02T01:19:08.210 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-02T01:19:08.210 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-02T01:19:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:19:08.644 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2023-12-02T01:19:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-02T01:19:08.644 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-02T01:19:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-02T01:19:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-02T01:19:08.645 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:19:08.645 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2023-12-02T01:19:09.150 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2023-12-02T01:19:09.297 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-02T01:19:09.298 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-02T01:19:09.298 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-02T01:19:09.298 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-02T01:19:09.298 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-02T01:19:09.298 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-02T01:19:09.298 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2023-12-02T01:19:09.298 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2023-12-02T01:19:09.420 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-02T01:19:09.420 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-02T01:19:09.421 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2023-12-02T01:19:09.463 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 68.el9 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8264254 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2023-12-02T01:19:09.464 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:19:09.465 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2023-12-02T01:19:09.466 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-02T01:19:09.466 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 5.14.0-388.el9.x86_64 2023-12-02T01:19:09.466 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-02T01:19:10.077 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2023-12-02T01:19:11.387 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-02T01:19:11.427 INFO:teuthology.orchestra.run.smithi001.stderr:done 2023-12-02T01:19:11.429 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2023-12-02T01:19:11.444 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.1HrjP6IcCu 2023-12-02T01:19:11.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1HrjP6IcCu 2023-12-02T01:19:11.517 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.1HrjP6IcCu 2023-12-02T01:19:11.661 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.1HrjP6IcCu is 6KB 2023-12-02T01:19:11.709 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.1HrjP6IcCu 2023-12-02T01:19:11.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2023-12-02T01:19:11.793 INFO:teuthology.orchestra.run.smithi001.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-02T01:19:11.793 INFO:teuthology.orchestra.run.smithi001.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-02T01:19:11.793 INFO:teuthology.orchestra.run.smithi001.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-02T01:19:11.793 INFO:teuthology.orchestra.run.smithi001.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-02T01:19:11.795 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-02T01:19:11.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2023-12-02T01:19:19.459 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:19.504 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:19.966 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:19.967 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-02T01:19:19.967 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-02T01:19:19.967 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:19:20.405 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-12-02T01:19:20.933 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2023-12-02T01:19:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-02T01:19:21.086 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-02T01:19:21.086 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-02T01:19:21.086 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-02T01:19:21.086 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-02T01:19:21.086 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-02T01:19:21.086 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2023-12-02T01:19:21.086 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2023-12-02T01:19:21.204 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-02T01:19:21.204 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-02T01:19:21.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2023-12-02T01:19:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 68.el9 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8264254 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2023-12-02T01:19:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-02T01:19:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2023-12-02T01:19:21.241 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:19:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2023-12-02T01:19:21.242 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-02T01:19:21.242 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 5.14.0-388.el9.x86_64 2023-12-02T01:19:21.242 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-02T01:19:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2023-12-02T01:19:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-02T01:19:23.372 INFO:teuthology.orchestra.run.smithi167.stderr:done 2023-12-02T01:19:23.374 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-12-02T01:19:23.431 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.TVqtIesUP7 2023-12-02T01:19:23.431 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TVqtIesUP7 2023-12-02T01:19:23.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.TVqtIesUP7 2023-12-02T01:19:23.645 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.TVqtIesUP7 is 6KB 2023-12-02T01:19:23.664 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.TVqtIesUP7 2023-12-02T01:19:23.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2023-12-02T01:19:23.743 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-02T01:19:23.743 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-02T01:19:23.743 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-02T01:19:23.743 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-02T01:19:23.744 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-02T01:19:23.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2023-12-02T01:19:41.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-02T01:19:41.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-02T01:19:41.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:19:53.918 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-02T01:19:53.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-02T01:19:53.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:20:00.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-02T01:20:09.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-02T01:20:09.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:20:12.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-02T01:20:12.418 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-02T01:20:21.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-02T01:20:21.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:20:24.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-02T01:20:24.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:20:24.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-02T01:20:36.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-02T01:20:36.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:20:54.882 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-12-02T01:20:56.192 DEBUG:teuthology.orchestra.run.smithi001:> true 2023-12-02T01:20:56.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-02T01:20:56.547 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-388.el9.x86_64"... 2023-12-02T01:20:56.547 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2023-12-02T01:20:56.562 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-388.el9.x86_64 2023-12-02T01:20:56.562 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-02T01:20:56.562 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-02T01:20:56.562 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-02T01:20:57.564 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-02T01:20:57.564 DEBUG:teuthology.orchestra.run.smithi001:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-02T01:20:57.636 INFO:teuthology.orchestra.run.smithi001.stdout:ttyS1 2023-12-02T01:20:57.677 DEBUG:teuthology.parallel:result is None 2023-12-02T01:21:09.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-02T01:21:09.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:21:10.330 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-12-02T01:21:10.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-02T01:21:10.714 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-388.el9.x86_64"... 2023-12-02T01:21:10.714 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-12-02T01:21:10.729 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-388.el9.x86_64 2023-12-02T01:21:10.729 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-02T01:21:10.729 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-02T01:21:10.729 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-02T01:21:11.730 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-02T01:21:11.730 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-02T01:21:11.817 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2023-12-02T01:21:11.872 DEBUG:teuthology.parallel:result is None 2023-12-02T01:21:11.872 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-02T01:21:11.879 INFO:teuthology.task.internal:Creating test directory... 2023-12-02T01:21:11.879 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-02T01:21:11.882 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-02T01:21:11.898 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-02T01:21:11.909 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-02T01:21:11.920 INFO:teuthology.task.internal:Creating archive directory... 2023-12-02T01:21:11.920 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-02T01:21:11.941 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-02T01:21:11.966 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-02T01:21:11.973 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-02T01:21:11.973 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-02T01:21:12.003 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-02T01:21:12.036 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-02T01:21:12.049 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-02T01:21:12.049 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-02T01:21:12.066 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-02T01:21:12.068 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-02T01:21:12.075 INFO:teuthology.task.internal:Configuring sudo... 2023-12-02T01:21:12.075 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-02T01:21:12.078 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-02T01:21:12.118 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-02T01:21:12.128 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-02T01:21:12.128 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-02T01:21:12.154 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-02T01:21:12.172 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T01:21:12.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T01:21:12.310 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T01:21:12.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T01:21:12.440 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:21:12.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-02T01:21:12.511 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T01:21:12.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T01:21:12.604 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T01:21:12.686 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T01:21:12.729 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:21:12.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-02T01:21:12.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2023-12-02T01:21:12.800 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2023-12-02T01:21:12.851 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-02T01:21:12.890 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-02T01:21:13.258 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-02T01:21:13.266 INFO:teuthology.task.internal:Starting timer... 2023-12-02T01:21:13.267 INFO:teuthology.run_tasks:Running task pcp... 2023-12-02T01:21:13.277 INFO:teuthology.run_tasks:Running task selinux... 2023-12-02T01:21:13.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2023-12-02T01:21:13.354 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2023-12-02T01:21:13.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2023-12-02T01:21:13.401 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2023-12-02T01:21:13.403 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-02T01:21:13.403 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2023-12-02T01:21:13.423 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2023-12-02T01:21:13.423 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2023-12-02T01:21:13.446 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2023-12-02T01:21:13.446 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2023-12-02T01:21:13.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-02T01:21:13.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T01:21:13.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-02T01:21:13.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T01:21:13.525 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-02T01:21:13.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2023-12-02T01:21:13.575 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2023-12-02T01:21:13.606 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-02T01:21:13.617 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-02T01:21:13.617 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-02T01:21:13.636 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-02T01:21:13.637 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-02T01:27:01.088 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2023-12-02T01:27:01.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-02T01:27:01.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:27:01.231 DEBUG:teuthology.orchestra.run.smithi001:> true 2023-12-02T01:27:01.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-02T01:27:01.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-02T01:27:01.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T01:27:01.382 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-12-02T01:27:01.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-12-02T01:27:01.448 INFO:teuthology.run_tasks:Running task clock... 2023-12-02T01:27:01.463 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-02T01:27:01.463 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-02T01:27:01.463 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-02T01:27:01.466 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-02T01:27:01.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-02T01:27:01.501 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-02T01:27:01.519 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-02T01:27:01.522 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-02T01:27:01.535 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-02T01:27:01.560 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2023-12-02T01:27:01.564 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2023-12-02T01:27:01.578 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2023-12-02T01:27:01.578 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2023-12-02T01:27:01.594 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-02T01:27:01.597 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-02T01:27:01.609 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-02T01:27:01.617 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-02T01:27:01.652 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2023-12-02T01:27:01.655 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-02T01:27:01.656 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-12-02T01:27:01.656 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.656 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.656 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.656 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.664 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2023-12-02T01:27:01.668 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-02T01:27:01.668 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2023-12-02T01:27:01.668 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.668 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.668 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.668 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-02T01:27:01.668 INFO:teuthology.run_tasks:Running task install... 2023-12-02T01:27:01.677 DEBUG:teuthology.task.install:project ceph 2023-12-02T01:27:01.677 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}} 2023-12-02T01:27:01.677 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'} 2023-12-02T01:27:01.677 INFO:teuthology.task.install:Using flavor: default 2023-12-02T01:27:01.683 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-02T01:27:01.683 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-02T01:27:01.683 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'tag': None, 'wait_for_package': False} 2023-12-02T01:27:01.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-02T01:27:01.686 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'tag': None, 'wait_for_package': False} 2023-12-02T01:27:01.686 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-02T01:27:01.842 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/ 2023-12-02T01:27:01.843 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7631.gbed76814 2023-12-02T01:27:01.903 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/ 2023-12-02T01:27:01.903 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7631.gbed76814 2023-12-02T01:27:02.005 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-02T01:27:02.005 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:27:02.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-02T01:27:02.011 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-02T01:27:02.012 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:27:02.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-02T01:27:02.034 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-02T01:27:02.034 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bed7681480ccb0192b91a35e691658867e1e96b7/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-02T01:27:02.044 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-02T01:27:02.045 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bed7681480ccb0192b91a35e691658867e1e96b7/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-02T01:27:02.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-02T01:27:02.116 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-02T01:27:02.182 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-02T01:27:02.203 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-02T01:27:02.233 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2023-12-02T01:27:02.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2023-12-02T01:27:02.248 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2023-12-02T01:27:02.250 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2023-12-02T01:27:02.497 INFO:teuthology.orchestra.run.smithi001.stdout:73 files removed 2023-12-02T01:27:02.498 INFO:teuthology.orchestra.run.smithi167.stdout:73 files removed 2023-12-02T01:27:02.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-02T01:27:02.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-02T01:27:03.244 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 205 kB/s | 78 kB 00:00 2023-12-02T01:27:03.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 173 kB/s | 78 kB 00:00 2023-12-02T01:27:03.761 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-02T01:27:03.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2023-12-02T01:27:04.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2023-12-02T01:27:04.262 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2023-12-02T01:27:04.732 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-12-02T01:27:04.806 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-02T01:27:06.140 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2023-12-02T01:27:06.223 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2023-12-02T01:27:07.005 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-12-02T01:27:07.598 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 7.9 MB 00:01 2023-12-02T01:27:10.531 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 18 MB 00:02 2023-12-02T01:27:12.716 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 18 MB 00:03 2023-12-02T01:27:15.574 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 5.8 MB 00:01 2023-12-02T01:27:16.633 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-02T01:27:17.125 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2023-12-02T01:27:18.126 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2023-12-02T01:27:18.292 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 15 kB 00:00 2023-12-02T01:27:20.060 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-02T01:27:23.077 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-02T01:27:24.777 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-02T01:27:25.865 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-02T01:27:25.866 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-02T01:27:25.880 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-02T01:27:25.881 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-02T01:27:25.882 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-02T01:27:25.883 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-02T01:27:25.885 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-02T01:27:25.888 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-02T01:27:25.889 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-02T01:27:25.968 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2023-12-02T01:27:25.986 INFO:teuthology.orchestra.run.smithi001.stdout:============================================================================================ 2023-12-02T01:27:25.986 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2023-12-02T01:27:25.986 INFO:teuthology.orchestra.run.smithi001.stdout:============================================================================================ 2023-12-02T01:27:25.986 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2023-12-02T01:27:25.986 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:18.0.0-7631.gbed76814.el9 ceph 6.6 k 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.2 M 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 859 k 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7631.gbed76814.el9 ceph 141 k 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.5 M 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 133 k 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 1.8 M 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 7.4 M 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 50 k 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 8.6 M 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:18.0.0-7631.gbed76814.el9 ceph 41 M 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 262 k 2023-12-02T01:27:25.987 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 776 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 218 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 18 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 31 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 718 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 127 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-02T01:27:25.988 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:18.0.0-7631.gbed76814.el9 ceph 162 k 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:18.0.0-7631.gbed76814.el9 ceph 320 k 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 298 k 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 99 k 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 85 k 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 170 k 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-02T01:27:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.3 M 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-02T01:27:25.990 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 19 M 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 28 k 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:18.0.0-7631.gbed76814.el9 ceph 2.1 M 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 243 k 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.4 M 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 18 M 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 15 k 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:18.0.0-7631.gbed76814.el9 ceph 24 k 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-02T01:27:25.991 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:18.0.0-7631.gbed76814.el9 ceph 164 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 475 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-02T01:27:25.992 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.8 M 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-02T01:27:25.993 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 45 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 129 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-02T01:27:25.994 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-02T01:27:25.995 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-02T01:27:25.996 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-02T01:27:25.997 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout:============================================================================================ 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout:Install 135 Packages 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 15 Packages 2023-12-02T01:27:25.998 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:27:25.999 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 204 M 2023-12-02T01:27:25.999 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2023-12-02T01:27:27.436 INFO:teuthology.orchestra.run.smithi001.stdout:(1/150): ceph-18.0.0-7631.gbed76814.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2023-12-02T01:27:27.489 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-02T01:27:27.490 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-02T01:27:27.503 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-02T01:27:27.504 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-02T01:27:27.505 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-02T01:27:27.506 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-02T01:27:27.508 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-02T01:27:27.510 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-02T01:27:27.511 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-02T01:27:27.583 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-12-02T01:27:27.600 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================ 2023-12-02T01:27:27.600 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2023-12-02T01:27:27.600 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================ 2023-12-02T01:27:27.600 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-12-02T01:27:27.600 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-02T01:27:27.600 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:18.0.0-7631.gbed76814.el9 ceph 6.6 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.2 M 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 859 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7631.gbed76814.el9 ceph 141 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.5 M 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 133 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 1.8 M 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 7.4 M 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 50 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 8.6 M 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:18.0.0-7631.gbed76814.el9 ceph 41 M 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 262 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 776 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 218 k 2023-12-02T01:27:27.601 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 18 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 31 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 718 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 127 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-02T01:27:27.602 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:18.0.0-7631.gbed76814.el9 ceph 162 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:18.0.0-7631.gbed76814.el9 ceph 320 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 298 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 99 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 85 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 170 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-02T01:27:27.603 INFO:teuthology.orchestra.run.smithi167.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.3 M 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-02T01:27:27.604 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 19 M 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 28 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:18.0.0-7631.gbed76814.el9 ceph 2.1 M 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 243 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.4 M 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 18 M 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 15 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:18.0.0-7631.gbed76814.el9 ceph 24 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-02T01:27:27.605 INFO:teuthology.orchestra.run.smithi167.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:18.0.0-7631.gbed76814.el9 ceph 164 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 475 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.8 M 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-02T01:27:27.606 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-02T01:27:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 45 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 129 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-02T01:27:27.608 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-02T01:27:27.609 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-02T01:27:27.610 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-02T01:27:27.611 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================ 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout:Install 135 Packages 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 15 Packages 2023-12-02T01:27:27.612 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:27:27.613 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 204 M 2023-12-02T01:27:27.613 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-12-02T01:27:28.853 INFO:teuthology.orchestra.run.smithi167.stdout:(1/150): ceph-18.0.0-7631.gbed76814.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2023-12-02T01:27:29.169 INFO:teuthology.orchestra.run.smithi001.stdout:(2/150): ceph-fuse-18.0.0-7631.gbed76814.el9.x8 496 kB/s | 859 kB 00:01 2023-12-02T01:27:29.236 INFO:teuthology.orchestra.run.smithi001.stdout:(3/150): ceph-base-18.0.0-7631.gbed76814.el9.x8 2.3 MB/s | 5.2 MB 00:02 2023-12-02T01:27:29.486 INFO:teuthology.orchestra.run.smithi001.stdout:(4/150): ceph-immutable-object-cache-18.0.0-763 446 kB/s | 141 kB 00:00 2023-12-02T01:27:29.740 INFO:teuthology.orchestra.run.smithi001.stdout:(5/150): ceph-mds-18.0.0-7631.gbed76814.el9.x86 4.1 MB/s | 2.1 MB 00:00 2023-12-02T01:27:29.938 INFO:teuthology.orchestra.run.smithi167.stdout:(2/150): ceph-fuse-18.0.0-7631.gbed76814.el9.x8 793 kB/s | 859 kB 00:01 2023-12-02T01:27:30.129 INFO:teuthology.orchestra.run.smithi167.stdout:(3/150): ceph-immutable-object-cache-18.0.0-763 738 kB/s | 141 kB 00:00 2023-12-02T01:27:30.765 INFO:teuthology.orchestra.run.smithi001.stdout:(6/150): ceph-mon-18.0.0-7631.gbed76814.el9.x86 4.3 MB/s | 4.4 MB 00:01 2023-12-02T01:27:31.146 INFO:teuthology.orchestra.run.smithi167.stdout:(4/150): ceph-base-18.0.0-7631.gbed76814.el9.x8 2.0 MB/s | 5.2 MB 00:02 2023-12-02T01:27:31.246 INFO:teuthology.orchestra.run.smithi167.stdout:(5/150): ceph-mds-18.0.0-7631.gbed76814.el9.x86 1.9 MB/s | 2.1 MB 00:01 2023-12-02T01:27:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:(6/150): ceph-mgr-18.0.0-7631.gbed76814.el9.x86 2.4 MB/s | 1.5 MB 00:00 2023-12-02T01:27:31.865 INFO:teuthology.orchestra.run.smithi001.stdout:(7/150): ceph-mgr-18.0.0-7631.gbed76814.el9.x86 630 kB/s | 1.5 MB 00:02 2023-12-02T01:27:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:(7/150): ceph-mon-18.0.0-7631.gbed76814.el9.x86 3.1 MB/s | 4.4 MB 00:01 2023-12-02T01:27:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:(8/150): ceph-radosgw-18.0.0-7631.gbed76814.el9 4.5 MB/s | 8.6 MB 00:01 2023-12-02T01:27:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:(9/150): ceph-selinux-18.0.0-7631.gbed76814.el9 241 kB/s | 24 kB 00:00 2023-12-02T01:27:35.065 INFO:teuthology.orchestra.run.smithi001.stdout:(8/150): ceph-osd-18.0.0-7631.gbed76814.el9.x86 4.1 MB/s | 18 MB 00:04 2023-12-02T01:27:35.132 INFO:teuthology.orchestra.run.smithi001.stdout:(9/150): ceph-selinux-18.0.0-7631.gbed76814.el9 362 kB/s | 24 kB 00:00 2023-12-02T01:27:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:(10/150): ceph-common-18.0.0-7631.gbed76814.el9 2.8 MB/s | 19 MB 00:06 2023-12-02T01:27:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:(11/150): cephfs-mirror-18.0.0-7631.gbed76814.e 1.8 MB/s | 218 kB 00:00 2023-12-02T01:27:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:(12/150): libcephfs-devel-18.0.0-7631.gbed76814 341 kB/s | 31 kB 00:00 2023-12-02T01:27:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:(13/150): libcephfs2-18.0.0-7631.gbed76814.el9. 2.8 MB/s | 718 kB 00:00 2023-12-02T01:27:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:(14/150): libcephsqlite-18.0.0-7631.gbed76814.e 1.6 MB/s | 164 kB 00:00 2023-12-02T01:27:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:(15/150): librados-devel-18.0.0-7631.gbed76814. 1.5 MB/s | 127 kB 00:00 2023-12-02T01:27:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:(16/150): libradosstriper1-18.0.0-7631.gbed7681 2.7 MB/s | 475 kB 00:00 2023-12-02T01:27:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:(17/150): ceph-osd-18.0.0-7631.gbed76814.el9.x8 3.7 MB/s | 18 MB 00:04 2023-12-02T01:27:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:(18/150): python3-ceph-argparse-18.0.0-7631.gbe 543 kB/s | 45 kB 00:00 2023-12-02T01:27:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:(19/150): python3-ceph-common-18.0.0-7631.gbed7 1.3 MB/s | 129 kB 00:00 2023-12-02T01:27:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:(20/150): python3-cephfs-18.0.0-7631.gbed76814. 1.8 MB/s | 162 kB 00:00 2023-12-02T01:27:36.981 INFO:teuthology.orchestra.run.smithi167.stdout:(21/150): python3-rados-18.0.0-7631.gbed76814.e 2.1 MB/s | 320 kB 00:00 2023-12-02T01:27:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:(22/150): librgw2-18.0.0-7631.gbed76814.el9.x86 5.5 MB/s | 4.8 MB 00:00 2023-12-02T01:27:37.124 INFO:teuthology.orchestra.run.smithi167.stdout:(23/150): python3-rbd-18.0.0-7631.gbed76814.el9 2.1 MB/s | 298 kB 00:00 2023-12-02T01:27:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:(24/150): python3-rgw-18.0.0-7631.gbed76814.el9 1.1 MB/s | 99 kB 00:00 2023-12-02T01:27:37.200 INFO:teuthology.orchestra.run.smithi167.stdout:(25/150): rbd-fuse-18.0.0-7631.gbed76814.el9.x8 1.1 MB/s | 85 kB 00:00 2023-12-02T01:27:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:(26/150): rbd-nbd-18.0.0-7631.gbed76814.el9.x86 1.8 MB/s | 170 kB 00:00 2023-12-02T01:27:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:(27/150): ceph-grafana-dashboards-18.0.0-7631.g 338 kB/s | 28 kB 00:00 2023-12-02T01:27:37.399 INFO:teuthology.orchestra.run.smithi001.stdout:(10/150): ceph-common-18.0.0-7631.gbed76814.el9 1.8 MB/s | 19 MB 00:10 2023-12-02T01:27:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:(28/150): ceph-mgr-cephadm-18.0.0-7631.gbed7681 1.4 MB/s | 133 kB 00:00 2023-12-02T01:27:37.508 INFO:teuthology.orchestra.run.smithi001.stdout:(11/150): cephfs-mirror-18.0.0-7631.gbed76814.e 2.0 MB/s | 218 kB 00:00 2023-12-02T01:27:37.566 INFO:teuthology.orchestra.run.smithi001.stdout:(12/150): libcephfs-devel-18.0.0-7631.gbed76814 536 kB/s | 31 kB 00:00 2023-12-02T01:27:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:(29/150): rbd-mirror-18.0.0-7631.gbed76814.el9. 5.3 MB/s | 3.0 MB 00:00 2023-12-02T01:27:37.733 INFO:teuthology.orchestra.run.smithi001.stdout:(13/150): libcephfs2-18.0.0-7631.gbed76814.el9. 4.2 MB/s | 718 kB 00:00 2023-12-02T01:27:37.800 INFO:teuthology.orchestra.run.smithi001.stdout:(14/150): libcephsqlite-18.0.0-7631.gbed76814.e 2.4 MB/s | 164 kB 00:00 2023-12-02T01:27:37.951 INFO:teuthology.orchestra.run.smithi001.stdout:(15/150): librados-devel-18.0.0-7631.gbed76814. 844 kB/s | 127 kB 00:00 2023-12-02T01:27:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:(30/150): ceph-mgr-dashboard-18.0.0-7631.gbed76 3.2 MB/s | 1.8 MB 00:00 2023-12-02T01:27:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:(16/150): libradosstriper1-18.0.0-7631.gbed7681 2.8 MB/s | 475 kB 00:00 2023-12-02T01:27:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:(31/150): ceph-mgr-modules-core-18.0.0-7631.gbe 2.0 MB/s | 243 kB 00:00 2023-12-02T01:27:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:(32/150): ceph-mgr-rook-18.0.0-7631.gbed76814.e 376 kB/s | 50 kB 00:00 2023-12-02T01:27:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:(33/150): ceph-prometheus-alerts-18.0.0-7631.gb 139 kB/s | 15 kB 00:00 2023-12-02T01:27:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:(34/150): ceph-volume-18.0.0-7631.gbed76814.el9 2.6 MB/s | 262 kB 00:00 2023-12-02T01:27:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:(35/150): cephadm-18.0.0-7631.gbed76814.el9.noa 3.1 MB/s | 776 kB 00:00 2023-12-02T01:27:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:(36/150): cephfs-top-18.0.0-7631.gbed76814.el9. 199 kB/s | 18 kB 00:00 2023-12-02T01:27:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:(37/150): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2023-12-02T01:27:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:(38/150): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2023-12-02T01:27:39.120 INFO:teuthology.orchestra.run.smithi167.stdout:(39/150): ceph-mgr-diskprediction-local-18.0.0- 5.2 MB/s | 7.4 MB 00:01 2023-12-02T01:27:39.145 INFO:teuthology.orchestra.run.smithi167.stdout:(40/150): boost-program-options-1.75.0-8.el9.x8 974 kB/s | 106 kB 00:00 2023-12-02T01:27:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:(41/150): elfutils-libelf-devel-0.190-1.el9.x86 432 kB/s | 21 kB 00:00 2023-12-02T01:27:39.201 INFO:teuthology.orchestra.run.smithi001.stdout:(17/150): librgw2-18.0.0-7631.gbed76814.el9.x86 4.4 MB/s | 4.8 MB 00:01 2023-12-02T01:27:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:(42/150): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-02T01:27:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:(43/150): flexiblas-3.0.4-8.el9.x86_64.rpm 546 kB/s | 32 kB 00:00 2023-12-02T01:27:39.251 INFO:teuthology.orchestra.run.smithi001.stdout:(18/150): python3-ceph-argparse-18.0.0-7631.gbe 909 kB/s | 45 kB 00:00 2023-12-02T01:27:39.301 INFO:teuthology.orchestra.run.smithi001.stdout:(19/150): python3-ceph-common-18.0.0-7631.gbed7 2.5 MB/s | 129 kB 00:00 2023-12-02T01:27:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:(44/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-12-02T01:27:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:(45/150): flexiblas-openblas-openmp-3.0.4-8.el9 160 kB/s | 17 kB 00:00 2023-12-02T01:27:39.352 INFO:teuthology.orchestra.run.smithi001.stdout:(20/150): python3-cephfs-18.0.0-7631.gbed76814. 3.2 MB/s | 162 kB 00:00 2023-12-02T01:27:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:(46/150): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-02T01:27:39.381 INFO:teuthology.orchestra.run.smithi167.stdout:(47/150): libaio-devel-0.3.111-13.el9.x86_64.rp 240 kB/s | 10 kB 00:00 2023-12-02T01:27:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:(48/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-02T01:27:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:(49/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-02T01:27:39.436 INFO:teuthology.orchestra.run.smithi001.stdout:(21/150): python3-rados-18.0.0-7631.gbed76814.e 3.8 MB/s | 320 kB 00:00 2023-12-02T01:27:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:(50/150): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-02T01:27:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:(51/150): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2023-12-02T01:27:39.511 INFO:teuthology.orchestra.run.smithi001.stdout:(22/150): python3-rbd-18.0.0-7631.gbed76814.el9 3.9 MB/s | 298 kB 00:00 2023-12-02T01:27:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:(52/150): libuuid-devel-2.37.4-15.el9.x86_64.rp 425 kB/s | 24 kB 00:00 2023-12-02T01:27:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:(53/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 924 kB/s | 46 kB 00:00 2023-12-02T01:27:39.561 INFO:teuthology.orchestra.run.smithi001.stdout:(23/150): python3-rgw-18.0.0-7631.gbed76814.el9 1.9 MB/s | 99 kB 00:00 2023-12-02T01:27:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:(54/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-12-02T01:27:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:(55/150): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-12-02T01:27:39.611 INFO:teuthology.orchestra.run.smithi001.stdout:(24/150): rbd-fuse-18.0.0-7631.gbed76814.el9.x8 1.7 MB/s | 85 kB 00:00 2023-12-02T01:27:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:(56/150): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-02T01:27:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:(57/150): openblas-0.3.21-2.el9.x86_64.rpm 689 kB/s | 34 kB 00:00 2023-12-02T01:27:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:(58/150): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2023-12-02T01:27:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:(59/150): postgresql-13.11-1.el9.x86_64.rpm 9.7 MB/s | 1.5 MB 00:00 2023-12-02T01:27:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:(60/150): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2023-12-02T01:27:39.877 INFO:teuthology.orchestra.run.smithi167.stdout:(61/150): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-12-02T01:27:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:(62/150): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2023-12-02T01:27:40.078 INFO:teuthology.orchestra.run.smithi001.stdout:(25/150): rbd-mirror-18.0.0-7631.gbed76814.el9. 6.4 MB/s | 3.0 MB 00:00 2023-12-02T01:27:40.137 INFO:teuthology.orchestra.run.smithi001.stdout:(26/150): rbd-nbd-18.0.0-7631.gbed76814.el9.x86 2.9 MB/s | 170 kB 00:00 2023-12-02T01:27:40.187 INFO:teuthology.orchestra.run.smithi001.stdout:(27/150): ceph-grafana-dashboards-18.0.0-7631.g 564 kB/s | 28 kB 00:00 2023-12-02T01:27:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:(63/150): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-12-02T01:27:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:(64/150): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-12-02T01:27:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:(65/150): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2023-12-02T01:27:40.254 INFO:teuthology.orchestra.run.smithi001.stdout:(28/150): ceph-mgr-cephadm-18.0.0-7631.gbed7681 1.9 MB/s | 133 kB 00:00 2023-12-02T01:27:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:(66/150): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2023-12-02T01:27:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:(67/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-02T01:27:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:(68/150): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2023-12-02T01:27:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:(69/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-12-02T01:27:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:(70/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-12-02T01:27:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:(71/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.0 MB/s | 174 kB 00:00 2023-12-02T01:27:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:(72/150): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 41 kB 00:00 2023-12-02T01:27:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:(73/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-02T01:27:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:(74/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2023-12-02T01:27:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:(75/150): python3-pytz-2021.1-5.el9.noarch.rpm 809 kB/s | 47 kB 00:00 2023-12-02T01:27:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:(76/150): python3-requests-oauthlib-1.3.0-12.el 854 kB/s | 43 kB 00:00 2023-12-02T01:27:40.796 INFO:teuthology.orchestra.run.smithi001.stdout:(29/150): ceph-test-18.0.0-7631.gbed76814.el9.x 7.3 MB/s | 41 MB 00:05 2023-12-02T01:27:40.888 INFO:teuthology.orchestra.run.smithi001.stdout:(30/150): ceph-radosgw-18.0.0-7631.gbed76814.el 977 kB/s | 8.6 MB 00:09 2023-12-02T01:27:40.930 INFO:teuthology.orchestra.run.smithi001.stdout:(31/150): ceph-mgr-dashboard-18.0.0-7631.gbed76 2.6 MB/s | 1.8 MB 00:00 2023-12-02T01:27:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:(77/150): python3-toml-0.10.2-6.el9.noarch.rpm 150 kB/s | 39 kB 00:00 2023-12-02T01:27:40.980 INFO:teuthology.orchestra.run.smithi001.stdout:(32/150): ceph-mgr-rook-18.0.0-7631.gbed76814.e 1.0 MB/s | 50 kB 00:00 2023-12-02T01:27:41.022 INFO:teuthology.orchestra.run.smithi001.stdout:(33/150): ceph-prometheus-alerts-18.0.0-7631.gb 366 kB/s | 15 kB 00:00 2023-12-02T01:27:41.055 INFO:teuthology.orchestra.run.smithi001.stdout:(34/150): ceph-mgr-modules-core-18.0.0-7631.gbe 1.4 MB/s | 243 kB 00:00 2023-12-02T01:27:41.097 INFO:teuthology.orchestra.run.smithi001.stdout:(35/150): ceph-volume-18.0.0-7631.gbed76814.el9 3.4 MB/s | 262 kB 00:00 2023-12-02T01:27:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:(78/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2023-12-02T01:27:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:(79/150): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2023-12-02T01:27:41.164 INFO:teuthology.orchestra.run.smithi001.stdout:(36/150): cephfs-top-18.0.0-7631.gbed76814.el9. 274 kB/s | 18 kB 00:00 2023-12-02T01:27:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:(80/150): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2023-12-02T01:27:41.198 INFO:teuthology.orchestra.run.smithi167.stdout:(81/150): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.0 MB/s | 85 kB 00:00 2023-12-02T01:27:41.215 INFO:teuthology.orchestra.run.smithi167.stdout:(82/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-12-02T01:27:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:(83/150): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-02T01:27:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:(84/150): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2023-12-02T01:27:41.299 INFO:teuthology.orchestra.run.smithi167.stdout:(85/150): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-02T01:27:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:(86/150): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-12-02T01:27:41.339 INFO:teuthology.orchestra.run.smithi001.stdout:(37/150): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2023-12-02T01:27:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:(87/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-02T01:27:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:(88/150): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-02T01:27:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:(89/150): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2023-12-02T01:27:41.473 INFO:teuthology.orchestra.run.smithi001.stdout:(38/150): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-12-02T01:27:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:(90/150): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 124 kB 00:00 2023-12-02T01:27:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:(91/150): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-12-02T01:27:41.515 INFO:teuthology.orchestra.run.smithi001.stdout:(39/150): bison-3.7.4-5.el9.x86_64.rpm 5.1 MB/s | 920 kB 00:00 2023-12-02T01:27:41.527 INFO:teuthology.orchestra.run.smithi167.stdout:(92/150): python3-urllib3-1.26.5-4.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-12-02T01:27:41.540 INFO:teuthology.orchestra.run.smithi001.stdout:(40/150): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-12-02T01:27:41.566 INFO:teuthology.orchestra.run.smithi001.stdout:(41/150): elfutils-libelf-devel-0.190-1.el9.x86 430 kB/s | 21 kB 00:00 2023-12-02T01:27:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:(42/150): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-12-02T01:27:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:(43/150): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2023-12-02T01:27:41.642 INFO:teuthology.orchestra.run.smithi001.stdout:(44/150): cephadm-18.0.0-7631.gbed76814.el9.noa 1.3 MB/s | 776 kB 00:00 2023-12-02T01:27:41.652 INFO:teuthology.orchestra.run.smithi167.stdout:(93/150): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2023-12-02T01:27:41.750 INFO:teuthology.orchestra.run.smithi001.stdout:(45/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2023-12-02T01:27:41.776 INFO:teuthology.orchestra.run.smithi001.stdout:(46/150): flexiblas-openblas-openmp-3.0.4-8.el9 108 kB/s | 17 kB 00:00 2023-12-02T01:27:41.801 INFO:teuthology.orchestra.run.smithi001.stdout:(47/150): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 186 kB 00:00 2023-12-02T01:27:41.826 INFO:teuthology.orchestra.run.smithi001.stdout:(48/150): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 10 kB 00:00 2023-12-02T01:27:41.851 INFO:teuthology.orchestra.run.smithi001.stdout:(49/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 888 kB/s | 44 kB 00:00 2023-12-02T01:27:41.876 INFO:teuthology.orchestra.run.smithi001.stdout:(50/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-12-02T01:27:41.901 INFO:teuthology.orchestra.run.smithi001.stdout:(51/150): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-12-02T01:27:41.935 INFO:teuthology.orchestra.run.smithi001.stdout:(52/150): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2023-12-02T01:27:41.961 INFO:teuthology.orchestra.run.smithi001.stdout:(53/150): libuuid-devel-2.37.4-15.el9.x86_64.rp 295 kB/s | 24 kB 00:00 2023-12-02T01:27:41.986 INFO:teuthology.orchestra.run.smithi001.stdout:(54/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 560 kB/s | 46 kB 00:00 2023-12-02T01:27:42.011 INFO:teuthology.orchestra.run.smithi001.stdout:(55/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-02T01:27:42.028 INFO:teuthology.orchestra.run.smithi167.stdout:(94/150): ceph-test-18.0.0-7631.gbed76814.el9.x 5.6 MB/s | 41 MB 00:07 2023-12-02T01:27:42.036 INFO:teuthology.orchestra.run.smithi001.stdout:(56/150): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-12-02T01:27:42.062 INFO:teuthology.orchestra.run.smithi001.stdout:(57/150): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2023-12-02T01:27:42.087 INFO:teuthology.orchestra.run.smithi001.stdout:(58/150): openblas-0.3.21-2.el9.x86_64.rpm 453 kB/s | 34 kB 00:00 2023-12-02T01:27:42.145 INFO:teuthology.orchestra.run.smithi167.stdout:(95/150): lua-devel-5.4.4-4.el9.x86_64.rpm 45 kB/s | 22 kB 00:00 2023-12-02T01:27:42.238 INFO:teuthology.orchestra.run.smithi001.stdout:(59/150): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2023-12-02T01:27:42.280 INFO:teuthology.orchestra.run.smithi001.stdout:(60/150): postgresql-13.11-1.el9.x86_64.rpm 8.0 MB/s | 1.5 MB 00:00 2023-12-02T01:27:42.347 INFO:teuthology.orchestra.run.smithi001.stdout:(61/150): postgresql-contrib-13.11-1.el9.x86_64 3.1 MB/s | 811 kB 00:00 2023-12-02T01:27:42.372 INFO:teuthology.orchestra.run.smithi001.stdout:(62/150): postgresql-private-libs-13.11-1.el9.x 1.0 MB/s | 134 kB 00:00 2023-12-02T01:27:42.647 INFO:teuthology.orchestra.run.smithi001.stdout:(63/150): postgresql-server-13.11-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2023-12-02T01:27:42.672 INFO:teuthology.orchestra.run.smithi001.stdout:(64/150): python3-jinja2-2.11.3-4.el9.noarch.rp 761 kB/s | 228 kB 00:00 2023-12-02T01:27:42.678 INFO:teuthology.orchestra.run.smithi167.stdout:(96/150): gperftools-libs-2.9.1-2.el9.x86_64.rp 475 kB/s | 309 kB 00:00 2023-12-02T01:27:42.737 INFO:teuthology.orchestra.run.smithi167.stdout:(97/150): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.3 MB/s | 4.1 MB 00:01 2023-12-02T01:27:42.754 INFO:teuthology.orchestra.run.smithi167.stdout:(98/150): libarrow-doc-9.0.0-9.el9.noarch.rpm 324 kB/s | 24 kB 00:00 2023-12-02T01:27:42.768 INFO:teuthology.orchestra.run.smithi001.stdout:(65/150): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2023-12-02T01:27:42.789 INFO:teuthology.orchestra.run.smithi001.stdout:(66/150): python3-jsonpatch-1.21-16.el9.noarch. 173 kB/s | 24 kB 00:00 2023-12-02T01:27:42.806 INFO:teuthology.orchestra.run.smithi001.stdout:(67/150): python3-jsonpointer-2.0-4.el9.noarch. 136 kB/s | 18 kB 00:00 2023-12-02T01:27:42.823 INFO:teuthology.orchestra.run.smithi001.stdout:(68/150): python3-markupsafe-1.1.1-12.el9.x86_6 946 kB/s | 32 kB 00:00 2023-12-02T01:27:42.848 INFO:teuthology.orchestra.run.smithi001.stdout:(69/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-12-02T01:27:42.862 INFO:teuthology.orchestra.run.smithi167.stdout:(99/150): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2023-12-02T01:27:42.988 INFO:teuthology.orchestra.run.smithi167.stdout:(100/150): liboath-2.6.7-2.el9.x86_64.rpm 194 kB/s | 49 kB 00:00 2023-12-02T01:27:43.032 INFO:teuthology.orchestra.run.smithi001.stdout:(70/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2023-12-02T01:27:43.057 INFO:teuthology.orchestra.run.smithi001.stdout:(71/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 931 kB/s | 217 kB 00:00 2023-12-02T01:27:43.082 INFO:teuthology.orchestra.run.smithi001.stdout:(72/150): python3-oauthlib-3.1.1-5.el9.noarch.r 751 kB/s | 174 kB 00:00 2023-12-02T01:27:43.096 INFO:teuthology.orchestra.run.smithi167.stdout:(101/150): luarocks-3.9.2-1.el9.noarch.rpm 647 kB/s | 151 kB 00:00 2023-12-02T01:27:43.107 INFO:teuthology.orchestra.run.smithi001.stdout:(73/150): python3-prettytable-0.7.2-27.el9.noar 555 kB/s | 41 kB 00:00 2023-12-02T01:27:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:(74/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-02T01:27:43.158 INFO:teuthology.orchestra.run.smithi001.stdout:(75/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-12-02T01:27:43.183 INFO:teuthology.orchestra.run.smithi001.stdout:(76/150): python3-pytz-2021.1-5.el9.noarch.rpm 627 kB/s | 47 kB 00:00 2023-12-02T01:27:43.210 INFO:teuthology.orchestra.run.smithi001.stdout:(77/150): python3-requests-oauthlib-1.3.0-12.el 849 kB/s | 43 kB 00:00 2023-12-02T01:27:43.401 INFO:teuthology.orchestra.run.smithi001.stdout:(78/150): python3-toml-0.10.2-6.el9.noarch.rpm 178 kB/s | 39 kB 00:00 2023-12-02T01:27:43.534 INFO:teuthology.orchestra.run.smithi001.stdout:(79/150): socat-1.7.4.1-5.el9.x86_64.rpm 929 kB/s | 300 kB 00:00 2023-12-02T01:27:43.613 INFO:teuthology.orchestra.run.smithi167.stdout:(102/150): python3-asyncssh-2.13.2-3.el9.noarch 1.0 MB/s | 548 kB 00:00 2023-12-02T01:27:43.680 INFO:teuthology.orchestra.run.smithi167.stdout:(103/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 654 kB/s | 43 kB 00:00 2023-12-02T01:27:43.685 INFO:teuthology.orchestra.run.smithi001.stdout:(80/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2023-12-02T01:27:43.710 INFO:teuthology.orchestra.run.smithi001.stdout:(81/150): uuid-1.6.2-55.el9.x86_64.rpm 184 kB/s | 56 kB 00:00 2023-12-02T01:27:43.735 INFO:teuthology.orchestra.run.smithi001.stdout:(82/150): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 426 kB/s | 85 kB 00:00 2023-12-02T01:27:43.738 INFO:teuthology.orchestra.run.smithi167.stdout:(104/150): python3-cachetools-4.2.4-1.el9.noarc 554 kB/s | 32 kB 00:00 2023-12-02T01:27:43.760 INFO:teuthology.orchestra.run.smithi001.stdout:(83/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-02T01:27:43.781 INFO:teuthology.orchestra.run.smithi167.stdout:(105/150): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2023-12-02T01:27:43.785 INFO:teuthology.orchestra.run.smithi001.stdout:(84/150): zlib-devel-1.2.11-40.el9.x86_64.rpm 590 kB/s | 44 kB 00:00 2023-12-02T01:27:43.811 INFO:teuthology.orchestra.run.smithi001.stdout:(85/150): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-02T01:27:43.844 INFO:teuthology.orchestra.run.smithi001.stdout:(86/150): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-12-02T01:27:43.873 INFO:teuthology.orchestra.run.smithi167.stdout:(106/150): parquet-libs-9.0.0-9.el9.x86_64.rpm 947 kB/s | 837 kB 00:00 2023-12-02T01:27:43.878 INFO:teuthology.orchestra.run.smithi001.stdout:(87/150): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2023-12-02T01:27:43.903 INFO:teuthology.orchestra.run.smithi001.stdout:(88/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-12-02T01:27:43.945 INFO:teuthology.orchestra.run.smithi001.stdout:(89/150): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-02T01:27:43.970 INFO:teuthology.orchestra.run.smithi001.stdout:(90/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-02T01:27:43.973 INFO:teuthology.orchestra.run.smithi167.stdout:(107/150): python3-cheroot-8.6.0-4.el9.noarch.r 895 kB/s | 172 kB 00:00 2023-12-02T01:27:43.995 INFO:teuthology.orchestra.run.smithi001.stdout:(91/150): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2023-12-02T01:27:44.021 INFO:teuthology.orchestra.run.smithi001.stdout:(92/150): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-02T01:27:44.046 INFO:teuthology.orchestra.run.smithi001.stdout:(93/150): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-02T01:27:44.106 INFO:teuthology.orchestra.run.smithi167.stdout:(108/150): python3-google-auth-2.23.4-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-12-02T01:27:44.138 INFO:teuthology.orchestra.run.smithi001.stdout:(94/150): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2023-12-02T01:27:44.148 INFO:teuthology.orchestra.run.smithi167.stdout:(109/150): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2023-12-02T01:27:44.190 INFO:teuthology.orchestra.run.smithi167.stdout:(110/150): python3-cherrypy-18.6.1-2.el9.noarch 1.1 MB/s | 358 kB 00:00 2023-12-02T01:27:44.216 INFO:teuthology.orchestra.run.smithi167.stdout:(111/150): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2023-12-02T01:27:44.221 INFO:teuthology.orchestra.run.smithi001.stdout:(95/150): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-12-02T01:27:44.241 INFO:teuthology.orchestra.run.smithi167.stdout:(112/150): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2023-12-02T01:27:44.258 INFO:teuthology.orchestra.run.smithi167.stdout:(113/150): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2023-12-02T01:27:44.275 INFO:teuthology.orchestra.run.smithi167.stdout:(114/150): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2023-12-02T01:27:44.292 INFO:teuthology.orchestra.run.smithi167.stdout:(115/150): python3-jwt+crypto-2.4.0-1.el9.noarc 269 kB/s | 9.0 kB 00:00 2023-12-02T01:27:44.334 INFO:teuthology.orchestra.run.smithi167.stdout:(116/150): python3-jwt-2.4.0-1.el9.noarch.rpm 697 kB/s | 41 kB 00:00 2023-12-02T01:27:44.380 INFO:teuthology.orchestra.run.smithi001.stdout:(96/150): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2023-12-02T01:27:44.384 INFO:teuthology.orchestra.run.smithi167.stdout:(117/150): python3-logutils-0.3.5-21.el9.noarch 928 kB/s | 46 kB 00:00 2023-12-02T01:27:44.438 INFO:teuthology.orchestra.run.smithi001.stdout:(97/150): libarrow-doc-9.0.0-9.el9.noarch.rpm 418 kB/s | 24 kB 00:00 2023-12-02T01:27:44.468 INFO:teuthology.orchestra.run.smithi167.stdout:(118/150): python3-more-itertools-8.12.0-2.el9. 946 kB/s | 79 kB 00:00 2023-12-02T01:27:44.497 INFO:teuthology.orchestra.run.smithi001.stdout:(98/150): liboath-2.6.7-2.el9.x86_64.rpm 834 kB/s | 49 kB 00:00 2023-12-02T01:27:44.527 INFO:teuthology.orchestra.run.smithi167.stdout:(119/150): python3-natsort-7.1.1-5.el9.noarch.r 990 kB/s | 58 kB 00:00 2023-12-02T01:27:44.564 INFO:teuthology.orchestra.run.smithi001.stdout:(99/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-12-02T01:27:44.664 INFO:teuthology.orchestra.run.smithi001.stdout:(100/150): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2023-12-02T01:27:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:(101/150): libarrow-9.0.0-9.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2023-12-02T01:27:44.815 INFO:teuthology.orchestra.run.smithi001.stdout:(102/150): openssl-devel-3.0.7-25.el9.x86_64.rp 5.0 MB/s | 4.1 MB 00:00 2023-12-02T01:27:44.850 INFO:teuthology.orchestra.run.smithi001.stdout:(103/150): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.5 MB/s | 837 kB 00:00 2023-12-02T01:27:44.860 INFO:teuthology.orchestra.run.smithi167.stdout:(120/150): python3-pecan-1.4.2-3.el9.noarch.rpm 817 kB/s | 272 kB 00:00 2023-12-02T01:27:44.873 INFO:teuthology.orchestra.run.smithi001.stdout:(104/150): python3-asyncssh-2.13.2-3.el9.noarch 4.6 MB/s | 548 kB 00:00 2023-12-02T01:27:44.911 INFO:teuthology.orchestra.run.smithi167.stdout:(121/150): python3-portend-3.1.0-2.el9.noarch.r 330 kB/s | 16 kB 00:00 2023-12-02T01:27:44.932 INFO:teuthology.orchestra.run.smithi001.stdout:(105/150): python3-cachetools-4.2.4-1.el9.noarc 385 kB/s | 32 kB 00:00 2023-12-02T01:27:45.028 INFO:teuthology.orchestra.run.smithi167.stdout:(122/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 770 kB/s | 90 kB 00:00 2023-12-02T01:27:45.061 INFO:teuthology.orchestra.run.smithi167.stdout:(123/150): python3-repoze-lru-0.7-16.el9.noarch 931 kB/s | 31 kB 00:00 2023-12-02T01:27:45.091 INFO:teuthology.orchestra.run.smithi001.stdout:(106/150): python3-certifi-2021.10.8-2.el9.noar 69 kB/s | 15 kB 00:00 2023-12-02T01:27:45.116 INFO:teuthology.orchestra.run.smithi001.stdout:(107/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 144 kB/s | 43 kB 00:00 2023-12-02T01:27:45.141 INFO:teuthology.orchestra.run.smithi001.stdout:(108/150): python3-cheroot-8.6.0-4.el9.noarch.r 823 kB/s | 172 kB 00:00 2023-12-02T01:27:45.192 INFO:teuthology.orchestra.run.smithi001.stdout:(109/150): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2023-12-02T01:27:45.203 INFO:teuthology.orchestra.run.smithi167.stdout:(124/150): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2023-12-02T01:27:45.242 INFO:teuthology.orchestra.run.smithi001.stdout:(110/150): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2023-12-02T01:27:45.262 INFO:teuthology.orchestra.run.smithi167.stdout:(125/150): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-02T01:27:45.267 INFO:teuthology.orchestra.run.smithi001.stdout:(111/150): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2023-12-02T01:27:45.301 INFO:teuthology.orchestra.run.smithi001.stdout:(112/150): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2023-12-02T01:27:45.304 INFO:teuthology.orchestra.run.smithi167.stdout:(126/150): python3-tempora-5.0.0-2.el9.noarch.r 861 kB/s | 36 kB 00:00 2023-12-02T01:27:45.326 INFO:teuthology.orchestra.run.smithi001.stdout:(113/150): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2023-12-02T01:27:45.352 INFO:teuthology.orchestra.run.smithi001.stdout:(114/150): python3-google-auth-2.23.4-1.el9.noa 840 kB/s | 197 kB 00:00 2023-12-02T01:27:45.362 INFO:teuthology.orchestra.run.smithi167.stdout:(127/150): python3-typing-extensions-4.4.0-2.el 877 kB/s | 51 kB 00:00 2023-12-02T01:27:45.377 INFO:teuthology.orchestra.run.smithi001.stdout:(115/150): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2023-12-02T01:27:45.402 INFO:teuthology.orchestra.run.smithi001.stdout:(116/150): python3-jwt+crypto-2.4.0-1.el9.noarc 120 kB/s | 9.0 kB 00:00 2023-12-02T01:27:45.427 INFO:teuthology.orchestra.run.smithi001.stdout:(117/150): python3-jwt-2.4.0-1.el9.noarch.rpm 541 kB/s | 41 kB 00:00 2023-12-02T01:27:45.496 INFO:teuthology.orchestra.run.smithi167.stdout:(128/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2023-12-02T01:27:45.511 INFO:teuthology.orchestra.run.smithi001.stdout:(118/150): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2023-12-02T01:27:45.528 INFO:teuthology.orchestra.run.smithi001.stdout:(119/150): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2023-12-02T01:27:45.561 INFO:teuthology.orchestra.run.smithi001.stdout:(120/150): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2023-12-02T01:27:45.587 INFO:teuthology.orchestra.run.smithi001.stdout:(121/150): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2023-12-02T01:27:45.597 INFO:teuthology.orchestra.run.smithi167.stdout:(129/150): python3-kubernetes-26.1.0-2.el9.noar 801 kB/s | 1.0 MB 00:01 2023-12-02T01:27:45.622 INFO:teuthology.orchestra.run.smithi167.stdout:(130/150): python3-websocket-client-1.2.3-2.el9 715 kB/s | 90 kB 00:00 2023-12-02T01:27:45.637 INFO:teuthology.orchestra.run.smithi001.stdout:(122/150): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2023-12-02T01:27:45.665 INFO:teuthology.orchestra.run.smithi001.stdout:(123/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2023-12-02T01:27:45.666 INFO:teuthology.orchestra.run.smithi167.stdout:(131/150): python3-zc-lockfile-2.0-10.el9.noarc 482 kB/s | 20 kB 00:00 2023-12-02T01:27:45.688 INFO:teuthology.orchestra.run.smithi001.stdout:(124/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2023-12-02T01:27:45.713 INFO:teuthology.orchestra.run.smithi001.stdout:(125/150): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2023-12-02T01:27:45.738 INFO:teuthology.orchestra.run.smithi001.stdout:(126/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2023-12-02T01:27:45.763 INFO:teuthology.orchestra.run.smithi001.stdout:(127/150): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2023-12-02T01:27:45.781 INFO:teuthology.orchestra.run.smithi167.stdout:(132/150): libarrow-9.0.0-9.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2023-12-02T01:27:45.788 INFO:teuthology.orchestra.run.smithi001.stdout:(128/150): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2023-12-02T01:27:45.814 INFO:teuthology.orchestra.run.smithi001.stdout:(129/150): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2023-12-02T01:27:45.873 INFO:teuthology.orchestra.run.smithi001.stdout:(130/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2023-12-02T01:27:45.898 INFO:teuthology.orchestra.run.smithi001.stdout:(131/150): python3-websocket-client-1.2.3-2.el9 824 kB/s | 90 kB 00:00 2023-12-02T01:27:45.981 INFO:teuthology.orchestra.run.smithi167.stdout:(133/150): re2-20211101-3.el9.x86_64.rpm 604 kB/s | 192 kB 00:00 2023-12-02T01:27:46.006 INFO:teuthology.orchestra.run.smithi001.stdout:(132/150): python3-zc-lockfile-2.0-10.el9.noarc 149 kB/s | 20 kB 00:00 2023-12-02T01:27:46.031 INFO:teuthology.orchestra.run.smithi167.stdout:(134/150): python3-werkzeug-2.0.3-3.el9.1.noarc 983 kB/s | 427 kB 00:00 2023-12-02T01:27:46.032 INFO:teuthology.orchestra.run.smithi001.stdout:(133/150): python3-werkzeug-2.0.3-3.el9.1.noarc 1.9 MB/s | 427 kB 00:00 2023-12-02T01:27:46.057 INFO:teuthology.orchestra.run.smithi001.stdout:(134/150): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2023-12-02T01:27:46.107 INFO:teuthology.orchestra.run.smithi001.stdout:(135/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2023-12-02T01:27:46.141 INFO:teuthology.orchestra.run.smithi001.stdout:(136/150): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-02T01:27:46.191 INFO:teuthology.orchestra.run.smithi001.stdout:(137/150): acl-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2023-12-02T01:27:46.233 INFO:teuthology.orchestra.run.smithi001.stdout:(138/150): elfutils-debuginfod-client-0.190-1.e 880 kB/s | 36 kB 00:00 2023-12-02T01:27:46.267 INFO:teuthology.orchestra.run.smithi001.stdout:(139/150): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-12-02T01:27:46.317 INFO:teuthology.orchestra.run.smithi001.stdout:(140/150): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-12-02T01:27:46.359 INFO:teuthology.orchestra.run.smithi001.stdout:(141/150): libacl-2.3.1-4.el9.x86_64.rpm 527 kB/s | 22 kB 00:00 2023-12-02T01:27:46.434 INFO:teuthology.orchestra.run.smithi001.stdout:(142/150): librbd1-18.0.0-7631.gbed76814.el9.x8 8.0 MB/s | 3.0 MB 00:00 2023-12-02T01:27:46.460 INFO:teuthology.orchestra.run.smithi001.stdout:(143/150): xfsdump-3.1.12-4.el9.x86_64.rpm 3.1 MB/s | 321 kB 00:00 2023-12-02T01:27:46.665 INFO:teuthology.orchestra.run.smithi167.stdout:(135/150): librados2-18.0.0-7631.gbed76814.el9. 4.8 MB/s | 3.3 MB 00:00 2023-12-02T01:27:46.707 INFO:teuthology.orchestra.run.smithi167.stdout:(136/150): thrift-0.15.0-2.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2023-12-02T01:27:46.732 INFO:teuthology.orchestra.run.smithi167.stdout:(137/150): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2023-12-02T01:27:46.774 INFO:teuthology.orchestra.run.smithi167.stdout:(138/150): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2023-12-02T01:27:46.799 INFO:teuthology.orchestra.run.smithi167.stdout:(139/150): elfutils-debuginfod-client-0.190-1.e 547 kB/s | 36 kB 00:00 2023-12-02T01:27:46.850 INFO:teuthology.orchestra.run.smithi167.stdout:(140/150): librbd1-18.0.0-7631.gbed76814.el9.x8 3.7 MB/s | 3.0 MB 00:00 2023-12-02T01:27:46.875 INFO:teuthology.orchestra.run.smithi167.stdout:(141/150): elfutils-libelf-0.190-1.el9.x86_64.r 1.9 MB/s | 192 kB 00:00 2023-12-02T01:27:46.900 INFO:teuthology.orchestra.run.smithi167.stdout:(142/150): elfutils-libs-0.190-1.el9.x86_64.rpm 2.5 MB/s | 255 kB 00:00 2023-12-02T01:27:46.917 INFO:teuthology.orchestra.run.smithi167.stdout:(143/150): libacl-2.3.1-4.el9.x86_64.rpm 330 kB/s | 22 kB 00:00 2023-12-02T01:27:46.951 INFO:teuthology.orchestra.run.smithi167.stdout:(144/150): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-02T01:27:47.051 INFO:teuthology.orchestra.run.smithi167.stdout:(145/150): NetworkManager-team-1.45.7-1.el9.x86 432 kB/s | 43 kB 00:00 2023-12-02T01:27:47.160 INFO:teuthology.orchestra.run.smithi167.stdout:(146/150): NetworkManager-libnm-1.45.7-1.el9.x8 7.3 MB/s | 1.8 MB 00:00 2023-12-02T01:27:47.185 INFO:teuthology.orchestra.run.smithi167.stdout:(147/150): NetworkManager-tui-1.45.7-1.el9.x86_ 1.8 MB/s | 246 kB 00:00 2023-12-02T01:27:47.227 INFO:teuthology.orchestra.run.smithi167.stdout:(148/150): NetworkManager-1.45.7-1.el9.x86_64.r 6.9 MB/s | 2.3 MB 00:00 2023-12-02T01:27:47.261 INFO:teuthology.orchestra.run.smithi167.stdout:(149/150): openssl-3.0.7-25.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2023-12-02T01:27:47.293 INFO:teuthology.orchestra.run.smithi001.stdout:(144/150): NetworkManager-libnm-1.45.7-1.el9.x8 2.1 MB/s | 1.8 MB 00:00 2023-12-02T01:27:47.328 INFO:teuthology.orchestra.run.smithi167.stdout:(150/150): openssl-libs-3.0.7-25.el9.x86_64.rpm 15 MB/s | 2.2 MB 00:00 2023-12-02T01:27:47.335 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-12-02T01:27:47.335 INFO:teuthology.orchestra.run.smithi167.stdout:Total 10 MB/s | 204 MB 00:19 2023-12-02T01:27:47.343 INFO:teuthology.orchestra.run.smithi001.stdout:(145/150): NetworkManager-1.45.7-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2023-12-02T01:27:47.393 INFO:teuthology.orchestra.run.smithi001.stdout:(146/150): NetworkManager-team-1.45.7-1.el9.x86 432 kB/s | 43 kB 00:00 2023-12-02T01:27:47.460 INFO:teuthology.orchestra.run.smithi001.stdout:(147/150): NetworkManager-tui-1.45.7-1.el9.x86_ 2.1 MB/s | 246 kB 00:00 2023-12-02T01:27:47.509 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-12-02T01:27:47.552 INFO:teuthology.orchestra.run.smithi001.stdout:(148/150): openssl-3.0.7-25.el9.x86_64.rpm 7.6 MB/s | 1.2 MB 00:00 2023-12-02T01:27:47.653 INFO:teuthology.orchestra.run.smithi001.stdout:(149/150): openssl-libs-3.0.7-25.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2023-12-02T01:27:47.696 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-12-02T01:27:47.696 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-12-02T01:27:47.828 INFO:teuthology.orchestra.run.smithi001.stdout:(150/150): librados2-18.0.0-7631.gbed76814.el9. 1.8 MB/s | 3.3 MB 00:01 2023-12-02T01:27:47.832 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2023-12-02T01:27:47.832 INFO:teuthology.orchestra.run.smithi001.stdout:Total 9.4 MB/s | 204 MB 00:21 2023-12-02T01:27:48.013 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2023-12-02T01:27:48.219 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2023-12-02T01:27:48.219 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2023-12-02T01:27:49.548 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-12-02T01:27:49.549 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-12-02T01:27:50.117 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2023-12-02T01:27:50.117 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2023-12-02T01:27:55.541 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-12-02T01:27:55.656 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2023-12-02T01:27:55.690 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/165 2023-12-02T01:27:55.729 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/165 2023-12-02T01:27:55.765 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/165 2023-12-02T01:27:55.791 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2023-12-02T01:27:55.837 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2023-12-02T01:27:56.170 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2023-12-02T01:27:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 8/165 2023-12-02T01:27:56.582 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 8/165 2023-12-02T01:27:56.611 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 9/165 2023-12-02T01:27:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2023-12-02T01:27:56.702 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 9/165 2023-12-02T01:27:56.737 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 10/165 2023-12-02T01:27:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2023-12-02T01:27:56.776 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2023-12-02T01:27:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/165 2023-12-02T01:27:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/165 2023-12-02T01:27:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/165 2023-12-02T01:27:56.899 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2023-12-02T01:27:56.954 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2023-12-02T01:27:56.984 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/165 2023-12-02T01:27:57.030 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/165 2023-12-02T01:27:57.049 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 14/165 2023-12-02T01:27:57.134 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 14/165 2023-12-02T01:27:57.159 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 15/165 2023-12-02T01:27:57.302 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2023-12-02T01:27:57.369 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 8/165 2023-12-02T01:27:57.377 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 15/165 2023-12-02T01:27:57.491 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 8/165 2023-12-02T01:27:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-02T01:27:57.520 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 9/165 2023-12-02T01:27:57.540 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-02T01:27:57.604 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 9/165 2023-12-02T01:27:57.637 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 10/165 2023-12-02T01:27:57.644 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-02T01:27:57.676 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2023-12-02T01:27:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-02T01:27:57.858 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/165 2023-12-02T01:27:57.892 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-02T01:27:57.915 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/165 2023-12-02T01:27:57.933 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 14/165 2023-12-02T01:27:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/165 2023-12-02T01:27:58.036 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 14/165 2023-12-02T01:27:58.038 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/165 2023-12-02T01:27:58.059 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 15/165 2023-12-02T01:27:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/165 2023-12-02T01:27:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/165 2023-12-02T01:27:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/165 2023-12-02T01:27:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/165 2023-12-02T01:27:58.265 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 15/165 2023-12-02T01:27:58.275 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/165 2023-12-02T01:27:58.349 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/165 2023-12-02T01:27:58.383 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/165 2023-12-02T01:27:58.388 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-02T01:27:58.417 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/165 2023-12-02T01:27:58.445 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2023-12-02T01:27:58.448 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-02T01:27:58.515 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2023-12-02T01:27:58.540 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-02T01:27:58.550 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 30/165 2023-12-02T01:27:58.583 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-02T01:27:58.585 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 31/165 2023-12-02T01:27:58.614 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 32/165 2023-12-02T01:27:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/165 2023-12-02T01:27:58.760 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/165 2023-12-02T01:27:58.784 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-02T01:27:58.886 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/165 2023-12-02T01:27:58.896 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/165 2023-12-02T01:27:58.920 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/165 2023-12-02T01:27:59.010 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/165 2023-12-02T01:27:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/165 2023-12-02T01:27:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/165 2023-12-02T01:27:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/165 2023-12-02T01:27:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/165 2023-12-02T01:27:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/165 2023-12-02T01:27:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/165 2023-12-02T01:27:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/165 2023-12-02T01:27:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/165 2023-12-02T01:27:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2023-12-02T01:27:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2023-12-02T01:27:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 30/165 2023-12-02T01:27:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 31/165 2023-12-02T01:27:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 32/165 2023-12-02T01:27:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/165 2023-12-02T01:27:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/165 2023-12-02T01:27:59.756 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/165 2023-12-02T01:27:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/165 2023-12-02T01:27:59.842 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/165 2023-12-02T01:27:59.887 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 39/165 2023-12-02T01:27:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/165 2023-12-02T01:27:59.944 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 40/165 2023-12-02T01:27:59.978 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 41/165 2023-12-02T01:28:00.021 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/165 2023-12-02T01:28:00.171 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/165 2023-12-02T01:28:00.220 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 44/165 2023-12-02T01:28:00.327 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-3.el9.x86_64 45/165 2023-12-02T01:28:00.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 46/165 2023-12-02T01:28:00.420 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/165 2023-12-02T01:28:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/165 2023-12-02T01:28:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/165 2023-12-02T01:28:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/165 2023-12-02T01:28:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/165 2023-12-02T01:28:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/165 2023-12-02T01:28:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 39/165 2023-12-02T01:28:00.608 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/165 2023-12-02T01:28:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 40/165 2023-12-02T01:28:00.653 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/165 2023-12-02T01:28:00.676 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 41/165 2023-12-02T01:28:00.696 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/165 2023-12-02T01:28:00.718 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/165 2023-12-02T01:28:00.830 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/165 2023-12-02T01:28:00.856 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/165 2023-12-02T01:28:00.882 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/165 2023-12-02T01:28:00.910 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 44/165 2023-12-02T01:28:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/165 2023-12-02T01:28:01.016 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/165 2023-12-02T01:28:01.020 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-3.el9.x86_64 45/165 2023-12-02T01:28:01.055 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 46/165 2023-12-02T01:28:01.056 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/165 2023-12-02T01:28:01.098 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/165 2023-12-02T01:28:01.110 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/165 2023-12-02T01:28:01.121 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/165 2023-12-02T01:28:01.193 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/165 2023-12-02T01:28:01.216 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 61/165 2023-12-02T01:28:01.230 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/165 2023-12-02T01:28:01.258 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/165 2023-12-02T01:28:01.267 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/165 2023-12-02T01:28:01.306 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/165 2023-12-02T01:28:01.314 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/165 2023-12-02T01:28:01.359 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/165 2023-12-02T01:28:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/165 2023-12-02T01:28:01.401 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/165 2023-12-02T01:28:01.539 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/165 2023-12-02T01:28:01.551 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/165 2023-12-02T01:28:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/165 2023-12-02T01:28:01.604 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/165 2023-12-02T01:28:01.628 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/165 2023-12-02T01:28:01.723 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/165 2023-12-02T01:28:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/165 2023-12-02T01:28:01.761 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/165 2023-12-02T01:28:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/165 2023-12-02T01:28:01.802 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/165 2023-12-02T01:28:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/165 2023-12-02T01:28:01.834 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/165 2023-12-02T01:28:01.843 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/165 2023-12-02T01:28:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/165 2023-12-02T01:28:01.906 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/165 2023-12-02T01:28:01.932 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 61/165 2023-12-02T01:28:01.934 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/165 2023-12-02T01:28:01.979 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/165 2023-12-02T01:28:01.980 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/165 2023-12-02T01:28:02.014 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/165 2023-12-02T01:28:02.037 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/165 2023-12-02T01:28:02.044 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/165 2023-12-02T01:28:02.093 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/165 2023-12-02T01:28:02.120 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/165 2023-12-02T01:28:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 78/165 2023-12-02T01:28:02.188 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/165 2023-12-02T01:28:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/165 2023-12-02T01:28:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/165 2023-12-02T01:28:02.289 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/165 2023-12-02T01:28:02.350 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/165 2023-12-02T01:28:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/165 2023-12-02T01:28:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 83/165 2023-12-02T01:28:02.485 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/165 2023-12-02T01:28:02.500 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/165 2023-12-02T01:28:02.534 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/165 2023-12-02T01:28:02.544 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/165 2023-12-02T01:28:02.573 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/165 2023-12-02T01:28:02.607 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/165 2023-12-02T01:28:02.639 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/165 2023-12-02T01:28:02.669 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/165 2023-12-02T01:28:02.698 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/165 2023-12-02T01:28:02.743 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/165 2023-12-02T01:28:02.777 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/165 2023-12-02T01:28:02.807 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/165 2023-12-02T01:28:02.885 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/165 2023-12-02T01:28:02.934 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 78/165 2023-12-02T01:28:02.967 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/165 2023-12-02T01:28:03.009 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/165 2023-12-02T01:28:03.060 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/165 2023-12-02T01:28:03.152 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/165 2023-12-02T01:28:03.188 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 83/165 2023-12-02T01:28:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/165 2023-12-02T01:28:03.284 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/165 2023-12-02T01:28:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/165 2023-12-02T01:28:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/165 2023-12-02T01:28:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/165 2023-12-02T01:28:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/165 2023-12-02T01:28:03.568 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/165 2023-12-02T01:28:03.596 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/165 2023-12-02T01:28:03.675 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/165 2023-12-02T01:28:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/165 2023-12-02T01:28:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/165 2023-12-02T01:28:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/165 2023-12-02T01:28:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/165 2023-12-02T01:28:04.326 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/165 2023-12-02T01:28:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/165 2023-12-02T01:28:04.435 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/165 2023-12-02T01:28:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/165 2023-12-02T01:28:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/165 2023-12-02T01:28:05.204 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/165 2023-12-02T01:28:05.325 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/165 2023-12-02T01:28:05.684 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/165 2023-12-02T01:28:05.757 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/165 2023-12-02T01:28:05.823 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/165 2023-12-02T01:28:05.823 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : jq-1.6-16.el9.x86_64 98/165 2023-12-02T01:28:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2023-12-02T01:28:05.881 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 100/165 2023-12-02T01:28:06.181 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2023-12-02T01:28:06.211 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 102/165 2023-12-02T01:28:06.310 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 102/165 2023-12-02T01:28:06.341 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 103/165 2023-12-02T01:28:06.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2023-12-02T01:28:06.611 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/165 2023-12-02T01:28:06.683 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/165 2023-12-02T01:28:06.714 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/165 2023-12-02T01:28:06.745 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : jq-1.6-16.el9.x86_64 98/165 2023-12-02T01:28:06.774 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2023-12-02T01:28:06.806 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 105/165 2023-12-02T01:28:06.807 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 100/165 2023-12-02T01:28:06.839 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 106/165 2023-12-02T01:28:06.910 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 106/165 2023-12-02T01:28:06.932 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 107/165 2023-12-02T01:28:07.124 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2023-12-02T01:28:07.153 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 102/165 2023-12-02T01:28:07.236 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 102/165 2023-12-02T01:28:07.266 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 103/165 2023-12-02T01:28:07.303 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2023-12-02T01:28:07.744 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 105/165 2023-12-02T01:28:07.781 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 106/165 2023-12-02T01:28:07.852 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 106/165 2023-12-02T01:28:07.874 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 107/165 2023-12-02T01:28:09.006 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 108/165 2023-12-02T01:28:09.040 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 108/165 2023-12-02T01:28:09.579 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 108/165 2023-12-02T01:28:09.625 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 109/165 2023-12-02T01:28:09.729 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 109/165 2023-12-02T01:28:09.729 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-02T01:28:09.729 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-02T01:28:09.729 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:09.759 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 110/165 2023-12-02T01:28:10.089 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 108/165 2023-12-02T01:28:10.120 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 108/165 2023-12-02T01:28:10.699 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 108/165 2023-12-02T01:28:10.741 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 109/165 2023-12-02T01:28:10.808 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 109/165 2023-12-02T01:28:10.809 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-02T01:28:10.809 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-02T01:28:10.809 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:10.842 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 110/165 2023-12-02T01:28:21.689 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 110/165 2023-12-02T01:28:21.689 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2023-12-02T01:28:21.689 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2023-12-02T01:28:21.689 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2023-12-02T01:28:21.689 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2023-12-02T01:28:21.689 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2023-12-02T01:28:21.690 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2023-12-02T01:28:21.690 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2023-12-02T01:28:21.690 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:21.851 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 111/165 2023-12-02T01:28:21.866 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 111/165 2023-12-02T01:28:21.866 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:21.866 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-02T01:28:21.866 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 110/165 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2023-12-02T01:28:22.790 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:22.953 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 111/165 2023-12-02T01:28:22.970 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 111/165 2023-12-02T01:28:22.970 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:22.970 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-02T01:28:22.970 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:23.437 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 112/165 2023-12-02T01:28:23.462 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 112/165 2023-12-02T01:28:23.463 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:23.463 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-02T01:28:23.463 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-02T01:28:23.463 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-02T01:28:23.463 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 113/165 2023-12-02T01:28:23.695 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 113/165 2023-12-02T01:28:23.695 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:23.695 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-02T01:28:23.695 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-02T01:28:23.695 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-02T01:28:23.695 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:24.166 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 114/165 2023-12-02T01:28:24.188 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 114/165 2023-12-02T01:28:24.189 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:24.189 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-02T01:28:24.189 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-02T01:28:24.189 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-02T01:28:24.189 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:24.292 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2023-12-02T01:28:24.598 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 112/165 2023-12-02T01:28:24.625 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 112/165 2023-12-02T01:28:24.625 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:24.625 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-02T01:28:24.625 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-02T01:28:24.625 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-02T01:28:24.626 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:24.772 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 116/165 2023-12-02T01:28:24.807 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 116/165 2023-12-02T01:28:24.832 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 113/165 2023-12-02T01:28:24.837 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 117/165 2023-12-02T01:28:24.856 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 113/165 2023-12-02T01:28:24.856 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:24.856 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-02T01:28:24.856 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-02T01:28:24.856 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-02T01:28:24.856 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:24.899 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 118/165 2023-12-02T01:28:24.923 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 119/165 2023-12-02T01:28:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 119/165 2023-12-02T01:28:25.182 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 120/165 2023-12-02T01:28:25.333 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 114/165 2023-12-02T01:28:25.356 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 114/165 2023-12-02T01:28:25.356 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:25.357 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-02T01:28:25.357 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-02T01:28:25.357 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-02T01:28:25.357 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:25.451 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2023-12-02T01:28:25.832 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 116/165 2023-12-02T01:28:25.866 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 116/165 2023-12-02T01:28:25.897 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 117/165 2023-12-02T01:28:25.960 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 118/165 2023-12-02T01:28:25.989 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 119/165 2023-12-02T01:28:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 120/165 2023-12-02T01:28:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 121/165 2023-12-02T01:28:26.226 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 119/165 2023-12-02T01:28:26.257 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 120/165 2023-12-02T01:28:26.281 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 121/165 2023-12-02T01:28:26.440 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 122/165 2023-12-02T01:28:26.476 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 123/165 2023-12-02T01:28:26.499 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 123/165 2023-12-02T01:28:26.499 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:26.499 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-02T01:28:26.499 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-02T01:28:26.499 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-02T01:28:26.499 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:26.543 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 124/165 2023-12-02T01:28:26.554 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 124/165 2023-12-02T01:28:26.602 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 125/165 2023-12-02T01:28:27.273 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 120/165 2023-12-02T01:28:27.299 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 121/165 2023-12-02T01:28:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/165 2023-12-02T01:28:27.395 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 127/165 2023-12-02T01:28:27.402 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 121/165 2023-12-02T01:28:27.418 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 127/165 2023-12-02T01:28:27.418 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:27.418 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-02T01:28:27.418 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-02T01:28:27.418 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-02T01:28:27.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:27.463 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 128/165 2023-12-02T01:28:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7631.gbed76 128/165 2023-12-02T01:28:27.485 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:27.485 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-02T01:28:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:27.530 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 129/165 2023-12-02T01:28:27.552 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 129/165 2023-12-02T01:28:27.552 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:27.552 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-02T01:28:27.553 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-02T01:28:27.553 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-02T01:28:27.553 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:27.563 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 122/165 2023-12-02T01:28:27.592 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 123/165 2023-12-02T01:28:27.617 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 123/165 2023-12-02T01:28:27.617 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:27.618 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-02T01:28:27.618 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-02T01:28:27.618 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-02T01:28:27.618 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:27.668 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 124/165 2023-12-02T01:28:27.679 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 124/165 2023-12-02T01:28:27.732 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 125/165 2023-12-02T01:28:27.856 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/165 2023-12-02T01:28:27.878 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/165 2023-12-02T01:28:27.878 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:27.878 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-02T01:28:27.878 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-02T01:28:27.878 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-02T01:28:27.879 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:28.552 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/165 2023-12-02T01:28:28.586 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 127/165 2023-12-02T01:28:28.611 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 127/165 2023-12-02T01:28:28.611 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:28.611 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-02T01:28:28.611 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-02T01:28:28.611 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-02T01:28:28.611 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:28.654 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 128/165 2023-12-02T01:28:28.677 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7631.gbed76 128/165 2023-12-02T01:28:28.677 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:28.678 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-02T01:28:28.678 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:28.721 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 129/165 2023-12-02T01:28:28.745 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 129/165 2023-12-02T01:28:28.745 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:28.745 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-02T01:28:28.745 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-02T01:28:28.746 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-02T01:28:28.746 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:29.055 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/165 2023-12-02T01:28:29.079 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/165 2023-12-02T01:28:29.079 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-02T01:28:29.080 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-02T01:28:29.080 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-02T01:28:29.080 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-02T01:28:29.080 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:31.726 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 131/165 2023-12-02T01:28:31.776 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 132/165 2023-12-02T01:28:31.817 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 133/165 2023-12-02T01:28:31.849 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 134/165 2023-12-02T01:28:32.025 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 135/165 2023-12-02T01:28:32.140 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 136/165 2023-12-02T01:28:32.173 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 137/165 2023-12-02T01:28:32.206 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 138/165 2023-12-02T01:28:32.266 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 139/165 2023-12-02T01:28:32.332 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-02T01:28:32.374 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 141/165 2023-12-02T01:28:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 142/165 2023-12-02T01:28:32.442 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 143/165 2023-12-02T01:28:33.090 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-02T01:28:33.117 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 131/165 2023-12-02T01:28:33.133 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-02T01:28:33.153 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-02T01:28:33.167 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 132/165 2023-12-02T01:28:33.208 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 133/165 2023-12-02T01:28:33.239 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 134/165 2023-12-02T01:28:33.423 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 135/165 2023-12-02T01:28:33.534 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 136/165 2023-12-02T01:28:33.571 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 137/165 2023-12-02T01:28:33.603 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 138/165 2023-12-02T01:28:33.682 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 139/165 2023-12-02T01:28:33.742 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-02T01:28:33.780 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 141/165 2023-12-02T01:28:33.827 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 142/165 2023-12-02T01:28:33.872 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 143/165 2023-12-02T01:28:33.999 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 145/165 2023-12-02T01:28:34.106 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2023-12-02T01:28:34.163 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 147/165 2023-12-02T01:28:34.205 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/165 2023-12-02T01:28:34.311 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/165 2023-12-02T01:28:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/165 2023-12-02T01:28:34.368 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/165 2023-12-02T01:28:34.394 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 152/165 2023-12-02T01:28:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 153/165 2023-12-02T01:28:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-02T01:28:34.504 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-02T01:28:34.529 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-02T01:28:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 155/165 2023-12-02T01:28:34.563 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-02T01:28:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 156/165 2023-12-02T01:28:34.583 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-02T01:28:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2023-12-02T01:28:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-02T01:28:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-02T01:28:34.689 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-02T01:28:34.696 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-02T01:28:34.696 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-02T01:28:34.875 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-02T01:28:34.876 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-02T01:28:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-02T01:28:34.983 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2023-12-02T01:28:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2023-12-02T01:28:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 164/165 2023-12-02T01:28:35.108 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-02T01:28:35.462 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 145/165 2023-12-02T01:28:35.566 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2023-12-02T01:28:35.625 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 147/165 2023-12-02T01:28:35.667 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/165 2023-12-02T01:28:35.760 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/165 2023-12-02T01:28:35.796 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/165 2023-12-02T01:28:35.821 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/165 2023-12-02T01:28:35.846 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 152/165 2023-12-02T01:28:35.872 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 153/165 2023-12-02T01:28:35.873 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-02T01:28:35.951 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-02T01:28:35.979 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 155/165 2023-12-02T01:28:36.009 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 156/165 2023-12-02T01:28:36.034 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2023-12-02T01:28:36.034 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-02T01:28:36.102 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-02T01:28:36.127 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-02T01:28:36.134 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-02T01:28:36.134 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-02T01:28:36.321 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-02T01:28:36.321 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-02T01:28:36.405 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-02T01:28:36.429 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2023-12-02T01:28:36.454 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2023-12-02T01:28:36.480 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 164/165 2023-12-02T01:28:36.547 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-02T01:28:39.742 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-02T01:28:39.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 1/165 2023-12-02T01:28:39.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2/165 2023-12-02T01:28:39.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 3/165 2023-12-02T01:28:39.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 4/165 2023-12-02T01:28:39.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 5/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 6/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 7/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 8/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 9/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 10/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 11/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 12/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 13/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 14/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 15/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 16/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 17/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 18/165 2023-12-02T01:28:39.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 19/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 20/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 21/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 22/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 23/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 24/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 25/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 26/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 27/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 28/165 2023-12-02T01:28:39.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 29/165 2023-12-02T01:28:39.756 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 30/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 31/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 32/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 33/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 34/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 35/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 36/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 37/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 38/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/165 2023-12-02T01:28:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : jq-1.6-16.el9.x86_64 47/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/165 2023-12-02T01:28:39.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/165 2023-12-02T01:28:39.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/165 2023-12-02T01:28:39.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 98/165 2023-12-02T01:28:39.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 99/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 103/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 110/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2023-12-02T01:28:39.762 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 116/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 117/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/165 2023-12-02T01:28:39.763 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 136/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 138/165 2023-12-02T01:28:39.764 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 141/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : acl-2.3.1-4.el9.x86_64 142/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : acl-2.3.1-3.el9.x86_64 143/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 144/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 146/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 147/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 148/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 149/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/165 2023-12-02T01:28:39.765 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 154/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 155/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 156/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 157/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 158/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 160/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 161/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/165 2023-12-02T01:28:39.766 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/165 2023-12-02T01:28:41.031 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-02T01:28:41.031 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 1/165 2023-12-02T01:28:41.031 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2/165 2023-12-02T01:28:41.031 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 3/165 2023-12-02T01:28:41.031 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 4/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 5/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 6/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 7/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 8/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 9/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 10/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 11/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 12/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 13/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 14/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 15/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 16/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 17/165 2023-12-02T01:28:41.032 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 18/165 2023-12-02T01:28:41.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 19/165 2023-12-02T01:28:41.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 20/165 2023-12-02T01:28:41.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 21/165 2023-12-02T01:28:41.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 22/165 2023-12-02T01:28:41.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 23/165 2023-12-02T01:28:41.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 24/165 2023-12-02T01:28:41.033 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 25/165 2023-12-02T01:28:41.047 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 26/165 2023-12-02T01:28:41.047 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 27/165 2023-12-02T01:28:41.047 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 28/165 2023-12-02T01:28:41.047 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 29/165 2023-12-02T01:28:41.047 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 30/165 2023-12-02T01:28:41.047 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 31/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 32/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 33/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 34/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 35/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 36/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 37/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 38/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2023-12-02T01:28:41.048 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : jq-1.6-16.el9.x86_64 47/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/165 2023-12-02T01:28:41.049 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/165 2023-12-02T01:28:41.050 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/165 2023-12-02T01:28:41.051 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2023-12-02T01:28:41.052 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 98/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 99/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 103/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2023-12-02T01:28:41.053 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 110/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 116/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 117/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/165 2023-12-02T01:28:41.054 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/165 2023-12-02T01:28:41.055 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 136/165 2023-12-02T01:28:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/165 2023-12-02T01:28:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 138/165 2023-12-02T01:28:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/165 2023-12-02T01:28:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-02T01:28:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 141/165 2023-12-02T01:28:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : acl-2.3.1-4.el9.x86_64 142/165 2023-12-02T01:28:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : acl-2.3.1-3.el9.x86_64 143/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 144/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 146/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 147/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 148/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 149/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 154/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 155/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 156/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 157/165 2023-12-02T01:28:41.057 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 158/165 2023-12-02T01:28:41.058 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-02T01:28:41.058 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 160/165 2023-12-02T01:28:41.058 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 161/165 2023-12-02T01:28:41.058 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/165 2023-12-02T01:28:41.058 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/165 2023-12-02T01:28:41.058 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/165 2023-12-02T01:28:42.368 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/165 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: acl-2.3.1-4.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-02T01:28:42.369 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.370 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.371 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: jq-1.6-16.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-02T01:28:42.372 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.11-1.el9.x86_64 2023-12-02T01:28:42.374 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-02T01:28:42.375 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-02T01:28:42.376 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-02T01:28:42.377 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-02T01:28:42.378 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-3.el9.x86_64 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-02T01:28:42.379 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-02T01:28:42.380 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-02T01:28:42.380 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-02T01:28:42.380 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:42.380 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-12-02T01:28:42.934 DEBUG:teuthology.parallel:result is None 2023-12-02T01:28:43.461 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/165 2023-12-02T01:28:43.461 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:43.461 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2023-12-02T01:28:43.461 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:43.461 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: acl-2.3.1-4.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.462 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.463 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.464 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: jq-1.6-16.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-02T01:28:43.465 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.466 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-02T01:28:43.467 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.11-1.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-02T01:28:43.468 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-02T01:28:43.469 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-02T01:28:43.470 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-02T01:28:43.471 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-3.el9.x86_64 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-02T01:28:43.472 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-02T01:28:43.473 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-02T01:28:43.473 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-02T01:28:43.473 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-02T01:28:43.473 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:43.473 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2023-12-02T01:28:44.054 DEBUG:teuthology.parallel:result is None 2023-12-02T01:28:44.054 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-02T01:28:44.201 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-02T01:28:44.226 INFO:teuthology.orchestra.run.smithi001.stdout:18.0.0-7631.gbed76814.el9 2023-12-02T01:28:44.226 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7631.gbed76814.el9 2023-12-02T01:28:44.226 INFO:teuthology.task.install:The correct ceph version 18.0.0-7631.gbed76814 is installed. 2023-12-02T01:28:44.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-02T01:28:44.368 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-02T01:28:44.393 INFO:teuthology.orchestra.run.smithi167.stdout:18.0.0-7631.gbed76814.el9 2023-12-02T01:28:44.394 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7631.gbed76814.el9 2023-12-02T01:28:44.394 INFO:teuthology.task.install:The correct ceph version 18.0.0-7631.gbed76814 is installed. 2023-12-02T01:28:44.394 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-02T01:28:44.394 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:44.394 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-02T01:28:44.432 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:44.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-02T01:28:44.466 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-02T01:28:44.467 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:44.467 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2023-12-02T01:28:44.506 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-02T01:28:44.578 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:44.579 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2023-12-02T01:28:44.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-02T01:28:44.679 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-02T01:28:44.680 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:44.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-02T01:28:44.712 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-02T01:28:44.784 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:44.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-02T01:28:44.815 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-02T01:28:44.884 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-02T01:28:44.884 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:44.884 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2023-12-02T01:28:44.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-02T01:28:44.990 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:44.990 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2023-12-02T01:28:45.018 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-02T01:28:45.088 INFO:teuthology.run_tasks:Running task ceph... 2023-12-02T01:28:45.155 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-02T01:28:45.155 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /var/log/ceph 2023-12-02T01:28:45.157 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2023-12-02T01:28:45.187 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-02T01:28:45.187 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-02T01:28:45.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-02T01:28:45.259 INFO:tasks.ceph:Creating extra log directories... 2023-12-02T01:28:45.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-02T01:28:45.302 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-02T01:28:45.337 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-02T01:28:45.337 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-02T01:28:45.337 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-02T01:28:45.337 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:45.338 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-02T01:28:45.387 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-02T01:28:45.520 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-02T01:28:45.552 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:45.552 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-02T01:28:45.568 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-02T01:28:45.691 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-02T01:28:45.723 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-02T01:28:45.723 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-02T01:28:45.723 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474690', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7474690', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1991, 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi001.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKMOqRhUMzD7tBFZ+s2VhR5buspxbKXCSUd2Sy6WSJgzRfWzCtEQxyRViqMPBpY8vqdbm8xhdW/YCmP6QlMGn0=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMx/y8abdAAMZBvrX7yzmISe8AJ15d4CDALsOQREw9fUmrnrk0kmJ8iLgeUbTmm+OCd/lOCuq5NujbDpVbM11R0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-01_17:57:53', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-02T01:28:45.724 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-02T01:28:45.726 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-02T01:28:45.773 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/run/ceph 2023-12-02T01:28:45.782 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2023-12-02T01:28:45.840 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:45.840 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2023-12-02T01:28:45.869 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-02T01:28:45.869 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2023-12-02T01:28:45.925 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-02T01:28:45.925 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:45.925 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-02T01:28:45.925 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:45.926 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:45.926 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-12-02 01:28:36.872885511 +0000 2023-12-02T01:28:45.926 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-12-02 01:26:29.513656705 +0000 2023-12-02T01:28:45.926 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-12-02 01:26:29.513656705 +0000 2023-12-02T01:28:45.926 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2023-12-02 01:26:29.513656705 +0000 2023-12-02T01:28:45.926 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-02T01:28:45.996 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-12-02T01:28:45.996 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-12-02T01:28:45.996 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000104718 s, 4.9 MB/s 2023-12-02T01:28:45.997 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-02T01:28:46.055 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2023-12-02T01:28:46.112 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-02T01:28:46.112 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:46.112 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-02T01:28:46.112 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:46.112 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:46.112 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-12-02 01:28:36.872885511 +0000 2023-12-02T01:28:46.113 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-12-02 01:26:30.020649761 +0000 2023-12-02T01:28:46.113 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-12-02 01:26:30.020649761 +0000 2023-12-02T01:28:46.113 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2023-12-02 01:26:30.020649761 +0000 2023-12-02T01:28:46.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-02T01:28:46.183 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-12-02T01:28:46.183 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-12-02T01:28:46.183 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 9.7714e-05 s, 5.2 MB/s 2023-12-02T01:28:46.184 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-02T01:28:46.241 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2023-12-02T01:28:46.297 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-02T01:28:46.297 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:46.297 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-02T01:28:46.297 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:46.297 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:46.297 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-12-02 01:28:36.872885511 +0000 2023-12-02T01:28:46.298 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-12-02 01:26:30.534642722 +0000 2023-12-02T01:28:46.298 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-12-02 01:26:30.534642722 +0000 2023-12-02T01:28:46.298 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2023-12-02 01:26:30.534642722 +0000 2023-12-02T01:28:46.298 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-02T01:28:46.368 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-12-02T01:28:46.368 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-12-02T01:28:46.368 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000102155 s, 5.0 MB/s 2023-12-02T01:28:46.369 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-02T01:28:46.426 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2023-12-02 01:28:36.873885497 +0000 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2023-12-02 01:26:31.059635531 +0000 2023-12-02T01:28:46.483 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2023-12-02 01:26:31.059635531 +0000 2023-12-02T01:28:46.484 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2023-12-02 01:26:31.059635531 +0000 2023-12-02T01:28:46.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-02T01:28:46.554 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2023-12-02T01:28:46.555 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2023-12-02T01:28:46.555 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000106644 s, 4.8 MB/s 2023-12-02T01:28:46.556 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-02T01:28:46.614 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-02T01:28:46.614 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:46.614 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2023-12-02T01:28:46.631 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-02T01:28:46.631 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-12-02 01:28:35.443669265 +0000 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-12-02 01:26:21.405737544 +0000 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-12-02 01:26:21.405737544 +0000 2023-12-02T01:28:46.687 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-12-02 01:26:21.405737544 +0000 2023-12-02T01:28:46.688 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-02T01:28:46.753 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-12-02T01:28:46.759 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-12-02T01:28:46.759 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000221542 s, 2.3 MB/s 2023-12-02T01:28:46.760 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-02T01:28:46.817 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-12-02 01:28:35.443669265 +0000 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-12-02 01:26:21.910728605 +0000 2023-12-02T01:28:46.873 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-12-02 01:26:21.910728605 +0000 2023-12-02T01:28:46.874 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-12-02 01:26:21.910728605 +0000 2023-12-02T01:28:46.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-02T01:28:46.939 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-12-02T01:28:46.940 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-12-02T01:28:46.940 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000194592 s, 2.6 MB/s 2023-12-02T01:28:46.941 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-02T01:28:46.997 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-12-02 01:28:35.444669247 +0000 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-12-02 01:26:22.403719880 +0000 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-12-02 01:26:22.403719880 +0000 2023-12-02T01:28:47.053 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-12-02 01:26:22.403719880 +0000 2023-12-02T01:28:47.054 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-02T01:28:47.120 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-12-02T01:28:47.120 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-12-02T01:28:47.120 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000203558 s, 2.5 MB/s 2023-12-02T01:28:47.121 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-02T01:28:47.177 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2023-12-02T01:28:47.231 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-12-02 01:28:35.444669247 +0000 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-12-02 01:26:22.904711012 +0000 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-12-02 01:26:22.904711012 +0000 2023-12-02T01:28:47.232 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-12-02 01:26:22.904711012 +0000 2023-12-02T01:28:47.232 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-02T01:28:47.297 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-12-02T01:28:47.298 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-12-02T01:28:47.298 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000192986 s, 2.7 MB/s 2023-12-02T01:28:47.299 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-02T01:28:47.354 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-02T01:28:47.355 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-02T01:28:47.355 INFO:tasks.ceph:Generating config... 2023-12-02T01:28:47.356 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-02T01:28:47.356 INFO:tasks.ceph:[client] debug client = 20 2023-12-02T01:28:47.356 INFO:tasks.ceph:[client] debug ms = 1 2023-12-02T01:28:47.356 INFO:tasks.ceph:[client] pid file = 2023-12-02T01:28:47.356 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-02T01:28:47.356 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-02T01:28:47.356 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-02T01:28:47.356 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-02T01:28:47.356 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-02T01:28:47.356 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-02T01:28:47.357 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-02T01:28:47.357 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-02T01:28:47.357 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-02T01:28:47.357 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-02T01:28:47.357 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-02T01:28:47.358 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-02T01:28:47.359 INFO:tasks.ceph:Setting up mon.a... 2023-12-02T01:28:47.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-02T01:28:47.438 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.keyring 2023-12-02T01:28:47.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-02T01:28:47.494 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-02T01:28:47.526 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.1'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2023-12-02T01:28:47.527 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.1,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-02T01:28:47.528 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:47.528 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-02T01:28:47.582 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.1 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:47.671 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:47.671 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: generated fsid 0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e 2023-12-02T01:28:47.671 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = pacific 2023-12-02T01:28:47.671 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 0 2023-12-02T01:28:47.671 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e 2023-12-02T01:28:47.671 INFO:teuthology.orchestra.run.smithi001.stdout:last_changed 2023-12-02T01:28:47.670733+0000 2023-12-02T01:28:47.672 INFO:teuthology.orchestra.run.smithi001.stdout:created 2023-12-02T01:28:47.670733+0000 2023-12-02T01:28:47.672 INFO:teuthology.orchestra.run.smithi001.stdout:min_mon_release 16 (pacific) 2023-12-02T01:28:47.672 INFO:teuthology.orchestra.run.smithi001.stdout:election_strategy: 1 2023-12-02T01:28:47.672 INFO:teuthology.orchestra.run.smithi001.stdout:0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2023-12-02T01:28:47.672 INFO:teuthology.orchestra.run.smithi001.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2023-12-02T01:28:47.672 INFO:teuthology.orchestra.run.smithi001.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2023-12-02T01:28:47.672 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-02T01:28:47.673 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-02T01:28:47.689 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e... 2023-12-02T01:28:47.690 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-02T01:28:47.732 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2023-12-02T01:28:47.783 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2023-12-02T01:28:47.784 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2023-12-02T01:28:47.785 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.1,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.786 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2023-12-02T01:28:47.787 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2023-12-02T01:28:47.788 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-12-02T01:28:47.789 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2023-12-02T01:28:47.790 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2023-12-02T01:28:47.791 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2023-12-02T01:28:47.792 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-12-02T01:28:47.793 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: chdir = "" 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: auth supported = cephx 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: filestore xattr use omap = true 2023-12-02T01:28:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: mon clock drift allowed = 1.000 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: osd crush chooseleaf type = 0 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: auth debug = true 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on old message = true 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on bug = true 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: mon pg warn max object skew = 0 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: # disable pg_autoscaler by default for new pools 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-02T01:28:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default size = 2 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow primary affinity = true 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow pg remap = true 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on legacy crush tunables = false 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on crush straw calc version zero = false 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on no sortbitwise = false 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on osd down out interval zero = false 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on too few osds = false 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: mon_allow_pool_size_one = true 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-02T01:28:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: osd default data pool replay window = 5 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: mon allow pool delete = true 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: mon cluster log file level = debug 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: debug asserts on shutdown = true 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: mon health detail to clog = false 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: mon host = "172.21.15.1,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = 0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout:[osd] 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: osd journal size = 100 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub load threshold = 5.0 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub max interval = 600 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd mclock profile = high_recovery_ops 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd recover clone overlap = true 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd recovery max chunk = 1048576 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug shutdown = true 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug op order = true 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug verify stray on activate = true 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug trim objects = true 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd open classes on start = true 2023-12-02T01:28:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug pg log writeout = true 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: osd deep scrub update digest min age = 30 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: osd map max advance = 10 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: journal zero on create = true 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: filestore ondisk finisher threads = 3 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: filestore apply finisher threads = 3 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: bdev debug aio = true 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug misdirected ops = true 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: bdev async discard = True 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: bdev enable discard = True 2023-12-02T01:28:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore allocator = bitmap 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore block size = 96636764160 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore fsck on mount = True 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluefs = 1/20 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluestore = 1/20 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: debug osd = 20 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: debug rocksdb = 4/10 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd backfillfull_ratio = 0.85 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd full ratio = 0.9 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd nearfull ratio = 0.8 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: osd failsafe full ratio = 0.95 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: osd objectstore = bluestore 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2023-12-02T01:28:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr] 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug mgr = 20 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: mgr/telemetry/nag = false 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout:[mon] 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug paxos = 20 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2023-12-02T01:28:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: mon data avail warn = 5 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: mon mgr mkfs grace = 240 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd reporter subtree level = osd 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd prime pg temp = true 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: auth mon ticket ttl = 660 # 11m 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: auth service ticket ttl = 240 # 4m 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: # don't complain about insecure global_id in the test suite 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: # 1m isn't quite enough 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: mon_down_mkfs_grace = 2m 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_filestore_osds = false 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: mon op complaint time = 120 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout:[client] 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: rgw cache enabled = true 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable ops log = true 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable usage log = true 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: client mount timeout = 600 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: debug client = 20 2023-12-02T01:28:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = "" 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.a] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.b] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.c] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout:[mds] 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds = 20 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds balancer = 20 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2023-12-02T01:28:47.804 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug frag = True 2023-12-02T01:28:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug scatterstat = True 2023-12-02T01:28:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: mds op complaint time = 180 2023-12-02T01:28:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: mds verify scatter = True 2023-12-02T01:28:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2023-12-02T01:28:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2023-12-02T01:28:47.805 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2023-12-02T01:28:47.808 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-02T01:28:47.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-02T01:28:47.909 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-02T01:28:47.909 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:47.909 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-02T01:28:47.924 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:47.924 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-02T01:28:47.979 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:28:47.979 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:47.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-02T01:28:47.980 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-02T01:28:48.066 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:28:48.066 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:48.121 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:28:48.121 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:48.121 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-02T01:28:48.121 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-02T01:28:48.161 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:28:48.161 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:48.216 INFO:tasks.ceph:Setting up mon nodes... 2023-12-02T01:28:48.216 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-02T01:28:48.216 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-02T01:28:48.278 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-02T01:28:48.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-02T01:28:48.340 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-02T01:28:48.342 INFO:tasks.ceph:Setting up mds nodes... 2023-12-02T01:28:48.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-02T01:28:48.405 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-02T01:28:48.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-02T01:28:48.437 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-02T01:28:48.540 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-02T01:28:48.543 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-02T01:28:48.573 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-02T01:28:48.628 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-02T01:28:48.630 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-02T01:28:48.656 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-02T01:28:48.750 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-02T01:28:48.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-02T01:28:48.779 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-02T01:28:48.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-02T01:28:48.826 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-02T01:28:48.844 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-02T01:28:48.890 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-02T01:28:48.908 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-02T01:28:48.950 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-02T01:28:48.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-02T01:28:49.047 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-02T01:28:49.063 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-02T01:28:49.063 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-02T01:28:49.063 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-02T01:28:49.094 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-02T01:28:49.094 INFO:tasks.ceph:role: osd.0 2023-12-02T01:28:49.094 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:28:49.094 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-02T01:28:49.164 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:28:49.165 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:28:49.197 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-12-02T01:28:49.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-12-02T01:28:49.199 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-02T01:28:49.273 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-02T01:28:49.349 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-02T01:28:49.420 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-02T01:28:49.420 INFO:tasks.ceph:role: osd.1 2023-12-02T01:28:49.420 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:28:49.421 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-02T01:28:49.490 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:28:49.490 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:28:49.490 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:28:49.490 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:28:49.490 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:28:49.491 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:28:49.491 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:28:49.491 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:28:49.491 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:28:49.491 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:28:49.522 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-12-02T01:28:49.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-12-02T01:28:49.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-02T01:28:49.599 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-02T01:28:49.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-02T01:28:49.745 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-02T01:28:49.745 INFO:tasks.ceph:role: osd.2 2023-12-02T01:28:49.745 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:28:49.745 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-02T01:28:49.817 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:28:49.817 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:28:49.817 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:28:49.818 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:28:49.818 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:28:49.818 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:28:49.818 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:28:49.818 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:28:49.818 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:28:49.819 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:28:49.849 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-12-02T01:28:49.851 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-12-02T01:28:49.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-02T01:28:49.927 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-02T01:28:50.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-02T01:28:50.073 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-02T01:28:50.073 INFO:tasks.ceph:role: osd.3 2023-12-02T01:28:50.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:28:50.073 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-02T01:28:50.144 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:28:50.144 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:28:50.144 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:28:50.144 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:28:50.144 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:28:50.145 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:28:50.145 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:28:50.145 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:28:50.145 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:28:50.145 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:28:50.176 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2023-12-02T01:28:50.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2023-12-02T01:28:50.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-02T01:28:50.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-02T01:28:50.327 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:50.427+0000 7f8751a1a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-02T01:28:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:50.427+0000 7f8751a1a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-02T01:28:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:50.427+0000 7f8751a1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-02T01:28:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:50.427+0000 7f8751a1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-02T01:28:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:50.427+0000 7f8751a1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-02T01:28:50.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:50.427+0000 7f8751a1a500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-02T01:28:53.283 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-02T01:28:53.319 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:53.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:53.413+0000 7fd1e7225500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-02T01:28:53.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:53.414+0000 7fd1e7225500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-02T01:28:53.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:53.414+0000 7fd1e7225500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-02T01:28:53.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:53.414+0000 7fd1e7225500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-02T01:28:53.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:53.414+0000 7fd1e7225500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-02T01:28:53.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:53.414+0000 7fd1e7225500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-02T01:28:56.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-02T01:28:56.307 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:56.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:56.401+0000 7f5c9296e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-02T01:28:56.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:56.401+0000 7f5c9296e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-02T01:28:56.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:56.401+0000 7f5c9296e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-02T01:28:56.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:56.401+0000 7f5c9296e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-02T01:28:56.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:56.401+0000 7f5c9296e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-02T01:28:56.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:56.401+0000 7f5c9296e500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-02T01:28:59.261 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-02T01:28:59.297 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:28:59.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:59.393+0000 7fbb9ac14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-02T01:28:59.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:59.393+0000 7fbb9ac14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-02T01:28:59.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:59.393+0000 7fbb9ac14500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-02T01:28:59.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:59.393+0000 7fbb9ac14500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-02T01:28:59.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:59.393+0000 7fbb9ac14500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-02T01:28:59.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:28:59.393+0000 7fbb9ac14500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-02T01:29:02.251 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-02T01:29:02.287 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-02T01:29:02.320 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-02T01:29:02.321 INFO:tasks.ceph:role: osd.4 2023-12-02T01:29:02.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:29:02.321 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:29:02.400 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:29:02.912 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-12-02T01:29:02.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-12-02T01:29:02.914 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-02T01:29:03.045 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-02T01:29:03.081 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-02T01:29:03.149 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-02T01:29:03.150 INFO:tasks.ceph:role: osd.5 2023-12-02T01:29:03.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:29:03.150 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-02T01:29:03.224 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:29:03.224 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:29:03.224 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:29:03.224 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:29:03.224 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:29:03.224 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:29:03.225 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:29:03.225 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:29:03.225 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:29:03.225 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:29:03.677 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-12-02T01:29:03.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-12-02T01:29:03.679 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-02T01:29:03.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-02T01:29:03.804 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-02T01:29:03.872 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-02T01:29:03.872 INFO:tasks.ceph:role: osd.6 2023-12-02T01:29:03.872 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:29:03.872 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-02T01:29:03.947 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:29:03.947 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:29:03.947 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:29:03.947 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:29:03.947 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:29:03.948 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:29:03.948 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:29:03.948 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:29:03.948 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:29:03.948 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:29:04.441 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-12-02T01:29:04.442 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-12-02T01:29:04.442 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-02T01:29:04.586 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-02T01:29:04.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-02T01:29:04.688 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-02T01:29:04.688 INFO:tasks.ceph:role: osd.7 2023-12-02T01:29:04.688 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:29:04.688 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-02T01:29:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-02T01:29:04.762 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-02T01:29:04.762 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-02T01:29:04.762 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-02T01:29:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-02T01:29:04.762 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-12-02T01:29:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-02T01:29:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-02T01:29:04.763 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-02T01:29:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-02T01:29:05.281 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-12-02T01:29:05.282 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-12-02T01:29:05.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-02T01:29:05.430 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-02T01:29:05.465 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:29:05.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:05.569+0000 7fa84ae13500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-02T01:29:05.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:05.570+0000 7fa84ae13500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-02T01:29:05.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:05.570+0000 7fa84ae13500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-02T01:29:05.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:05.570+0000 7fa84ae13500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-02T01:29:05.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:05.570+0000 7fa84ae13500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-02T01:29:05.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:05.571+0000 7fa84ae13500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-02T01:29:08.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-02T01:29:08.443 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:29:08.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:08.528+0000 7f73c0449500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-02T01:29:08.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:08.528+0000 7f73c0449500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-02T01:29:08.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:08.528+0000 7f73c0449500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-02T01:29:08.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:08.528+0000 7f73c0449500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-02T01:29:08.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:08.528+0000 7f73c0449500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-02T01:29:08.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:08.529+0000 7f73c0449500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-02T01:29:11.375 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-02T01:29:11.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:29:11.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:11.498+0000 7f783680d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-02T01:29:11.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:11.498+0000 7f783680d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-02T01:29:11.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:11.498+0000 7f783680d500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-02T01:29:11.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:11.498+0000 7f783680d500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-02T01:29:11.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:11.498+0000 7f783680d500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-02T01:29:11.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:11.498+0000 7f783680d500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-02T01:29:14.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-02T01:29:14.394 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:29:14.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:14.478+0000 7fd340120500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-02T01:29:14.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:14.479+0000 7fd340120500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-02T01:29:14.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:14.479+0000 7fd340120500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-02T01:29:14.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:14.479+0000 7fd340120500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-02T01:29:14.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:14.479+0000 7fd340120500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-02T01:29:14.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:14.479+0000 7fd340120500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-02T01:29:15.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:29:15.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:29:17.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-02T01:29:17.360 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-02T01:29:17.360 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:17.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-02T01:29:17.397 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:17.397 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-02T01:29:17.472 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:17.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-02T01:29:17.545 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:17.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-02T01:29:17.617 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:17.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-02T01:29:17.689 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:17.689 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-02T01:29:17.761 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:17.761 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-02T01:29:17.832 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:17.832 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-02T01:29:17.860 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:17.860 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-02T01:29:17.927 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:17.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-02T01:29:17.994 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:17.994 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-02T01:29:18.061 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:18.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-02T01:29:18.128 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:18.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-02T01:29:18.195 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:18.196 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-02T01:29:18.262 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:18.262 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-02T01:29:18.279 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:18.279 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-02T01:29:18.336 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:18.336 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-02T01:29:18.351 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:18.351 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-02T01:29:18.406 INFO:tasks.ceph:Adding keys to all mons... 2023-12-02T01:29:18.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-02T01:29:18.410 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-02T01:29:18.450 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.y] 2023-12-02T01:29:18.450 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGplQkGSEBAAGTjP+dMFURFpZgDusYN/VQ== 2023-12-02T01:29:18.450 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGpleFwkGBAAITiRuWpXczedcnLptKnnlw== 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c] 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGplFj8zIBAANJ06XhaYfqIpRXPI+ikd4g== 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.0] 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBSiGplqBeHGRAA5fPUANudtFc3/JC37eMC0Q== 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.1] 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBViGplRqS5GBAAsoEuYQs3z79q6ZXcO5Jiig== 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.2] 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBYiGplbuL4FxAApq4Bxa2J9KHDc83lv0VliA== 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.3] 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBbiGpl7Y2AFxAAyWfYQKbDlxpbDtgvrso12w== 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.x] 2023-12-02T01:29:18.451 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGplEm9EFBAATP84GWPREy2Maye5AjRQkQ== 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGplVNhnJRAAu4ddZCm+qUWTih2nzCkrdA== 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d] 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGplgfK5LBAAN9og1AhLP8hmFqP9b8z9DA== 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.4] 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBhiGplmm75IRAA/5O9X6Qfg6STJP/LohsYIQ== 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.5] 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBkiGplQrSKHxAAWb/WIC80OZl0t14qLNc01Q== 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.6] 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBniGplzne9HRAATiHD4eSgkVMDXtMPgbyw9w== 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.7] 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBqiGplv5imHBAABqJyOVfN2fQvo5Ir4RDCQw== 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2023-12-02T01:29:18.452 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGplxfg6MRAA+vtsoFgV7M1UyKLtt5Ugrw== 2023-12-02T01:29:18.453 INFO:teuthology.orchestra.run.smithi001.stdout:[client.2] 2023-12-02T01:29:18.453 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGpl4RsMNRAA3R86c7JBo/OLA6nw61j7yQ== 2023-12-02T01:29:18.453 INFO:teuthology.orchestra.run.smithi001.stdout:[client.1] 2023-12-02T01:29:18.453 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGpl3hWdOBAArzu02qjNXpKlL2QFnznCzA== 2023-12-02T01:29:18.453 INFO:teuthology.orchestra.run.smithi001.stdout:[client.3] 2023-12-02T01:29:18.453 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBRiGplSSTRAhAAlK+59Jpc1p0Q2F7cnSBswA== 2023-12-02T01:29:18.472 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2023-12-02T01:29:18.472 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGplQkGSEBAAGTjP+dMFURFpZgDusYN/VQ== 2023-12-02T01:29:18.472 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-12-02T01:29:18.472 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGpleFwkGBAAITiRuWpXczedcnLptKnnlw== 2023-12-02T01:29:18.472 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-12-02T01:29:18.472 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGplFj8zIBAANJ06XhaYfqIpRXPI+ikd4g== 2023-12-02T01:29:18.472 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBSiGplqBeHGRAA5fPUANudtFc3/JC37eMC0Q== 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBViGplRqS5GBAAsoEuYQs3z79q6ZXcO5Jiig== 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBYiGplbuL4FxAApq4Bxa2J9KHDc83lv0VliA== 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBbiGpl7Y2AFxAAyWfYQKbDlxpbDtgvrso12w== 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGplEm9EFBAATP84GWPREy2Maye5AjRQkQ== 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGplVNhnJRAAu4ddZCm+qUWTih2nzCkrdA== 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGplgfK5LBAAN9og1AhLP8hmFqP9b8z9DA== 2023-12-02T01:29:18.473 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBhiGplmm75IRAA/5O9X6Qfg6STJP/LohsYIQ== 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBkiGplQrSKHxAAWb/WIC80OZl0t14qLNc01Q== 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBniGplzne9HRAATiHD4eSgkVMDXtMPgbyw9w== 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBqiGplv5imHBAABqJyOVfN2fQvo5Ir4RDCQw== 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGplxfg6MRAA+vtsoFgV7M1UyKLtt5Ugrw== 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout:[client.2] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGpl4RsMNRAA3R86c7JBo/OLA6nw61j7yQ== 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout:[client.1] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBQiGpl3hWdOBAArzu02qjNXpKlL2QFnznCzA== 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout:[client.3] 2023-12-02T01:29:18.474 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBRiGplSSTRAhAAlK+59Jpc1p0Q2F7cnSBswA== 2023-12-02T01:29:18.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-02T01:29:18.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-02T01:29:18.568 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:18.571 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:18.630 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:18.632 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:18.689 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.691 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.744 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.746 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.799 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.801 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.855 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.862 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:18.916 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-02T01:29:18.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-02T01:29:18.971 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:18.973 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:19.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:19.032 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-02T01:29:19.089 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.144 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.147 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.200 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.203 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.256 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.258 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-02T01:29:19.312 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.314 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.373 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.429 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.488 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-02T01:29:19.547 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-02T01:29:19.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-02T01:29:19.577 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-02T01:29:19.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-02T01:29:19.710 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-02T01:29:19.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-02T01:29:19.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-02T01:29:19.863 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-02T01:29:19.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-02T01:29:20.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-02T01:29:20.053 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:29:20.056 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-02T01:29:20.107 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-02T01:29:20.108 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-02T01:29:20.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-02T01:29:20.111 INFO:tasks.ceph.mon.a:Started 2023-12-02T01:29:20.111 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-02T01:29:20.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-02T01:29:20.149 INFO:tasks.ceph.mon.b:Started 2023-12-02T01:29:20.149 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-02T01:29:20.149 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-02T01:29:20.151 INFO:tasks.ceph.mon.c:Started 2023-12-02T01:29:20.151 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-02T01:29:20.151 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-02T01:29:20.152 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-02T01:29:20.154 INFO:tasks.ceph.mgr.y:Started 2023-12-02T01:29:20.154 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-02T01:29:20.154 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-02T01:29:20.156 INFO:tasks.ceph.mgr.x:Started 2023-12-02T01:29:20.156 INFO:tasks.ceph:Setting crush tunables to default 2023-12-02T01:29:20.156 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd crush tunables default 2023-12-02T01:29:20.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.263+0000 7f3050e48640 1 Processor -- start 2023-12-02T01:29:20.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.263+0000 7f3050e48640 1 -- start start 2023-12-02T01:29:20.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3050e48640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3050e48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3050e48640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c1446f0 con 0x7f304c06c890 2023-12-02T01:29:20.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3050e48640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0b3980 con 0x7f304c144310 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3050e48640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0cec60 con 0x7f304c0ce7e0 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f304a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f304ad9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f304c06c890 0x7f304c15ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55852/0 (socket says 172.21.15.1:55852) 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f304ad9d640 1 -- 172.21.15.1:0/954910503 learned_addr learned my addr 172.21.15.1:0/954910503 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f304a59c640 1 -- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 msgr2=0x7f304c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f304a59c640 1 -- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 msgr2=0x7f304c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f304a59c640 1 --2- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3049d9b640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f304a59c640 1 --2- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3049d9b640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 msgr2=0x7f304c0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3049d9b640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 msgr2=0x7f304c0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.264+0000 7f3049d9b640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-02T01:29:20.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.265+0000 7f3049d9b640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-02T01:29:20.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.465+0000 7f304a59c640 1 --2- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.465+0000 7f304a59c640 1 -- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 msgr2=0x7f304c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-02T01:29:20.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.465+0000 7f304a59c640 1 -- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 msgr2=0x7f304c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-02T01:29:20.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.465+0000 7f304a59c640 1 --2- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-02T01:29:20.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.465+0000 7f304a59c640 1 --2- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-02T01:29:20.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.466+0000 7f3049d9b640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.466+0000 7f3049d9b640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 msgr2=0x7f304c0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-02T01:29:20.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.466+0000 7f3049d9b640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 msgr2=0x7f304c0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-02T01:29:20.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.466+0000 7f3049d9b640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-02T01:29:20.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.466+0000 7f3049d9b640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-02T01:29:20.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.468+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931561724 0 0) 0x7f304c1446f0 con 0x7f304c06c890 2023-12-02T01:29:20.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.468+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3034003520 con 0x7f304c06c890 2023-12-02T01:29:20.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916616170 0 0) 0x7f3034003520 con 0x7f304c06c890 2023-12-02T01:29:20.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 msgr2=0x7f304c0b3440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-02T01:29:20.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f304c0b3440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 msgr2=0x7f304c144950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-02T01:29:20.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 --2- 172.21.15.1:0/954910503 >> v2:172.21.15.1:3300/0 conn(0x7f304c144310 0x7f304c144950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c15ba80 con 0x7f304c06c890 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f303c0019f0 con 0x7f304c06c890 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 >> v1:172.21.15.1:6789/0 conn(0x7f304c06c890 legacy=0x7f304c15ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034003970 0x7f3034003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f30340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034004d00 0x7f3034005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0b3980 con 0x7f3034004d00 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303400ba30 con 0x7f3034003970 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303400bba0 con 0x7f304c0ce7e0 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304ad9d640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034004d00 0x7f3034005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f3049d9b640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f30340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.469+0000 7f304a59c640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034003970 0x7f3034003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.470+0000 7f304ad9d640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 msgr2=0x7f30340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.470+0000 7f304ad9d640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c0ce7e0 0x7f30340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.470+0000 7f304ad9d640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034003970 msgr2=0x7f3034003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.470+0000 7f304ad9d640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034003970 0x7f3034003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.470+0000 7f304ad9d640 1 -- 172.21.15.1:0/954910503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034003520 con 0x7f3034004d00 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.471+0000 7f304ad9d640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034004d00 0x7f3034005180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f303c00a8d0 tx=0x7f30340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93330a6dab4a27f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.471+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c034630 con 0x7f3034004d00 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.471+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c02f070 con 0x7f3034004d00 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.471+0000 7f304959a640 1 -- 172.21.15.1:0/954910503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0349d0 con 0x7f3034004d00 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.471+0000 7f3050e48640 1 -- 172.21.15.1:0/954910503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034004d00 msgr2=0x7f3034005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.471+0000 7f3050e48640 1 --2- 172.21.15.1:0/954910503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034004d00 0x7f3034005180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f303c00a8d0 tx=0x7f30340057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.471+0000 7f304ad9d640 1 -- 172.21.15.1:0/954910503 reap_dead start 2023-12-02T01:29:20.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.472+0000 7f3050e48640 1 -- 172.21.15.1:0/954910503 shutdown_connections 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.472+0000 7f3050e48640 1 -- 172.21.15.1:0/954910503 >> 172.21.15.1:0/954910503 conn(0x7f304c06a8f0 msgr2=0x7f304c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.472+0000 7f3050e48640 1 -- 172.21.15.1:0/954910503 shutdown_connections 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.472+0000 7f3050e48640 1 -- 172.21.15.1:0/954910503 wait complete. 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.473+0000 7f3050e48640 1 Processor -- start 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.473+0000 7f3050e48640 1 -- start start 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f3050e48640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034004d00 0x7f304c0a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f3050e48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c1f4f10 0x7f304c13a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f3050e48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f304c15d940 0x7f304c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f3050e48640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c15e310 con 0x7f304c15d940 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f3050e48640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c153d70 con 0x7f3034004d00 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f3050e48640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0a94c0 con 0x7f304c1f4f10 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f304c15d940 0x7f304c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f304c15d940 0x7f304c15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59486/0 (socket says 172.21.15.1:59486) 2023-12-02T01:29:20.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 -- 172.21.15.1:0/1044296271 learned_addr learned my addr 172.21.15.1:0/1044296271 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304a59c640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034004d00 0x7f304c0a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f3049d9b640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c1f4f10 0x7f304c13a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 -- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c1f4f10 msgr2=0x7f304c13a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c1f4f10 0x7f304c13a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 -- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034004d00 msgr2=0x7f304c0a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034004d00 0x7f304c0a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 -- 172.21.15.1:0/1044296271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c153a90 con 0x7f304c15d940 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.474+0000 7f304ad9d640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f304c15d940 0x7f304c15ddd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f303c00a9f0 tx=0x7f303c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.475+0000 7f303affd640 1 -- 172.21.15.1:0/1044296271 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c034840 con 0x7f304c15d940 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.475+0000 7f303affd640 1 -- 172.21.15.1:0/1044296271 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0349a0 con 0x7f304c15d940 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.475+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c0a8e70 con 0x7f304c15d940 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.475+0000 7f303affd640 1 -- 172.21.15.1:0/1044296271 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c034d50 con 0x7f304c15d940 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.475+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c13ab70 con 0x7f304c15d940 2023-12-02T01:29:20.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.475+0000 7f303affd640 1 -- 172.21.15.1:0/1044296271 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f303c031030 con 0x7f304c15d940 2023-12-02T01:29:20.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.475+0000 7f303affd640 1 -- 172.21.15.1:0/1044296271 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f303c03f420 con 0x7f304c15d940 2023-12-02T01:29:20.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.476+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c0afeb0 con 0x7f304c15d940 2023-12-02T01:29:20.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.478+0000 7f303affd640 1 -- 172.21.15.1:0/1044296271 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f303c00a4a0 con 0x7f304c15d940 2023-12-02T01:29:20.547 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.546+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f304c0afeb0 con 0x7f304c15d940 2023-12-02T01:29:20.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.547+0000 7f303affd640 1 -- 172.21.15.1:0/1044296271 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f303c002000 con 0x7f304c15d940 2023-12-02T01:29:20.549 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2023-12-02T01:29:20.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f304c15d940 msgr2=0x7f304c15ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:20.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f304c15d940 0x7f304c15ddd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f303c00a9f0 tx=0x7f303c001360 comp rx=0 tx=0).stop 2023-12-02T01:29:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 shutdown_connections 2023-12-02T01:29:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f304c15d940 0x7f304c15ddd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f304c1f4f10 0x7f304c13a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 --2- 172.21.15.1:0/1044296271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3034004d00 0x7f304c0a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 >> 172.21.15.1:0/1044296271 conn(0x7f304c06a8f0 msgr2=0x7f304c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 shutdown_connections 2023-12-02T01:29:20.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:20.548+0000 7f3050e48640 1 -- 172.21.15.1:0/1044296271 wait complete. 2023-12-02T01:29:20.560 INFO:tasks.ceph:check_enable_crimson: False 2023-12-02T01:29:20.560 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-02T01:29:20.560 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:20.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-02T01:29:20.591 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:20.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-02T01:29:20.662 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:20.662 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-02T01:29:20.733 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:29:20.733 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-02T01:29:20.805 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:20.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-02T01:29:20.832 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:20.832 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-02T01:29:20.899 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:20.899 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-02T01:29:20.934 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:20.932+0000 7f7f45e2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-02T01:29:20.934 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:20.932+0000 7f3f07211040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-02T01:29:20.960 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:29:20.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-02T01:29:20.988 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:20.986+0000 7f7f45e2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-02T01:29:20.988 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:20.986+0000 7f3f07211040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-02T01:29:21.015 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 579b11a8-a765-4522-8785-e7054aa31871 0 2023-12-02T01:29:21.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.153+0000 7f50a18ee640 1 Processor -- start 2023-12-02T01:29:21.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.153+0000 7f50a18ee640 1 -- start start 2023-12-02T01:29:21.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f50a18ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f50a18ee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f509c070ed0 0x7f509c071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f50a18ee640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c0ceea0 con 0x7f509c1434c0 2023-12-02T01:29:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f50a18ee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c161dc0 con 0x7f509c070ed0 2023-12-02T01:29:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f50a18ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0718a0 con 0x7f509c0ceac0 2023-12-02T01:29:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f509c070ed0 0x7f509c071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:34124/0 (socket says 172.21.15.167:34124) 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509affd640 1 -- 172.21.15.167:0/2509217633 learned_addr learned my addr 172.21.15.167:0/2509217633 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509b7fe640 1 --2- 172.21.15.167:0/2509217633 >> v2:172.21.15.167:3300/0 conn(0x7f509c070ed0 0x7f509c071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60864/0 (socket says 172.21.15.167:60864) 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509b7fe640 1 -- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 msgr2=0x7f509c160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509b7fe640 1 --2- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509b7fe640 1 -- 172.21.15.167:0/2509217633 >> v1:172.21.15.1:6789/0 conn(0x7f509c1434c0 legacy=0x7f509c06cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509b7fe640 1 -- 172.21.15.167:0/2509217633 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c06d1e0 con 0x7f509c070ed0 2023-12-02T01:29:21.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.154+0000 7f509affd640 1 --2- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:21.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.155+0000 7f509b7fe640 1 --2- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c071360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5094009d90 tx=0x7f509402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=829d14bea307cc16 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.155+0000 7f5099ffb640 1 -- 172.21.15.167:0/2509217633 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509402cc50 con 0x7f509c070ed0 2023-12-02T01:29:21.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.155+0000 7f5099ffb640 1 -- 172.21.15.167:0/2509217633 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509402cdb0 con 0x7f509c070ed0 2023-12-02T01:29:21.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.155+0000 7f5099ffb640 1 -- 172.21.15.167:0/2509217633 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094034660 con 0x7f509c070ed0 2023-12-02T01:29:21.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 -- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 msgr2=0x7f509c071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 --2- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c071360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5094009d90 tx=0x7f509402bea0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 -- 172.21.15.167:0/2509217633 shutdown_connections 2023-12-02T01:29:21.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 --2- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c071360 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 --2- 172.21.15.167:0/2509217633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 -- 172.21.15.167:0/2509217633 >> 172.21.15.167:0/2509217633 conn(0x7f509c0b1630 msgr2=0x7f509c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 -- 172.21.15.167:0/2509217633 shutdown_connections 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.156+0000 7f50a18ee640 1 -- 172.21.15.167:0/2509217633 wait complete. 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.157+0000 7f50a18ee640 1 Processor -- start 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.157+0000 7f50a18ee640 1 -- start start 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f50a18ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c13f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f50a18ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f50a18ee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f509c1434c0 0x7f509c1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f50a18ee640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c160a20 con 0x7f509c1434c0 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f50a18ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c15e630 con 0x7f509c070ed0 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f50a18ee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c15d5e0 con 0x7f509c0ceac0 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c13f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509a7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c13f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60880/0 (socket says 172.21.15.167:60880) 2023-12-02T01:29:21.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 -- 172.21.15.167:0/3867640782 learned_addr learned my addr 172.21.15.167:0/3867640782 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509b7fe640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f509c1434c0 0x7f509c1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 -- 172.21.15.167:0/3867640782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 msgr2=0x7f509c1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 -- 172.21.15.167:0/3867640782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f509c1434c0 msgr2=0x7f509c1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f509c1434c0 0x7f509c1408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.158+0000 7f509affd640 1 -- 172.21.15.167:0/3867640782 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900094d0 con 0x7f509c070ed0 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f509affd640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c13f460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f509000e9d0 tx=0x7f509000ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f5083fff640 1 -- 172.21.15.167:0/3867640782 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000ca60 con 0x7f509c070ed0 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f5083fff640 1 -- 172.21.15.167:0/3867640782 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000cbc0 con 0x7f509c070ed0 2023-12-02T01:29:21.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5094009a70 con 0x7f509c070ed0 2023-12-02T01:29:21.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f5083fff640 1 -- 172.21.15.167:0/3867640782 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090013470 con 0x7f509c070ed0 2023-12-02T01:29:21.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c15d7f0 con 0x7f509c070ed0 2023-12-02T01:29:21.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f5083fff640 1 -- 172.21.15.167:0/3867640782 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5090005c90 con 0x7f509c070ed0 2023-12-02T01:29:21.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.159+0000 7f5083fff640 1 -- 172.21.15.167:0/3867640782 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5090013910 con 0x7f509c070ed0 2023-12-02T01:29:21.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.160+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c072460 con 0x7f509c070ed0 2023-12-02T01:29:21.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.162+0000 7f5083fff640 1 -- 172.21.15.167:0/3867640782 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5090021060 con 0x7f509c070ed0 2023-12-02T01:29:21.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.253+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "579b11a8-a765-4522-8785-e7054aa31871", "id": 0} v 0) v1 -- 0x7f509c04e920 con 0x7f509c070ed0 2023-12-02T01:29:21.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.259+0000 7f5083fff640 1 -- 172.21.15.167:0/3867640782 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "579b11a8-a765-4522-8785-e7054aa31871", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5090017070 con 0x7f509c070ed0 2023-12-02T01:29:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:0 2023-12-02T01:29:21.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 msgr2=0x7f509c13f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c13f460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f509000e9d0 tx=0x7f509000ee90 comp rx=0 tx=0).stop 2023-12-02T01:29:21.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 shutdown_connections 2023-12-02T01:29:21.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f509c1434c0 0x7f509c1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f509c0ceac0 0x7f509c1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 --2- 172.21.15.167:0/3867640782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c070ed0 0x7f509c13f460 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 >> 172.21.15.167:0/3867640782 conn(0x7f509c0b1630 msgr2=0x7f509c06cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 shutdown_connections 2023-12-02T01:29:21.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.260+0000 7f50a18ee640 1 -- 172.21.15.167:0/3867640782 wait complete. 2023-12-02T01:29:21.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 2796d820-f5d7-4015-9254-d32bf43ae9be 1 2023-12-02T01:29:21.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.371+0000 7f64bc475640 1 Processor -- start 2023-12-02T01:29:21.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.372+0000 7f64bc475640 1 -- start start 2023-12-02T01:29:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.372+0000 7f64bc475640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64b40d1a60 0x7f64b406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.372+0000 7f64bc475640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f64b4099970 0x7f64b4099de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.372+0000 7f64bc475640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b406f490 con 0x7f64b40cfff0 2023-12-02T01:29:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64bc475640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b40d1f10 con 0x7f64b4099970 2023-12-02T01:29:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64bc475640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b409a320 con 0x7f64b40d1a60 2023-12-02T01:29:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64b9a10640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64b40d1a60 0x7f64b406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64b9a10640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64b40d1a60 0x7f64b406ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60896/0 (socket says 172.21.15.167:60896) 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64b9a10640 1 -- 172.21.15.167:0/3538576931 learned_addr learned my addr 172.21.15.167:0/3538576931 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64baa12640 1 --2- 172.21.15.167:0/3538576931 >> v2:172.21.15.1:3300/0 conn(0x7f64b4099970 0x7f64b4099de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64b9a10640 1 -- 172.21.15.167:0/3538576931 >> v2:172.21.15.1:3300/0 conn(0x7f64b4099970 msgr2=0x7f64b4099de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64b9a10640 1 --2- 172.21.15.167:0/3538576931 >> v2:172.21.15.1:3300/0 conn(0x7f64b4099970 0x7f64b4099de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64b9a10640 1 -- 172.21.15.167:0/3538576931 >> v1:172.21.15.167:6789/0 conn(0x7f64b40cfff0 legacy=0x7f64b40cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64b9a10640 1 -- 172.21.15.167:0/3538576931 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40cf6e0 con 0x7f64b40d1a60 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.373+0000 7f64baa12640 1 --2- 172.21.15.167:0/3538576931 >> v2:172.21.15.1:3300/0 conn(0x7f64b4099970 0x7f64b4099de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.374+0000 7f64b9a10640 1 --2- 172.21.15.167:0/3538576931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40d1a60 0x7f64b406ef50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f64b4066cd0 tx=0x7f64a802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686d8414ba405ec9 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.374+0000 7f64b920f640 1 -- 172.21.15.167:0/3538576931 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8031870 con 0x7f64b40d1a60 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.374+0000 7f64b920f640 1 -- 172.21.15.167:0/3538576931 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a80319d0 con 0x7f64b40d1a60 2023-12-02T01:29:21.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.374+0000 7f64b920f640 1 -- 172.21.15.167:0/3538576931 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8031d60 con 0x7f64b40d1a60 2023-12-02T01:29:21.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.374+0000 7f64bc475640 1 -- 172.21.15.167:0/3538576931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40d1a60 msgr2=0x7f64b406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.374+0000 7f64bc475640 1 --2- 172.21.15.167:0/3538576931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40d1a60 0x7f64b406ef50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f64b4066cd0 tx=0x7f64a802b910 comp rx=0 tx=0).stop 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.375+0000 7f64bc475640 1 -- 172.21.15.167:0/3538576931 shutdown_connections 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.375+0000 7f64bc475640 1 --2- 172.21.15.167:0/3538576931 >> v2:172.21.15.1:3300/0 conn(0x7f64b4099970 0x7f64b4099de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.375+0000 7f64bc475640 1 --2- 172.21.15.167:0/3538576931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40d1a60 0x7f64b406ef50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.375+0000 7f64bc475640 1 -- 172.21.15.167:0/3538576931 >> 172.21.15.167:0/3538576931 conn(0x7f64b40d0f40 msgr2=0x7f64b40d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.375+0000 7f64bc475640 1 -- 172.21.15.167:0/3538576931 shutdown_connections 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.375+0000 7f64bc475640 1 -- 172.21.15.167:0/3538576931 wait complete. 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.376+0000 7f64bc475640 1 Processor -- start 2023-12-02T01:29:21.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.376+0000 7f64bc475640 1 -- start start 2023-12-02T01:29:21.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64b4099970 0x7f64b40ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40cfff0 0x7f64b415bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64b40d1a60 0x7f64b415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b415e580 con 0x7f64b40d1a60 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b415d970 con 0x7f64b40cfff0 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b415dc50 con 0x7f64b4099970 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40cfff0 0x7f64b415bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40cfff0 0x7f64b415bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60906/0 (socket says 172.21.15.167:60906) 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 -- 172.21.15.167:0/1703708073 learned_addr learned my addr 172.21.15.167:0/1703708073 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64ba211640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64b4099970 0x7f64b40ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64baa12640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64b40d1a60 0x7f64b415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 -- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64b4099970 msgr2=0x7f64b40ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64b4099970 0x7f64b40ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 -- 172.21.15.167:0/1703708073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64b40d1a60 msgr2=0x7f64b415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64b40d1a60 0x7f64b415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 -- 172.21.15.167:0/1703708073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80094d0 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b9a10640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40cfff0 0x7f64b415bf00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64a802b950 tx=0x7f64a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b2ffd640 1 -- 172.21.15.167:0/1703708073 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a803bcc0 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b2ffd640 1 -- 172.21.15.167:0/1703708073 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a803be40 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b2ffd640 1 -- 172.21.15.167:0/1703708073 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8045630 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b415df30 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b40cac30 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b2ffd640 1 -- 172.21.15.167:0/1703708073 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f64a8045a90 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.377+0000 7f64b2ffd640 1 -- 172.21.15.167:0/1703708073 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f64a802d040 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.378+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b409f0b0 con 0x7f64b40cfff0 2023-12-02T01:29:21.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.380+0000 7f64b2ffd640 1 -- 172.21.15.167:0/1703708073 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f64a8035020 con 0x7f64b40cfff0 2023-12-02T01:29:21.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.453+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2796d820-f5d7-4015-9254-d32bf43ae9be", "id": 1} v 0) v1 -- 0x7f64b4066b20 con 0x7f64b40cfff0 2023-12-02T01:29:21.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.458+0000 7f64b2ffd640 1 -- 172.21.15.167:0/1703708073 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2796d820-f5d7-4015-9254-d32bf43ae9be", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f64a804e450 con 0x7f64b40cfff0 2023-12-02T01:29:21.460 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40cfff0 msgr2=0x7f64b415bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40cfff0 0x7f64b415bf00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64a802b950 tx=0x7f64a80046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 shutdown_connections 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64b40d1a60 0x7f64b415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64b40cfff0 0x7f64b415bf00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 --2- 172.21.15.167:0/1703708073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64b4099970 0x7f64b40ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 >> 172.21.15.167:0/1703708073 conn(0x7f64b40d0f40 msgr2=0x7f64b40b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 shutdown_connections 2023-12-02T01:29:21.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.459+0000 7f64bc475640 1 -- 172.21.15.167:0/1703708073 wait complete. 2023-12-02T01:29:21.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd 2 2023-12-02T01:29:21.533 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.532+0000 7f7f45e2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-02T01:29:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.572+0000 7f82d4b8a640 1 Processor -- start 2023-12-02T01:29:21.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.572+0000 7f82d4b8a640 1 -- start start 2023-12-02T01:29:21.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82d4b8a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d015e8a0 0x7f82d00cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82d4b8a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82d00ceb70 0x7f82d00b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82d4b8a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d009a520 con 0x7f82d00cccd0 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82d4b8a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d009a330 con 0x7f82d00ceb70 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82d4b8a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d009a800 con 0x7f82d015e8a0 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82cdd9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82d00ceb70 0x7f82d00b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82ce59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d015e8a0 0x7f82d00cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82cdd9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82d00ceb70 0x7f82d00b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60908/0 (socket says 172.21.15.167:60908) 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82ce59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d015e8a0 0x7f82d00cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:34166/0 (socket says 172.21.15.167:34166) 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82cdd9b640 1 -- 172.21.15.167:0/1235225514 learned_addr learned my addr 172.21.15.167:0/1235225514 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82cdd9b640 1 -- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d015e8a0 msgr2=0x7f82d00cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82cdd9b640 1 --2- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d015e8a0 0x7f82d00cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82cdd9b640 1 -- 172.21.15.167:0/1235225514 >> v1:172.21.15.167:6789/0 conn(0x7f82d00cccd0 legacy=0x7f82d015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82cdd9b640 1 -- 172.21.15.167:0/1235225514 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00cbf90 con 0x7f82d00ceb70 2023-12-02T01:29:21.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.573+0000 7f82ce59c640 1 --2- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d015e8a0 0x7f82d00cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:21.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.574+0000 7f82cdd9b640 1 --2- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d00b0900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009870 tx=0x7f82c402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abe7beb14795f9a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.574+0000 7f82cd59a640 1 -- 172.21.15.167:0/1235225514 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4030840 con 0x7f82d00ceb70 2023-12-02T01:29:21.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.574+0000 7f82cd59a640 1 -- 172.21.15.167:0/1235225514 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40309a0 con 0x7f82d00ceb70 2023-12-02T01:29:21.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.574+0000 7f82cd59a640 1 -- 172.21.15.167:0/1235225514 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4030d30 con 0x7f82d00ceb70 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 -- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 msgr2=0x7f82d00b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 --2- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d00b0900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009870 tx=0x7f82c402b980 comp rx=0 tx=0).stop 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 -- 172.21.15.167:0/1235225514 shutdown_connections 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 --2- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d00b0900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 --2- 172.21.15.167:0/1235225514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d015e8a0 0x7f82d00cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 -- 172.21.15.167:0/1235225514 >> 172.21.15.167:0/1235225514 conn(0x7f82d00b2a90 msgr2=0x7f82d00b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 -- 172.21.15.167:0/1235225514 shutdown_connections 2023-12-02T01:29:21.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.575+0000 7f82d4b8a640 1 -- 172.21.15.167:0/1235225514 wait complete. 2023-12-02T01:29:21.579 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:21.576+0000 7f3f07211040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.576+0000 7f82d4b8a640 1 Processor -- start 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.576+0000 7f82d4b8a640 1 -- start start 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82d4b8a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d00cccd0 0x7f82d00af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82d4b8a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d01f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82d4b8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d015e8a0 0x7f82d00b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82d4b8a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00af6b0 con 0x7f82d015e8a0 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82d4b8a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00ae0d0 con 0x7f82d00ceb70 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82d4b8a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00ae3b0 con 0x7f82d00cccd0 2023-12-02T01:29:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d01f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82ce59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d00cccd0 0x7f82d00af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d01f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60914/0 (socket says 172.21.15.167:60914) 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82ce59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d00cccd0 0x7f82d00af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:34172/0 (socket says 172.21.15.167:34172) 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 -- 172.21.15.167:0/2100850789 learned_addr learned my addr 172.21.15.167:0/2100850789 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82ced9d640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d015e8a0 0x7f82d00b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 -- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d00cccd0 msgr2=0x7f82d00af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d00cccd0 0x7f82d00af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 -- 172.21.15.167:0/2100850789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d015e8a0 msgr2=0x7f82d00b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d015e8a0 0x7f82d00b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 -- 172.21.15.167:0/2100850789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c0009400 con 0x7f82d00ceb70 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82ce59c640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d00cccd0 0x7f82d00af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82ced9d640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d015e8a0 0x7f82d00b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.577+0000 7f82cdd9b640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d01f1aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000c00 tx=0x7f82c4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.578+0000 7f82beffd640 1 -- 172.21.15.167:0/2100850789 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4039c90 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.578+0000 7f82beffd640 1 -- 172.21.15.167:0/2100850789 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4039df0 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.578+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c40094d0 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.578+0000 7f82beffd640 1 -- 172.21.15.167:0/2100850789 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4043640 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.578+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d00ae970 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.578+0000 7f82beffd640 1 -- 172.21.15.167:0/2100850789 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f82c4043aa0 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.578+0000 7f82beffd640 1 -- 172.21.15.167:0/2100850789 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f82c403e070 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.579+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d009f0b0 con 0x7f82d00ceb70 2023-12-02T01:29:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.581+0000 7f82beffd640 1 -- 172.21.15.167:0/2100850789 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f82c4034070 con 0x7f82d00ceb70 2023-12-02T01:29:21.588 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.587+0000 7f7f45e2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-02T01:29:21.632 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:21.631+0000 7f3f07211040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-02T01:29:21.634 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.633+0000 7f7f45e2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-02T01:29:21.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.653+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd", "id": 2} v 0) v1 -- 0x7f82d0072710 con 0x7f82d00ceb70 2023-12-02T01:29:21.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.656+0000 7f82beffd640 1 -- 172.21.15.167:0/2100850789 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f82c404d460 con 0x7f82d00ceb70 2023-12-02T01:29:21.657 INFO:teuthology.orchestra.run.smithi167.stdout:2 2023-12-02T01:29:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 msgr2=0x7f82d01f1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d01f1aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000c00 tx=0x7f82c4004730 comp rx=0 tx=0).stop 2023-12-02T01:29:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 shutdown_connections 2023-12-02T01:29:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d015e8a0 0x7f82d00b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82d00ceb70 0x7f82d01f1aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 --2- 172.21.15.167:0/2100850789 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82d00cccd0 0x7f82d00af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 >> 172.21.15.167:0/2100850789 conn(0x7f82d00b2a90 msgr2=0x7f82d0159320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 shutdown_connections 2023-12-02T01:29:21.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.657+0000 7f82d4b8a640 1 -- 172.21.15.167:0/2100850789 wait complete. 2023-12-02T01:29:21.668 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 8c201366-3368-4769-9be2-73a2ee2d58de 3 2023-12-02T01:29:21.680 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:21.679+0000 7f3f07211040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-02T01:29:21.691 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.689+0000 7f7f45e2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-02T01:29:21.735 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.733+0000 7f7f45e2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-02T01:29:21.737 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:21.736+0000 7f3f07211040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-02T01:29:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.767+0000 7fd60d99e640 1 Processor -- start 2023-12-02T01:29:21.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.768+0000 7fd60d99e640 1 -- start start 2023-12-02T01:29:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.768+0000 7fd60d99e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd60815a460 0x7fd6080b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.768+0000 7fd60d99e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd6080b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.768+0000 7fd60d99e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60815a9d0 con 0x7fd6080713d0 2023-12-02T01:29:21.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.768+0000 7fd60d99e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080b2ee0 con 0x7fd60815a460 2023-12-02T01:29:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.768+0000 7fd60d99e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60815acb0 con 0x7fd60815da50 2023-12-02T01:29:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.768+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd6080b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd6080b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:34184/0 (socket says 172.21.15.167:34184) 2023-12-02T01:29:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6077fe640 1 -- 172.21.15.167:0/3402878814 learned_addr learned my addr 172.21.15.167:0/3402878814 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6067fc640 1 --2- 172.21.15.167:0/3402878814 >> v2:172.21.15.1:3300/0 conn(0x7fd60815a460 0x7fd6080b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6077fe640 1 -- 172.21.15.167:0/3402878814 >> v2:172.21.15.1:3300/0 conn(0x7fd60815a460 msgr2=0x7fd6080b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6077fe640 1 --2- 172.21.15.167:0/3402878814 >> v2:172.21.15.1:3300/0 conn(0x7fd60815a460 0x7fd6080b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6077fe640 1 -- 172.21.15.167:0/3402878814 >> v1:172.21.15.1:6789/0 conn(0x7fd6080713d0 legacy=0x7fd6080717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6077fe640 1 -- 172.21.15.167:0/3402878814 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60815af90 con 0x7fd60815da50 2023-12-02T01:29:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.769+0000 7fd6077fe640 1 --2- 172.21.15.167:0/3402878814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd6080b3870 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd60000d150 tx=0x7fd60002e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91bd988e25e12415 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd605ffb640 1 -- 172.21.15.167:0/3402878814 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002ea80 con 0x7fd60815da50 2023-12-02T01:29:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd605ffb640 1 -- 172.21.15.167:0/3402878814 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60002ebe0 con 0x7fd60815da50 2023-12-02T01:29:21.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd605ffb640 1 -- 172.21.15.167:0/3402878814 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600009600 con 0x7fd60815da50 2023-12-02T01:29:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 -- 172.21.15.167:0/3402878814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 msgr2=0x7fd6080b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 --2- 172.21.15.167:0/3402878814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd6080b3870 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd60000d150 tx=0x7fd60002e0e0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 -- 172.21.15.167:0/3402878814 shutdown_connections 2023-12-02T01:29:21.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 --2- 172.21.15.167:0/3402878814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd6080b3870 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 --2- 172.21.15.167:0/3402878814 >> v2:172.21.15.1:3300/0 conn(0x7fd60815a460 0x7fd6080b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 -- 172.21.15.167:0/3402878814 >> 172.21.15.167:0/3402878814 conn(0x7fd6080b1be0 msgr2=0x7fd6080b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 -- 172.21.15.167:0/3402878814 shutdown_connections 2023-12-02T01:29:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.770+0000 7fd60d99e640 1 -- 172.21.15.167:0/3402878814 wait complete. 2023-12-02T01:29:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.771+0000 7fd60d99e640 1 Processor -- start 2023-12-02T01:29:21.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd60d99e640 1 -- start start 2023-12-02T01:29:21.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd60d99e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6080713d0 0x7fd60814b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd60d99e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd60815a460 0x7fd60815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd60d99e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd60815bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd60d99e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608152db0 con 0x7fd6080713d0 2023-12-02T01:29:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd60d99e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60815c7f0 con 0x7fd60815a460 2023-12-02T01:29:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd60d99e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081527c0 con 0x7fd60815da50 2023-12-02T01:29:21.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd60815bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd6067fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd60815a460 0x7fd60815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd6077fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd60815bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:34188/0 (socket says 172.21.15.167:34188) 2023-12-02T01:29:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd6077fe640 1 -- 172.21.15.167:0/1332945803 learned_addr learned my addr 172.21.15.167:0/1332945803 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.772+0000 7fd606ffd640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6080713d0 0x7fd60814b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd6077fe640 1 -- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd60815a460 msgr2=0x7fd60815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd6077fe640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd60815a460 0x7fd60815b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd6077fe640 1 -- 172.21.15.167:0/1332945803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6080713d0 msgr2=0x7fd60814b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd6077fe640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6080713d0 0x7fd60814b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd6077fe640 1 -- 172.21.15.167:0/1332945803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60000bd40 con 0x7fd60815da50 2023-12-02T01:29:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd6067fc640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd60815a460 0x7fd60815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd6077fe640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd60815bc00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd600038040 tx=0x7fd600004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd5effff640 1 -- 172.21.15.167:0/1332945803 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002ea80 con 0x7fd60815da50 2023-12-02T01:29:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd5effff640 1 -- 172.21.15.167:0/1332945803 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60003f850 con 0x7fd60815da50 2023-12-02T01:29:21.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60815c230 con 0x7fd60815da50 2023-12-02T01:29:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd5effff640 1 -- 172.21.15.167:0/1332945803 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60003fc00 con 0x7fd60815da50 2023-12-02T01:29:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6081f6580 con 0x7fd60815da50 2023-12-02T01:29:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd5effff640 1 -- 172.21.15.167:0/1332945803 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd60002ed50 con 0x7fd60815da50 2023-12-02T01:29:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.773+0000 7fd5effff640 1 -- 172.21.15.167:0/1332945803 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fd6000093e0 con 0x7fd60815da50 2023-12-02T01:29:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.774+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60815c620 con 0x7fd60815da50 2023-12-02T01:29:21.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.776+0000 7fd5effff640 1 -- 172.21.15.167:0/1332945803 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd600067ce0 con 0x7fd60815da50 2023-12-02T01:29:21.787 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:21.781+0000 7f3f07211040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-02T01:29:21.840 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.838+0000 7f7f45e2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-02T01:29:21.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.848+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8c201366-3368-4769-9be2-73a2ee2d58de", "id": 3} v 0) v1 -- 0x7fd60806e6c0 con 0x7fd60815da50 2023-12-02T01:29:21.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd5effff640 1 -- 172.21.15.167:0/1332945803 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c201366-3368-4769-9be2-73a2ee2d58de", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd600056030 con 0x7fd60815da50 2023-12-02T01:29:21.853 INFO:teuthology.orchestra.run.smithi167.stdout:3 2023-12-02T01:29:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 msgr2=0x7fd60815bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd60d99e640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd60815bc00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd600038040 tx=0x7fd600004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 shutdown_connections 2023-12-02T01:29:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd60d99e640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd60815da50 0x7fd60815bc00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd60d99e640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd60815a460 0x7fd60815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd60d99e640 1 --2- 172.21.15.167:0/1332945803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6080713d0 0x7fd60814b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.852+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 >> 172.21.15.167:0/1332945803 conn(0x7fd6080b1be0 msgr2=0x7fd60806a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.853+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 shutdown_connections 2023-12-02T01:29:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.853+0000 7fd60d99e640 1 -- 172.21.15.167:0/1332945803 wait complete. 2023-12-02T01:29:21.864 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 03b03a57-dd1a-4a06-aea4-4537357626f6 4 2023-12-02T01:29:21.889 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:21.888+0000 7f3f07211040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-02T01:29:21.913 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.912+0000 7f7f45e2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-02T01:29:21.961 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:21.960+0000 7f7f45e2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-02T01:29:21.964 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:21.963+0000 7f3f07211040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-02T01:29:21.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.989+0000 7f6c18010640 1 Processor -- start 2023-12-02T01:29:21.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.989+0000 7f6c18010640 1 -- start start 2023-12-02T01:29:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c18010640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6c100cf950 0x7f6c1006f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c18010640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6c100701a0 0x7f6c100cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c18010640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c100cfde0 con 0x7f6c100b0420 2023-12-02T01:29:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c18010640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c100b0800 con 0x7f6c100701a0 2023-12-02T01:29:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c18010640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c100cb920 con 0x7f6c100cf950 2023-12-02T01:29:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c155ab640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6c100cf950 0x7f6c1006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c155ab640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6c100cf950 0x7f6c1006f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60934/0 (socket says 172.21.15.167:60934) 2023-12-02T01:29:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c155ab640 1 -- 172.21.15.167:0/3237043788 learned_addr learned my addr 172.21.15.167:0/3237043788 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.990+0000 7f6c165ad640 1 --2- 172.21.15.167:0/3237043788 >> v2:172.21.15.1:3300/0 conn(0x7f6c100701a0 0x7f6c100cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.991+0000 7f6c155ab640 1 -- 172.21.15.167:0/3237043788 >> v2:172.21.15.1:3300/0 conn(0x7f6c100701a0 msgr2=0x7f6c100cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.991+0000 7f6c155ab640 1 --2- 172.21.15.167:0/3237043788 >> v2:172.21.15.1:3300/0 conn(0x7f6c100701a0 0x7f6c100cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.991+0000 7f6c155ab640 1 -- 172.21.15.167:0/3237043788 >> v1:172.21.15.1:6789/0 conn(0x7f6c100b0420 legacy=0x7f6c10099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.991+0000 7f6c155ab640 1 -- 172.21.15.167:0/3237043788 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100cbbc0 con 0x7f6c100cf950 2023-12-02T01:29:21.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.991+0000 7f6c155ab640 1 --2- 172.21.15.167:0/3237043788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100cf950 0x7f6c1006f630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c100d03d0 tx=0x7f6c0c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae248cdd0ab353f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.991+0000 7f6c14daa640 1 -- 172.21.15.167:0/3237043788 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c030860 con 0x7f6c100cf950 2023-12-02T01:29:21.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c14daa640 1 -- 172.21.15.167:0/3237043788 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0309c0 con 0x7f6c100cf950 2023-12-02T01:29:21.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c14daa640 1 -- 172.21.15.167:0/3237043788 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c030d50 con 0x7f6c100cf950 2023-12-02T01:29:21.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 -- 172.21.15.167:0/3237043788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100cf950 msgr2=0x7f6c1006f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 --2- 172.21.15.167:0/3237043788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100cf950 0x7f6c1006f630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c100d03d0 tx=0x7f6c0c02b9a0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 -- 172.21.15.167:0/3237043788 shutdown_connections 2023-12-02T01:29:21.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 --2- 172.21.15.167:0/3237043788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100cf950 0x7f6c1006f630 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 --2- 172.21.15.167:0/3237043788 >> v2:172.21.15.1:3300/0 conn(0x7f6c100701a0 0x7f6c100cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 -- 172.21.15.167:0/3237043788 >> 172.21.15.167:0/3237043788 conn(0x7f6c100d0f40 msgr2=0x7f6c100d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:21.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 -- 172.21.15.167:0/3237043788 shutdown_connections 2023-12-02T01:29:21.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.992+0000 7f6c18010640 1 -- 172.21.15.167:0/3237043788 wait complete. 2023-12-02T01:29:21.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.993+0000 7f6c18010640 1 Processor -- start 2023-12-02T01:29:21.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.993+0000 7f6c18010640 1 -- start start 2023-12-02T01:29:21.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c18010640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c100701a0 0x7f6c1014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c18010640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100b0420 0x7f6c100c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c18010640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c100c9090 0x7f6c100ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c18010640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100b4930 con 0x7f6c100701a0 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c18010640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100b4c10 con 0x7f6c100b0420 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c18010640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100b4ef0 con 0x7f6c100c9090 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c155ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100b0420 0x7f6c100c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c155ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100b0420 0x7f6c100c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60942/0 (socket says 172.21.15.167:60942) 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c155ab640 1 -- 172.21.15.167:0/2386736947 learned_addr learned my addr 172.21.15.167:0/2386736947 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c165ad640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c100c9090 0x7f6c100ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.994+0000 7f6c15dac640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c100701a0 0x7f6c1014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c155ab640 1 -- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c100c9090 msgr2=0x7f6c100ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c155ab640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c100c9090 0x7f6c100ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c155ab640 1 -- 172.21.15.167:0/2386736947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c100701a0 msgr2=0x7f6c1014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:21.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c155ab640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c100701a0 0x7f6c1014d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c155ab640 1 -- 172.21.15.167:0/2386736947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0094d0 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c165ad640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c100c9090 0x7f6c100ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c155ab640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100b0420 0x7f6c100c9ac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c02b9e0 tx=0x7f6c0c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c067fc640 1 -- 172.21.15.167:0/2386736947 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c039a90 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c067fc640 1 -- 172.21.15.167:0/2386736947 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c039c10 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c100b51d0 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c067fc640 1 -- 172.21.15.167:0/2386736947 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c043410 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1014d870 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c067fc640 1 -- 172.21.15.167:0/2386736947 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c0c043870 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.995+0000 7f6c067fc640 1 -- 172.21.15.167:0/2386736947 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6c0c02f8c0 con 0x7f6c100b0420 2023-12-02T01:29:21.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.996+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1009f0b0 con 0x7f6c100b0420 2023-12-02T01:29:22.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:21.998+0000 7f6c067fc640 1 -- 172.21.15.167:0/2386736947 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6c0c048070 con 0x7f6c100b0420 2023-12-02T01:29:22.014 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.013+0000 7f3f07211040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-02T01:29:22.015 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:22.014+0000 7f7f45e2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-02T01:29:22.064 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:22.062+0000 7f7f45e2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-02T01:29:22.068 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.067+0000 7f3f07211040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-02T01:29:22.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.070+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "03b03a57-dd1a-4a06-aea4-4537357626f6", "id": 4} v 0) v1 -- 0x7f6c1004e920 con 0x7f6c100b0420 2023-12-02T01:29:22.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.073+0000 7f6c067fc640 1 -- 172.21.15.167:0/2386736947 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "03b03a57-dd1a-4a06-aea4-4537357626f6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c0c034070 con 0x7f6c100b0420 2023-12-02T01:29:22.074 INFO:teuthology.orchestra.run.smithi167.stdout:4 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100b0420 msgr2=0x7f6c100c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100b0420 0x7f6c100c9ac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c02b9e0 tx=0x7f6c0c004730 comp rx=0 tx=0).stop 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 shutdown_connections 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c100c9090 0x7f6c100ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c100b0420 0x7f6c100c9ac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 --2- 172.21.15.167:0/2386736947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c100701a0 0x7f6c1014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 >> 172.21.15.167:0/2386736947 conn(0x7f6c100d0f40 msgr2=0x7f6c100d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 shutdown_connections 2023-12-02T01:29:22.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.074+0000 7f6c18010640 1 -- 172.21.15.167:0/2386736947 wait complete. 2023-12-02T01:29:22.086 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new f31557e6-a9e1-49ee-9577-05533fa03859 5 2023-12-02T01:29:22.119 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.118+0000 7f3f07211040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-02T01:29:22.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.186+0000 7fc2591d0640 1 Processor -- start 2023-12-02T01:29:22.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.186+0000 7fc2591d0640 1 -- start start 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc2591d0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc25415e4b0 0x7fc2540aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc2591d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc2591d0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc254161bc0 con 0x7fc25406a4d0 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc2591d0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2540b3d30 con 0x7fc25415e4b0 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc2591d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc254160fb0 con 0x7fc2540af400 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc25359e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc252d9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc25406a4d0 0x7fc25406a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:58578/0 (socket says 172.21.15.167:58578) 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc252d9d640 1 -- 172.21.15.167:0/244621100 learned_addr learned my addr 172.21.15.167:0/244621100 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc25259c640 1 --2- 172.21.15.167:0/244621100 >> v2:172.21.15.1:3300/0 conn(0x7fc25415e4b0 0x7fc2540aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc251d9b640 1 -- 172.21.15.167:0/244621100 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980296167 0 0) 0x7fc254161bc0 con 0x7fc25406a4d0 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc251d9b640 1 -- 172.21.15.167:0/244621100 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c003520 con 0x7fc25406a4d0 2023-12-02T01:29:22.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc25359e640 1 -- 172.21.15.167:0/244621100 >> v2:172.21.15.1:3300/0 conn(0x7fc25415e4b0 msgr2=0x7fc2540aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:22.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc25359e640 1 --2- 172.21.15.167:0/244621100 >> v2:172.21.15.1:3300/0 conn(0x7fc25415e4b0 0x7fc2540aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc25359e640 1 -- 172.21.15.167:0/244621100 >> v1:172.21.15.167:6789/0 conn(0x7fc25406a4d0 legacy=0x7fc25406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.187+0000 7fc25359e640 1 -- 172.21.15.167:0/244621100 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254161290 con 0x7fc2540af400 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.188+0000 7fc25359e640 1 --2- 172.21.15.167:0/244621100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254071580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009d90 tx=0x7fc24c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733c0c7a09bfc7b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.188+0000 7fc251d9b640 1 -- 172.21.15.167:0/244621100 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c02cc50 con 0x7fc2540af400 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.188+0000 7fc251d9b640 1 -- 172.21.15.167:0/244621100 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c02cdb0 con 0x7fc2540af400 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.188+0000 7fc251d9b640 1 -- 172.21.15.167:0/244621100 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c034660 con 0x7fc2540af400 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.188+0000 7fc2591d0640 1 -- 172.21.15.167:0/244621100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 msgr2=0x7fc254071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.188+0000 7fc2591d0640 1 --2- 172.21.15.167:0/244621100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254071580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009d90 tx=0x7fc24c02bea0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.189+0000 7fc2591d0640 1 -- 172.21.15.167:0/244621100 shutdown_connections 2023-12-02T01:29:22.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.189+0000 7fc2591d0640 1 --2- 172.21.15.167:0/244621100 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254071580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.189+0000 7fc2591d0640 1 --2- 172.21.15.167:0/244621100 >> v2:172.21.15.1:3300/0 conn(0x7fc25415e4b0 0x7fc2540aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.189+0000 7fc2591d0640 1 -- 172.21.15.167:0/244621100 >> 172.21.15.167:0/244621100 conn(0x7fc2540b1be0 msgr2=0x7fc2540b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.189+0000 7fc2591d0640 1 -- 172.21.15.167:0/244621100 shutdown_connections 2023-12-02T01:29:22.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.189+0000 7fc2591d0640 1 -- 172.21.15.167:0/244621100 wait complete. 2023-12-02T01:29:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.190+0000 7fc2591d0640 1 Processor -- start 2023-12-02T01:29:22.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.190+0000 7fc2591d0640 1 -- start start 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc2591d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc25406a4d0 0x7fc254151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc2591d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc2591d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc25415e4b0 0x7fc2540ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc2591d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254153d50 con 0x7fc25415e4b0 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc2591d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254153460 con 0x7fc25406a4d0 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc2591d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2540cee90 con 0x7fc2540af400 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc252d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc25406a4d0 0x7fc254151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:34222/0 (socket says 172.21.15.167:34222) 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 -- 172.21.15.167:0/2750401592 learned_addr learned my addr 172.21.15.167:0/2750401592 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25359e640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc25415e4b0 0x7fc2540ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 -- 172.21.15.167:0/2750401592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc25406a4d0 msgr2=0x7fc254151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc25406a4d0 0x7fc254151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 -- 172.21.15.167:0/2750401592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc25415e4b0 msgr2=0x7fc2540ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc25415e4b0 0x7fc2540ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 -- 172.21.15.167:0/2750401592 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c009a70 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc25259c640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254154170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc24800e8a0 tx=0x7fc24800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.191+0000 7fc23b7fe640 1 -- 172.21.15.167:0/2750401592 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480094f0 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.192+0000 7fc23b7fe640 1 -- 172.21.15.167:0/2750401592 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24800c940 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.192+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc254153690 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.192+0000 7fc23b7fe640 1 -- 172.21.15.167:0/2750401592 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800ccf0 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.192+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2540cf170 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.192+0000 7fc23b7fe640 1 -- 172.21.15.167:0/2750401592 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc248005c90 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.192+0000 7fc23b7fe640 1 -- 172.21.15.167:0/2750401592 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc2480067a0 con 0x7fc2540af400 2023-12-02T01:29:22.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.192+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc254153e90 con 0x7fc2540af400 2023-12-02T01:29:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.194+0000 7fc23b7fe640 1 -- 172.21.15.167:0/2750401592 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc254153e90 con 0x7fc2540af400 2023-12-02T01:29:22.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.266+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f31557e6-a9e1-49ee-9577-05533fa03859", "id": 5} v 0) v1 -- 0x7fc25406e6c0 con 0x7fc2540af400 2023-12-02T01:29:22.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.270+0000 7fc23b7fe640 1 -- 172.21.15.167:0/2750401592 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f31557e6-a9e1-49ee-9577-05533fa03859", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc248021060 con 0x7fc2540af400 2023-12-02T01:29:22.271 INFO:teuthology.orchestra.run.smithi167.stdout:5 2023-12-02T01:29:22.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 msgr2=0x7fc254154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254154170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc24800e8a0 tx=0x7fc24800ed60 comp rx=0 tx=0).stop 2023-12-02T01:29:22.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 shutdown_connections 2023-12-02T01:29:22.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc25415e4b0 0x7fc2540ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2540af400 0x7fc254154170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 --2- 172.21.15.167:0/2750401592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc25406a4d0 0x7fc254151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 >> 172.21.15.167:0/2750401592 conn(0x7fc2540b1be0 msgr2=0x7fc25406efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 shutdown_connections 2023-12-02T01:29:22.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.271+0000 7fc2591d0640 1 -- 172.21.15.167:0/2750401592 wait complete. 2023-12-02T01:29:22.282 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new f9698981-b1ac-440b-8d9d-b4e9c95d52fd 6 2023-12-02T01:29:22.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.423+0000 7fc92ed6e640 1 Processor -- start 2023-12-02T01:29:22.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.423+0000 7fc92ed6e640 1 -- start start 2023-12-02T01:29:22.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92ed6e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc9280cced0 0x7fc92806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92ed6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc9280cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92ed6e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92815a560 con 0x7fc92815a180 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92ed6e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92806e3b0 con 0x7fc9280cced0 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92ed6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92806dc70 con 0x7fc92815dc70 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92d30b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc9280cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92cb0a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc92815a180 0x7fc9280cc7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:58588/0 (socket says 172.21.15.167:58588) 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92cb0a640 1 -- 172.21.15.167:0/2929770925 learned_addr learned my addr 172.21.15.167:0/2929770925 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92d30b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc9280cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:34224/0 (socket says 172.21.15.167:34224) 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc927fff640 1 --2- 172.21.15.167:0/2929770925 >> v2:172.21.15.1:3300/0 conn(0x7fc9280cced0 0x7fc92806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc9277fe640 1 -- 172.21.15.167:0/2929770925 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652182362 0 0) 0x7fc92815a560 con 0x7fc92815a180 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92d30b640 1 -- 172.21.15.167:0/2929770925 >> v2:172.21.15.1:3300/0 conn(0x7fc9280cced0 msgr2=0x7fc92806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92d30b640 1 --2- 172.21.15.167:0/2929770925 >> v2:172.21.15.1:3300/0 conn(0x7fc9280cced0 0x7fc92806de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92d30b640 1 -- 172.21.15.167:0/2929770925 >> v1:172.21.15.167:6789/0 conn(0x7fc92815a180 legacy=0x7fc9280cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.424+0000 7fc92d30b640 1 -- 172.21.15.167:0/2929770925 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92806e5c0 con 0x7fc92815dc70 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.425+0000 7fc92d30b640 1 --2- 172.21.15.167:0/2929770925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc9280cdcb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc920009d90 tx=0x7fc92002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fff12c9a65ae9fe server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.425+0000 7fc9277fe640 1 -- 172.21.15.167:0/2929770925 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92002cc50 con 0x7fc92815dc70 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.425+0000 7fc9277fe640 1 -- 172.21.15.167:0/2929770925 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92002cdb0 con 0x7fc92815dc70 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.425+0000 7fc9277fe640 1 -- 172.21.15.167:0/2929770925 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920034660 con 0x7fc92815dc70 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.425+0000 7fc92ed6e640 1 -- 172.21.15.167:0/2929770925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 msgr2=0x7fc9280cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.425+0000 7fc92ed6e640 1 --2- 172.21.15.167:0/2929770925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc9280cdcb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc920009d90 tx=0x7fc92002bea0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.426+0000 7fc92ed6e640 1 -- 172.21.15.167:0/2929770925 shutdown_connections 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.426+0000 7fc92ed6e640 1 --2- 172.21.15.167:0/2929770925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc9280cdcb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.426+0000 7fc92ed6e640 1 --2- 172.21.15.167:0/2929770925 >> v2:172.21.15.1:3300/0 conn(0x7fc9280cced0 0x7fc92806de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.426+0000 7fc92ed6e640 1 -- 172.21.15.167:0/2929770925 >> 172.21.15.167:0/2929770925 conn(0x7fc9280b19d0 msgr2=0x7fc9280b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.426+0000 7fc92ed6e640 1 -- 172.21.15.167:0/2929770925 shutdown_connections 2023-12-02T01:29:22.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.426+0000 7fc92ed6e640 1 -- 172.21.15.167:0/2929770925 wait complete. 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.427+0000 7fc92ed6e640 1 Processor -- start 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.427+0000 7fc92ed6e640 1 -- start start 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9280cced0 0x7fc9280b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc92815a180 0x7fc9280b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc92806a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280b3310 con 0x7fc9280cced0 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280b35f0 con 0x7fc92815a180 2023-12-02T01:29:22.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280b38d0 con 0x7fc92815dc70 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc927fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc92815a180 0x7fc9280b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc927fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc92815a180 0x7fc9280b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60958/0 (socket says 172.21.15.167:60958) 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92d30b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc92806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc927fff640 1 -- 172.21.15.167:0/3597038682 learned_addr learned my addr 172.21.15.167:0/3597038682 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92cb0a640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9280cced0 0x7fc9280b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92d30b640 1 -- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc92815a180 msgr2=0x7fc9280b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92d30b640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc92815a180 0x7fc9280b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92d30b640 1 -- 172.21.15.167:0/3597038682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9280cced0 msgr2=0x7fc9280b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92d30b640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9280cced0 0x7fc9280b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92d30b640 1 -- 172.21.15.167:0/3597038682 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009a70 con 0x7fc92815dc70 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc927fff640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc92815a180 0x7fc9280b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:22.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92d30b640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc92806a740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc920033000 tx=0x7fc920004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc9257fa640 1 -- 172.21.15.167:0/3597038682 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920040650 con 0x7fc92815dc70 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc9257fa640 1 -- 172.21.15.167:0/3597038682 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9200407b0 con 0x7fc92815dc70 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9280b3bb0 con 0x7fc92815dc70 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc9257fa640 1 -- 172.21.15.167:0/3597038682 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920040b60 con 0x7fc92815dc70 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.428+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9280b2f70 con 0x7fc92815dc70 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.429+0000 7fc9257fa640 1 -- 172.21.15.167:0/3597038682 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc920049400 con 0x7fc92815dc70 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.429+0000 7fc9257fa640 1 -- 172.21.15.167:0/3597038682 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc92003e9f0 con 0x7fc92815dc70 2023-12-02T01:29:22.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.430+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9280b40d0 con 0x7fc92815dc70 2023-12-02T01:29:22.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.432+0000 7fc9257fa640 1 -- 172.21.15.167:0/3597038682 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc920067ce0 con 0x7fc92815dc70 2023-12-02T01:29:22.461 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:22.459+0000 7f7f45e2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-02T01:29:22.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.518+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f9698981-b1ac-440b-8d9d-b4e9c95d52fd", "id": 6} v 0) v1 -- 0x7fc92809e030 con 0x7fc92815dc70 2023-12-02T01:29:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.521+0000 7fc9257fa640 1 -- 172.21.15.167:0/3597038682 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9698981-b1ac-440b-8d9d-b4e9c95d52fd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc920056030 con 0x7fc92815dc70 2023-12-02T01:29:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:6 2023-12-02T01:29:22.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.522+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 msgr2=0x7fc92806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.522+0000 7fc92ed6e640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc92806a740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc920033000 tx=0x7fc920004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.522+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 shutdown_connections 2023-12-02T01:29:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.522+0000 7fc92ed6e640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc92815dc70 0x7fc92806a740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.522+0000 7fc92ed6e640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc92815a180 0x7fc9280b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.522+0000 7fc92ed6e640 1 --2- 172.21.15.167:0/3597038682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9280cced0 0x7fc9280b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.522+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 >> 172.21.15.167:0/3597038682 conn(0x7fc9280b19d0 msgr2=0x7fc9280b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.523+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 shutdown_connections 2023-12-02T01:29:22.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.523+0000 7fc92ed6e640 1 -- 172.21.15.167:0/3597038682 wait complete. 2023-12-02T01:29:22.535 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new c0f5c73c-31bb-4072-a7c6-eae14cae214e 7 2023-12-02T01:29:22.590 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.535+0000 7f3f07211040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-02T01:29:22.603 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:22.602+0000 7f7f45e2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-02T01:29:22.674 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.673+0000 7f3f07211040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-02T01:29:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.688+0000 7f0f2510f640 1 Processor -- start 2023-12-02T01:29:22.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.688+0000 7f0f2510f640 1 -- start start 2023-12-02T01:29:22.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.688+0000 7f0f2510f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015a180 0x7f0f2006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.688+0000 7f0f2510f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0f2015dc70 0x7f0f200cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.688+0000 7f0f2510f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2015a560 con 0x7f0f200ccd00 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.688+0000 7f0f2510f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200cd190 con 0x7f0f2015dc70 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.688+0000 7f0f2510f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2006e3b0 con 0x7f0f2015a180 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1ed9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015a180 0x7f0f2006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1f59e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0f200ccd00 0x7f0f20071310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:54008/0 (socket says 172.21.15.167:54008) 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1f59e640 1 -- 172.21.15.167:0/3907531773 learned_addr learned my addr 172.21.15.167:0/3907531773 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1e59c640 1 --2- 172.21.15.167:0/3907531773 >> v2:172.21.15.1:3300/0 conn(0x7f0f2015dc70 0x7f0f200cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1ed9d640 1 -- 172.21.15.167:0/3907531773 >> v2:172.21.15.1:3300/0 conn(0x7f0f2015dc70 msgr2=0x7f0f200cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1ed9d640 1 --2- 172.21.15.167:0/3907531773 >> v2:172.21.15.1:3300/0 conn(0x7f0f2015dc70 0x7f0f200cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1dd9b640 1 -- 172.21.15.167:0/3907531773 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567198092 0 0) 0x7f0f2015a560 con 0x7f0f200ccd00 2023-12-02T01:29:22.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1ed9d640 1 -- 172.21.15.167:0/3907531773 >> v1:172.21.15.167:6789/0 conn(0x7f0f200ccd00 legacy=0x7f0f20071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1ed9d640 1 -- 172.21.15.167:0/3907531773 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2006e5c0 con 0x7f0f2015a180 2023-12-02T01:29:22.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.689+0000 7f0f1e59c640 1 --2- 172.21.15.167:0/3907531773 >> v2:172.21.15.1:3300/0 conn(0x7f0f2015dc70 0x7f0f200cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:22.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f1ed9d640 1 --2- 172.21.15.167:0/3907531773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015a180 0x7f0f2006de70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0f100097a0 tx=0x7f0f1002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed2d91fae0f390e server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f1dd9b640 1 -- 172.21.15.167:0/3907531773 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10031830 con 0x7f0f2015a180 2023-12-02T01:29:22.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f1dd9b640 1 -- 172.21.15.167:0/3907531773 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f10031990 con 0x7f0f2015a180 2023-12-02T01:29:22.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f1dd9b640 1 -- 172.21.15.167:0/3907531773 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10031d20 con 0x7f0f2015a180 2023-12-02T01:29:22.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 -- 172.21.15.167:0/3907531773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015a180 msgr2=0x7f0f2006de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 --2- 172.21.15.167:0/3907531773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015a180 0x7f0f2006de70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0f100097a0 tx=0x7f0f1002b8d0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 -- 172.21.15.167:0/3907531773 shutdown_connections 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 --2- 172.21.15.167:0/3907531773 >> v2:172.21.15.1:3300/0 conn(0x7f0f2015dc70 0x7f0f200cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 --2- 172.21.15.167:0/3907531773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015a180 0x7f0f2006de70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 -- 172.21.15.167:0/3907531773 >> 172.21.15.167:0/3907531773 conn(0x7f0f200b19d0 msgr2=0x7f0f200b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 -- 172.21.15.167:0/3907531773 shutdown_connections 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.690+0000 7f0f2510f640 1 -- 172.21.15.167:0/3907531773 wait complete. 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.692+0000 7f0f2510f640 1 Processor -- start 2023-12-02T01:29:22.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.692+0000 7f0f2510f640 1 -- start start 2023-12-02T01:29:22.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f2510f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f200ccd00 0x7f0f200b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f2510f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f2015a180 0x7f0f2014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f2510f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015dc70 0x7f0f200c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f2510f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200c3bf0 con 0x7f0f2015a180 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f2510f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200b30f0 con 0x7f0f200ccd00 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f2510f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200b5940 con 0x7f0f2015dc70 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f200ccd00 0x7f0f200b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015dc70 0x7f0f200c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f200ccd00 0x7f0f200b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50544/0 (socket says 172.21.15.167:50544) 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015dc70 0x7f0f200c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:51542/0 (socket says 172.21.15.167:51542) 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1ed9d640 1 -- 172.21.15.167:0/2272420965 learned_addr learned my addr 172.21.15.167:0/2272420965 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1e59c640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f2015a180 0x7f0f2014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 -- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f200ccd00 msgr2=0x7f0f200b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f200ccd00 0x7f0f200b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 -- 172.21.15.167:0/2272420965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f2015a180 msgr2=0x7f0f2014d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f2015a180 0x7f0f2014d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 -- 172.21.15.167:0/2272420965 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009400 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1ed9d640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f200ccd00 0x7f0f200b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f1f59e640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015dc70 0x7f0f200c7f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e910 tx=0x7f0f1800edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f077fe640 1 -- 172.21.15.167:0/2272420965 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004d70 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f077fe640 1 -- 172.21.15.167:0/2272420965 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f18001b70 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.693+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f200c6270 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.694+0000 7f0f077fe640 1 -- 172.21.15.167:0/2272420965 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18001f20 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.694+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f200b2d10 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.694+0000 7f0f077fe640 1 -- 172.21.15.167:0/2272420965 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f180070d0 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.694+0000 7f0f077fe640 1 -- 172.21.15.167:0/2272420965 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0f18011ad0 con 0x7f0f2015dc70 2023-12-02T01:29:22.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.694+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f200b3230 con 0x7f0f2015dc70 2023-12-02T01:29:22.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.697+0000 7f0f077fe640 1 -- 172.21.15.167:0/2272420965 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0f18039ce0 con 0x7f0f2015dc70 2023-12-02T01:29:22.723 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:22.722+0000 7f7f45e2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-02T01:29:22.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.767+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c0f5c73c-31bb-4072-a7c6-eae14cae214e", "id": 7} v 0) v1 -- 0x7f0f200c6790 con 0x7f0f2015dc70 2023-12-02T01:29:22.770 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:22.769+0000 7f7f45e2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-02T01:29:22.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.771+0000 7f0f077fe640 1 -- 172.21.15.167:0/2272420965 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0f5c73c-31bb-4072-a7c6-eae14cae214e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0f18028030 con 0x7f0f2015dc70 2023-12-02T01:29:22.772 INFO:teuthology.orchestra.run.smithi167.stdout:7 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015dc70 msgr2=0x7f0f200c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015dc70 0x7f0f200c7f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e910 tx=0x7f0f1800edd0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 shutdown_connections 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f2015dc70 0x7f0f200c7f20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f2015a180 0x7f0f2014d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 --2- 172.21.15.167:0/2272420965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f200ccd00 0x7f0f200b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 >> 172.21.15.167:0/2272420965 conn(0x7f0f200b19d0 msgr2=0x7f0f200aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 shutdown_connections 2023-12-02T01:29:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:29:22.772+0000 7f0f2510f640 1 -- 172.21.15.167:0/2272420965 wait complete. 2023-12-02T01:29:22.784 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-02T01:29:22.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-02T01:29:22.786 INFO:tasks.ceph.osd.0:Started 2023-12-02T01:29:22.786 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-02T01:29:22.786 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-02T01:29:22.789 INFO:tasks.ceph.osd.1:Started 2023-12-02T01:29:22.789 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-02T01:29:22.789 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-02T01:29:22.791 INFO:tasks.ceph.osd.2:Started 2023-12-02T01:29:22.791 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-02T01:29:22.791 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-02T01:29:22.793 INFO:tasks.ceph.osd.3:Started 2023-12-02T01:29:22.793 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-02T01:29:22.793 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-02T01:29:22.795 INFO:tasks.ceph.osd.4:Started 2023-12-02T01:29:22.795 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-02T01:29:22.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-02T01:29:22.797 INFO:tasks.ceph.osd.5:Started 2023-12-02T01:29:22.797 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-02T01:29:22.797 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-02T01:29:22.798 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.797+0000 7f3f07211040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-02T01:29:22.799 INFO:tasks.ceph.osd.6:Started 2023-12-02T01:29:22.799 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-02T01:29:22.800 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-02T01:29:22.802 INFO:tasks.ceph.osd.7:Started 2023-12-02T01:29:22.803 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:22.853 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.851+0000 7f3f07211040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-02T01:29:22.909 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:22.907+0000 7f7f45e2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-02T01:29:22.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.938+0000 7f849fbea640 1 Processor -- start 2023-12-02T01:29:22.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.938+0000 7f849fbea640 1 -- start start 2023-12-02T01:29:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.939+0000 7f849fbea640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f84980ceef0 0x7f8498071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.939+0000 7f849fbea640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980cc3f0 con 0x7f849815a100 2023-12-02T01:29:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.939+0000 7f849fbea640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980cb7e0 con 0x7f8498071870 2023-12-02T01:29:22.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.939+0000 7f849fbea640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498071d00 con 0x7f84980ceef0 2023-12-02T01:29:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.939+0000 7f849d986640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f849815a100 0x7f84980cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45464/0 (socket says 172.21.15.1:45464) 2023-12-02T01:29:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.939+0000 7f849d986640 1 -- 172.21.15.1:0/541348256 learned_addr learned my addr 172.21.15.1:0/541348256 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.939+0000 7f849d185640 1 --2- 172.21.15.1:0/541348256 >> v2:172.21.15.1:3300/0 conn(0x7f84980ceef0 0x7f8498071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.940+0000 7f849d185640 1 -- 172.21.15.1:0/541348256 >> v1:172.21.15.167:6789/0 conn(0x7f8498071870 legacy=0x7f849806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.940+0000 7f849d185640 1 -- 172.21.15.1:0/541348256 >> v1:172.21.15.1:6789/0 conn(0x7f849815a100 legacy=0x7f84980cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.940+0000 7f849c984640 1 -- 172.21.15.1:0/541348256 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735264740 0 0) 0x7f84980cc3f0 con 0x7f849815a100 2023-12-02T01:29:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.940+0000 7f849d185640 1 -- 172.21.15.1:0/541348256 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84980cbac0 con 0x7f84980ceef0 2023-12-02T01:29:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.941+0000 7f849d185640 1 --2- 172.21.15.1:0/541348256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84980ceef0 0x7f8498071330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84940097d0 tx=0x7f849402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449385874ff9faf6 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.941+0000 7f849c984640 1 -- 172.21.15.1:0/541348256 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494031830 con 0x7f84980ceef0 2023-12-02T01:29:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.941+0000 7f849c984640 1 -- 172.21.15.1:0/541348256 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494031990 con 0x7f84980ceef0 2023-12-02T01:29:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.941+0000 7f849c984640 1 -- 172.21.15.1:0/541348256 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494031d20 con 0x7f84980ceef0 2023-12-02T01:29:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.942+0000 7f849fbea640 1 -- 172.21.15.1:0/541348256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84980ceef0 msgr2=0x7f8498071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.942+0000 7f849fbea640 1 --2- 172.21.15.1:0/541348256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84980ceef0 0x7f8498071330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84940097d0 tx=0x7f849402b8d0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.942+0000 7f849fbea640 1 -- 172.21.15.1:0/541348256 shutdown_connections 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.942+0000 7f849fbea640 1 --2- 172.21.15.1:0/541348256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84980ceef0 0x7f8498071330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.942+0000 7f849fbea640 1 -- 172.21.15.1:0/541348256 >> 172.21.15.1:0/541348256 conn(0x7f84980cfe80 msgr2=0x7f84980d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.942+0000 7f849fbea640 1 -- 172.21.15.1:0/541348256 shutdown_connections 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.942+0000 7f849fbea640 1 -- 172.21.15.1:0/541348256 wait complete. 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.943+0000 7f849fbea640 1 Processor -- start 2023-12-02T01:29:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.943+0000 7f849fbea640 1 -- start start 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849fbea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8498071870 0x7f84980c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849fbea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84980ceef0 0x7f849814f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849fbea640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f849815a100 0x7f84980b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849fbea640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84980c3700 con 0x7f8498071870 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849fbea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849814f850 con 0x7f84980ceef0 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849fbea640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849815c5c0 con 0x7f849815a100 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8498071870 0x7f84980c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8498071870 0x7f84980c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49680/0 (socket says 172.21.15.1:49680) 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 -- 172.21.15.1:0/4082455911 learned_addr learned my addr 172.21.15.1:0/4082455911 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d185640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84980ceef0 0x7f849814f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849e187640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f849815a100 0x7f84980b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 -- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f849815a100 msgr2=0x7f84980b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f849815a100 0x7f84980b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 -- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84980ceef0 msgr2=0x7f849814f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84980ceef0 0x7f849814f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 -- 172.21.15.1:0/4082455911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009400 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.944+0000 7f849d986640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8498071870 0x7f84980c4430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f848800c460 tx=0x7f848800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.945+0000 7f848e7fc640 1 -- 172.21.15.1:0/4082455911 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880074e0 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.945+0000 7f848e7fc640 1 -- 172.21.15.1:0/4082455911 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488007660 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.945+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84980c3950 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.945+0000 7f848e7fc640 1 -- 172.21.15.1:0/4082455911 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488004a20 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.945+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84980c3f10 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.945+0000 7f848e7fc640 1 -- 172.21.15.1:0/4082455911 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f848801d440 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.945+0000 7f848e7fc640 1 -- 172.21.15.1:0/4082455911 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8488012ad0 con 0x7f8498071870 2023-12-02T01:29:22.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.946+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84980c4100 con 0x7f8498071870 2023-12-02T01:29:22.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:22.948+0000 7f848e7fc640 1 -- 172.21.15.1:0/4082455911 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8488018070 con 0x7f8498071870 2023-12-02T01:29:22.966 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:22.965+0000 7f3f07211040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-02T01:29:23.010 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:23.008+0000 7f7f45e2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-02T01:29:23.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.010+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8498068470 con 0x7f8498071870 2023-12-02T01:29:23.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.010+0000 7f848e7fc640 1 -- 172.21.15.1:0/4082455911 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8488012400 con 0x7f8498071870 2023-12-02T01:29:23.012 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:23.012 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":10,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:22.769280+0000","last_up_change":"0.000000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8498071870 msgr2=0x7f84980c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8498071870 0x7f84980c4430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f848800c460 tx=0x7f848800c920 comp rx=0 tx=0).stop 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 shutdown_connections 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f849815a100 0x7f84980b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84980ceef0 0x7f849814f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 --2- 172.21.15.1:0/4082455911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8498071870 0x7f84980c4430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 >> 172.21.15.1:0/4082455911 conn(0x7f84980cfe80 msgr2=0x7f849806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 shutdown_connections 2023-12-02T01:29:23.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:23.011+0000 7f849fbea640 1 -- 172.21.15.1:0/4082455911 wait complete. 2023-12-02T01:29:23.023 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-02T01:29:23.023 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-02T01:29:23.061 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:23.060+0000 7f3f07211040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-02T01:29:23.156 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:23.154+0000 7f7f45e2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-02T01:29:23.200 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:23.198+0000 7f7f45e2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-02T01:29:23.202 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:23.201+0000 7f3f07211040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-02T01:29:23.244 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:23.243+0000 7f3f07211040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-02T01:29:23.346 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:23.345+0000 7f7f45e2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-02T01:29:23.383 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:23.381+0000 7f3f07211040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-02T01:29:23.396 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T01:29:23.394+0000 7fe5f951c500 -1 Falling back to public interface 2023-12-02T01:29:23.404 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T01:29:23.402+0000 7efe710fa500 -1 Falling back to public interface 2023-12-02T01:29:23.404 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T01:29:23.401+0000 7f9974c14500 -1 Falling back to public interface 2023-12-02T01:29:23.410 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T01:29:23.409+0000 7f56f7e0e500 -1 Falling back to public interface 2023-12-02T01:29:23.423 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T01:29:23.421+0000 7fdc7e011500 -1 Falling back to public interface 2023-12-02T01:29:23.425 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T01:29:23.423+0000 7f04e1812500 -1 Falling back to public interface 2023-12-02T01:29:23.430 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T01:29:23.429+0000 7f1e13782500 -1 Falling back to public interface 2023-12-02T01:29:23.431 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T01:29:23.430+0000 7f172dcd6500 -1 Falling back to public interface 2023-12-02T01:29:23.827 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:23.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.918+0000 7f30a9b6e640 1 Processor -- start 2023-12-02T01:29:23.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.918+0000 7f30a9b6e640 1 -- start start 2023-12-02T01:29:23.921 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a9b6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413cf00 0x7f30a40b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:23.921 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a9b6e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f30a413d2e0 0x7f30a40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:23.921 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a9b6e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30a413fb20 0x7f30a413ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:23.921 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a9b6e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a415ebf0 con 0x7f30a413fb20 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a9b6e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a415de30 con 0x7f30a413d2e0 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a9b6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a415e110 con 0x7f30a413cf00 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30a413fb20 0x7f30a413ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f30a413fb20 0x7f30a413ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49686/0 (socket says 172.21.15.1:49686) 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.919+0000 7f30a3fff640 1 -- 172.21.15.1:0/2937128720 learned_addr learned my addr 172.21.15.1:0/2937128720 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a37fe640 1 --2- 172.21.15.1:0/2937128720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413cf00 0x7f30a40b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a2ffd640 1 --2- 172.21.15.1:0/2937128720 >> v2:172.21.15.167:3300/0 conn(0x7f30a413d2e0 0x7f30a40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a3fff640 1 -- 172.21.15.1:0/2937128720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413cf00 msgr2=0x7f30a40b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a3fff640 1 --2- 172.21.15.1:0/2937128720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413cf00 0x7f30a40b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a3fff640 1 -- 172.21.15.1:0/2937128720 >> v2:172.21.15.167:3300/0 conn(0x7f30a413d2e0 msgr2=0x7f30a40b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a3fff640 1 --2- 172.21.15.1:0/2937128720 >> v2:172.21.15.167:3300/0 conn(0x7f30a413d2e0 0x7f30a40b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.922 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a3fff640 1 -- 172.21.15.1:0/2937128720 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a415e3f0 con 0x7f30a413fb20 2023-12-02T01:29:23.923 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.920+0000 7f30a3fff640 1 --2- 172.21.15.1:0/2937128720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a413ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f30a406e4d0 tx=0x7f309c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc459d494bb5d5a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a27fc640 1 -- 172.21.15.1:0/2937128720 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c02ea80 con 0x7f30a413fb20 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a27fc640 1 -- 172.21.15.1:0/2937128720 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c02ebe0 con 0x7f30a413fb20 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a27fc640 1 -- 172.21.15.1:0/2937128720 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c009600 con 0x7f30a413fb20 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 -- 172.21.15.1:0/2937128720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 msgr2=0x7f30a413ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/2937128720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a413ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f30a406e4d0 tx=0x7f309c02e0e0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 -- 172.21.15.1:0/2937128720 shutdown_connections 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/2937128720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a413ff90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/2937128720 >> v2:172.21.15.167:3300/0 conn(0x7f30a413d2e0 0x7f30a40b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/2937128720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413cf00 0x7f30a40b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 -- 172.21.15.1:0/2937128720 >> 172.21.15.1:0/2937128720 conn(0x7f30a40cca30 msgr2=0x7f30a40cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 -- 172.21.15.1:0/2937128720 shutdown_connections 2023-12-02T01:29:23.924 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.921+0000 7f30a9b6e640 1 -- 172.21.15.1:0/2937128720 wait complete. 2023-12-02T01:29:23.926 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.923+0000 7f30a9b6e640 1 Processor -- start 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.923+0000 7f30a9b6e640 1 -- start start 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.923+0000 7f30a9b6e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a413cf00 0x7f30a4138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.923+0000 7f30a9b6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413d2e0 0x7f30a41384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.923+0000 7f30a9b6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a4135dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.923+0000 7f30a9b6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4138a10 con 0x7f30a413fb20 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.923+0000 7f30a9b6e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4136300 con 0x7f30a413cf00 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a9b6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4135930 con 0x7f30a413d2e0 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a413cf00 0x7f30a4138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a2ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413d2e0 0x7f30a41384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a413cf00 0x7f30a4138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:34018/0 (socket says 172.21.15.1:34018) 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 -- 172.21.15.1:0/3204533063 learned_addr learned my addr 172.21.15.1:0/3204533063 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a4135dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:23.927 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 -- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413d2e0 msgr2=0x7f30a41384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413d2e0 0x7f30a41384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 -- 172.21.15.1:0/3204533063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 msgr2=0x7f30a4135dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a4135dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 -- 172.21.15.1:0/3204533063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c00bd40 con 0x7f30a413cf00 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a2ffd640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413d2e0 0x7f30a41384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a3fff640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a4135dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a37fe640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a413cf00 0x7f30a4138ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f309400e870 tx=0x7f309400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f308bfff640 1 -- 172.21.15.1:0/3204533063 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30940094f0 con 0x7f30a413cf00 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f308bfff640 1 -- 172.21.15.1:0/3204533063 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309400c940 con 0x7f30a413cf00 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a4149670 con 0x7f30a413cf00 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f308bfff640 1 -- 172.21.15.1:0/3204533063 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400ccf0 con 0x7f30a413cf00 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.924+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a41352e0 con 0x7f30a413cf00 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.925+0000 7f308bfff640 1 -- 172.21.15.1:0/3204533063 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3094013770 con 0x7f30a413cf00 2023-12-02T01:29:23.928 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.925+0000 7f308bfff640 1 -- 172.21.15.1:0/3204533063 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f309401cdf0 con 0x7f30a413cf00 2023-12-02T01:29:23.929 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.926+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a4068400 con 0x7f30a413cf00 2023-12-02T01:29:23.929 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.928+0000 7f308bfff640 1 -- 172.21.15.1:0/3204533063 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3094021060 con 0x7f30a413cf00 2023-12-02T01:29:23.992 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.990+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30a4072640 con 0x7f30a413cf00 2023-12-02T01:29:23.992 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.991+0000 7f308bfff640 1 -- 172.21.15.1:0/3204533063 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3094017070 con 0x7f30a413cf00 2023-12-02T01:29:23.992 INFO:teuthology.misc.health.smithi001.stdout: 2023-12-02T01:29:23.993 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":10,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:22.769280+0000","last_up_change":"0.000000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:23.994 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.992+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a413cf00 msgr2=0x7f30a4138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:23.994 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.992+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a413cf00 0x7f30a4138ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f309400e870 tx=0x7f309400ed30 comp rx=0 tx=0).stop 2023-12-02T01:29:23.994 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.992+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 shutdown_connections 2023-12-02T01:29:23.994 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.992+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a413fb20 0x7f30a4135dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.995 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.992+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a413d2e0 0x7f30a41384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.995 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.992+0000 7f30a9b6e640 1 --2- 172.21.15.1:0/3204533063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a413cf00 0x7f30a4138ed0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:23.995 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.992+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 >> 172.21.15.1:0/3204533063 conn(0x7f30a40cca30 msgr2=0x7f30a406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:23.995 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.993+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 shutdown_connections 2023-12-02T01:29:23.995 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:23.993+0000 7f30a9b6e640 1 -- 172.21.15.1:0/3204533063 wait complete. 2023-12-02T01:29:24.007 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-02T01:29:24.168 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:24.166+0000 7f7f45e2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-02T01:29:24.213 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:24.212+0000 7f3f07211040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-02T01:29:24.452 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:24.451+0000 7f7f45e2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-02T01:29:24.486 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:24.484+0000 7f3f07211040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-02T01:29:24.507 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:24.506+0000 7f7f45e2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-02T01:29:24.538 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:24.537+0000 7f3f07211040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-02T01:29:24.612 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:24.611+0000 7f7f45e2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-02T01:29:24.639 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-12-02T01:29:24.638+0000 7f3f07211040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-02T01:29:25.637 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:25.635+0000 7f7ee6a6e640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-02T01:29:25.639 INFO:tasks.ceph.mgr.y.smithi001.stderr:2023-12-02T01:29:25.638+0000 7f7ee6a6e640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-02T01:29:26.855 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T01:29:26.853+0000 7fe5f951c500 -1 osd.4 0 log_to_monitors true 2023-12-02T01:29:26.880 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T01:29:26.878+0000 7f56f7e0e500 -1 osd.1 0 log_to_monitors true 2023-12-02T01:29:26.899 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T01:29:26.898+0000 7f9974c14500 -1 osd.0 0 log_to_monitors true 2023-12-02T01:29:26.907 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T01:29:26.906+0000 7efe710fa500 -1 osd.7 0 log_to_monitors true 2023-12-02T01:29:26.957 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T01:29:26.955+0000 7f04e1812500 -1 osd.2 0 log_to_monitors true 2023-12-02T01:29:26.958 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T01:29:26.956+0000 7f172dcd6500 -1 osd.6 0 log_to_monitors true 2023-12-02T01:29:26.958 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T01:29:26.956+0000 7f1e13782500 -1 osd.5 0 log_to_monitors true 2023-12-02T01:29:26.962 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T01:29:26.961+0000 7fdc7e011500 -1 osd.3 0 log_to_monitors true 2023-12-02T01:29:30.129 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T01:29:30.128+0000 7f56f2f11640 -1 osd.1 0 waiting for initial osdmap 2023-12-02T01:29:30.145 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T01:29:30.144+0000 7f56eb549640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.171 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T01:29:30.169+0000 7f996fcbc640 -1 osd.0 0 waiting for initial osdmap 2023-12-02T01:29:30.182 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T01:29:30.181+0000 7f99682f4640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.200 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T01:29:30.199+0000 7f04dca6c640 -1 osd.2 0 waiting for initial osdmap 2023-12-02T01:29:30.206 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T01:29:30.205+0000 7fdc7924c640 -1 osd.3 0 waiting for initial osdmap 2023-12-02T01:29:30.212 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T01:29:30.211+0000 7f04d50a4640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.226 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T01:29:30.225+0000 7fdc71884640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.662 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T01:29:30.660+0000 7fe5f4c87640 -1 osd.4 0 waiting for initial osdmap 2023-12-02T01:29:30.674 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T01:29:30.673+0000 7fe5ed2bf640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.721 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T01:29:30.720+0000 7efe6c865640 -1 osd.7 0 waiting for initial osdmap 2023-12-02T01:29:30.732 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T01:29:30.731+0000 7f1e0eeef640 -1 osd.5 0 waiting for initial osdmap 2023-12-02T01:29:30.734 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T01:29:30.733+0000 7efe64e9d640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.746 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T01:29:30.745+0000 7f1e07527640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.761 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T01:29:30.760+0000 7f1729441640 -1 osd.6 0 waiting for initial osdmap 2023-12-02T01:29:30.776 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T01:29:30.775+0000 7f1721a79640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-02T01:29:30.814 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:30.909 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.908+0000 7fd451f97640 1 Processor -- start 2023-12-02T01:29:30.910 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.908+0000 7fd451f97640 1 -- start start 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd451f97640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd44c0ce870 0x7fd44c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd451f97640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd44c0ced00 0x7fd44c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd451f97640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c0b6010 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd451f97640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c0b6b90 con 0x7fd44c0ce870 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd451f97640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c0b6260 con 0x7fd44c0ced00 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd44c0ce870 0x7fd44c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd44c0ce870 0x7fd44c0b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49794/0 (socket says 172.21.15.1:49794) 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44affd640 1 -- 172.21.15.1:0/2327569167 learned_addr learned my addr 172.21.15.1:0/2327569167 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44bfff640 1 --2- 172.21.15.1:0/2327569167 >> v2:172.21.15.167:3300/0 conn(0x7fd44c0ced00 0x7fd44c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:30.911 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44affd640 1 -- 172.21.15.1:0/2327569167 >> v2:172.21.15.167:3300/0 conn(0x7fd44c0ced00 msgr2=0x7fd44c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:30.912 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44affd640 1 --2- 172.21.15.1:0/2327569167 >> v2:172.21.15.167:3300/0 conn(0x7fd44c0ced00 0x7fd44c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:30.912 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44affd640 1 -- 172.21.15.1:0/2327569167 >> v1:172.21.15.167:6789/0 conn(0x7fd44c0cfbd0 legacy=0x7fd44c0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:30.912 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.909+0000 7fd44affd640 1 -- 172.21.15.1:0/2327569167 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0b6540 con 0x7fd44c0ce870 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.910+0000 7fd44affd640 1 --2- 172.21.15.1:0/2327569167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0ce870 0x7fd44c0b3dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd44c08d5d0 tx=0x7fd44002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1653e387e1aeb5de server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.910+0000 7fd44a7fc640 1 -- 172.21.15.1:0/2327569167 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440030860 con 0x7fd44c0ce870 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.910+0000 7fd44a7fc640 1 -- 172.21.15.1:0/2327569167 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4400309c0 con 0x7fd44c0ce870 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.910+0000 7fd44a7fc640 1 -- 172.21.15.1:0/2327569167 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440030d50 con 0x7fd44c0ce870 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 -- 172.21.15.1:0/2327569167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0ce870 msgr2=0x7fd44c0b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 --2- 172.21.15.1:0/2327569167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0ce870 0x7fd44c0b3dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd44c08d5d0 tx=0x7fd44002b9a0 comp rx=0 tx=0).stop 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 -- 172.21.15.1:0/2327569167 shutdown_connections 2023-12-02T01:29:30.913 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 --2- 172.21.15.1:0/2327569167 >> v2:172.21.15.167:3300/0 conn(0x7fd44c0ced00 0x7fd44c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:30.914 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 --2- 172.21.15.1:0/2327569167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0ce870 0x7fd44c0b3dc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:30.914 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 -- 172.21.15.1:0/2327569167 >> 172.21.15.1:0/2327569167 conn(0x7fd44c09c490 msgr2=0x7fd44c0d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:30.914 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 -- 172.21.15.1:0/2327569167 shutdown_connections 2023-12-02T01:29:30.914 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.911+0000 7fd451f97640 1 -- 172.21.15.1:0/2327569167 wait complete. 2023-12-02T01:29:30.914 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.912+0000 7fd451f97640 1 Processor -- start 2023-12-02T01:29:30.918 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.912+0000 7fd451f97640 1 -- start start 2023-12-02T01:29:30.918 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd451f97640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0ce870 0x7fd44c14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:30.918 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd451f97640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ced00 0x7fd44c1e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:30.918 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd451f97640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0cfbd0 0x7fd44c1e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:30.918 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd451f97640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1e2610 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.918 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd451f97640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1f42f0 con 0x7fd44c0ced00 2023-12-02T01:29:30.918 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd451f97640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1e2860 con 0x7fd44c0ce870 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0cfbd0 0x7fd44c1e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0cfbd0 0x7fd44c1e8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49808/0 (socket says 172.21.15.1:49808) 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 -- 172.21.15.1:0/204964726 learned_addr learned my addr 172.21.15.1:0/204964726 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44b7fe640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0ce870 0x7fd44c14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44affd640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ced00 0x7fd44c1e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 -- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0ce870 msgr2=0x7fd44c14c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0ce870 0x7fd44c14c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 -- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ced00 msgr2=0x7fd44c1e3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ced00 0x7fd44c1e3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 -- 172.21.15.1:0/204964726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400094d0 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd44bfff640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0cfbd0 0x7fd44c1e8c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd44400efc0 tx=0x7fd44400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd433fff640 1 -- 172.21.15.1:0/204964726 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444014480 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.919 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.913+0000 7fd433fff640 1 -- 172.21.15.1:0/204964726 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44400f040 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.914+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c1e2b40 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.914+0000 7fd433fff640 1 -- 172.21.15.1:0/204964726 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444014820 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.914+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c1e3880 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.914+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c1e3060 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.915+0000 7fd433fff640 1 -- 172.21.15.1:0/204964726 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd444014980 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.915+0000 7fd433fff640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd43806adb0 0x7fd43806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.915+0000 7fd44b7fe640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd43806adb0 0x7fd43806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.915+0000 7fd433fff640 1 -- 172.21.15.1:0/204964726 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fd444089140 con 0x7fd44c0cfbd0 2023-12-02T01:29:30.920 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.916+0000 7fd44b7fe640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd43806adb0 0x7fd43806d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd43c000f60 tx=0x7fd43c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:30.921 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:30.920+0000 7fd433fff640 1 -- 172.21.15.1:0/204964726 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd44c1e3060 con 0x7fd44c0cfbd0 2023-12-02T01:29:31.098 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.096+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd44c1e3060 con 0x7fd44c0cfbd0 2023-12-02T01:29:31.098 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.097+0000 7fd433fff640 1 -- 172.21.15.1:0/204964726 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd44c1e3060 con 0x7fd44c0cfbd0 2023-12-02T01:29:31.098 INFO:teuthology.misc.health.smithi001.stdout: 2023-12-02T01:29:31.099 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":12,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:28.640248+0000","last_up_change":"0.000000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:31.100 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd43806adb0 msgr2=0x7fd43806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd43806adb0 0x7fd43806d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd43c000f60 tx=0x7fd43c009040 comp rx=0 tx=0).stop 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0cfbd0 msgr2=0x7fd44c1e8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0cfbd0 0x7fd44c1e8c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd44400efc0 tx=0x7fd44400c490 comp rx=0 tx=0).stop 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 shutdown_connections 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c0cfbd0 0x7fd44c1e8c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd43806adb0 0x7fd43806d270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd44c0ced00 0x7fd44c1e3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 --2- 172.21.15.1:0/204964726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44c0ce870 0x7fd44c14c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 >> 172.21.15.1:0/204964726 conn(0x7fd44c09c490 msgr2=0x7fd44c0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 shutdown_connections 2023-12-02T01:29:31.101 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:31.099+0000 7fd451f97640 1 -- 172.21.15.1:0/204964726 wait complete. 2023-12-02T01:29:31.110 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-02T01:29:37.915 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:38.018 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.017+0000 7ff9fd2da640 1 Processor -- start 2023-12-02T01:29:38.019 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.017+0000 7ff9fd2da640 1 -- start start 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9fd2da640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff9f80d17a0 0x7ff9f80d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9fd2da640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff9f815d670 0x7ff9f80d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9fd2da640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f80ce090 con 0x7ff9f80d12d0 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9fd2da640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80cea30 con 0x7ff9f815d670 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9fd2da640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80ce370 con 0x7ff9f80d17a0 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f67fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff9f815d670 0x7ff9f80d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f77fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff9f80d12d0 0x7ff9f80c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47980/0 (socket says 172.21.15.1:47980) 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f77fe640 1 -- 172.21.15.1:0/1656751931 learned_addr learned my addr 172.21.15.1:0/1656751931 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f6ffd640 1 --2- 172.21.15.1:0/1656751931 >> v2:172.21.15.167:3300/0 conn(0x7ff9f80d17a0 0x7ff9f80d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.020 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f67fc640 1 -- 172.21.15.1:0/1656751931 >> v2:172.21.15.167:3300/0 conn(0x7ff9f80d17a0 msgr2=0x7ff9f80d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:38.021 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f67fc640 1 --2- 172.21.15.1:0/1656751931 >> v2:172.21.15.167:3300/0 conn(0x7ff9f80d17a0 0x7ff9f80d1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.021 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f67fc640 1 -- 172.21.15.1:0/1656751931 >> v1:172.21.15.1:6789/0 conn(0x7ff9f80d12d0 legacy=0x7ff9f80c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.021 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f67fc640 1 -- 172.21.15.1:0/1656751931 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80ce650 con 0x7ff9f815d670 2023-12-02T01:29:38.021 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.018+0000 7ff9f5ffb640 1 -- 172.21.15.1:0/1656751931 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175246070 0 0) 0x7ff9f80ce090 con 0x7ff9f80d12d0 2023-12-02T01:29:38.022 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.019+0000 7ff9f67fc640 1 --2- 172.21.15.1:0/1656751931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f815d670 0x7ff9f80d0d90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80d0cc0 tx=0x7ff9ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b817d68769c80a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.022 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.019+0000 7ff9f5ffb640 1 -- 172.21.15.1:0/1656751931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec031830 con 0x7ff9f815d670 2023-12-02T01:29:38.022 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.019+0000 7ff9f5ffb640 1 -- 172.21.15.1:0/1656751931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec031990 con 0x7ff9f815d670 2023-12-02T01:29:38.022 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.019+0000 7ff9f5ffb640 1 -- 172.21.15.1:0/1656751931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec031d20 con 0x7ff9f815d670 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 -- 172.21.15.1:0/1656751931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f815d670 msgr2=0x7ff9f80d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/1656751931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f815d670 0x7ff9f80d0d90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80d0cc0 tx=0x7ff9ec02b8d0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 -- 172.21.15.1:0/1656751931 shutdown_connections 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/1656751931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f815d670 0x7ff9f80d0d90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/1656751931 >> v2:172.21.15.167:3300/0 conn(0x7ff9f80d17a0 0x7ff9f80d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 -- 172.21.15.1:0/1656751931 >> 172.21.15.1:0/1656751931 conn(0x7ff9f809c490 msgr2=0x7ff9f80d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 -- 172.21.15.1:0/1656751931 shutdown_connections 2023-12-02T01:29:38.023 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.020+0000 7ff9fd2da640 1 -- 172.21.15.1:0/1656751931 wait complete. 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.021+0000 7ff9fd2da640 1 Processor -- start 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9fd2da640 1 -- start start 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9fd2da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f80d12d0 0x7ff9f80cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9fd2da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f80d17a0 0x7ff9f81505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9fd2da640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f815d670 0x7ff9f81f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9fd2da640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80b6e40 con 0x7ff9f80d17a0 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9fd2da640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80cd600 con 0x7ff9f80d12d0 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9fd2da640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80b6b60 con 0x7ff9f815d670 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9f67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f80d17a0 0x7ff9f81505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9f67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f80d17a0 0x7ff9f81505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40372/0 (socket says 172.21.15.1:40372) 2023-12-02T01:29:38.027 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.022+0000 7ff9f67fc640 1 -- 172.21.15.1:0/615079318 learned_addr learned my addr 172.21.15.1:0/615079318 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f77fe640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f815d670 0x7ff9f81f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f6ffd640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f80d12d0 0x7ff9f80cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f67fc640 1 -- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f815d670 msgr2=0x7ff9f81f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f67fc640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f815d670 0x7ff9f81f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f67fc640 1 -- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f80d12d0 msgr2=0x7ff9f80cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f67fc640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f80d12d0 0x7ff9f80cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f67fc640 1 -- 172.21.15.1:0/615079318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec009400 con 0x7ff9f80d17a0 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9f67fc640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f80d17a0 0x7ff9f81505a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009890 tx=0x7ff9ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.028 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9df7fe640 1 -- 172.21.15.1:0/615079318 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec03ba70 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9df7fe640 1 -- 172.21.15.1:0/615079318 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec03bbf0 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f80b77d0 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9df7fe640 1 -- 172.21.15.1:0/615079318 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec045400 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.023+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f80b7d90 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.024+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80b7630 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.024+0000 7ff9df7fe640 1 -- 172.21.15.1:0/615079318 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9ec04e440 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.025+0000 7ff9df7fe640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff9e406ae40 0x7ff9e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.025+0000 7ff9df7fe640 1 -- 172.21.15.1:0/615079318 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff9ec0ab570 con 0x7ff9f80d17a0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.025+0000 7ff9f6ffd640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff9e406ae40 0x7ff9e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.029 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.025+0000 7ff9f6ffd640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff9e406ae40 0x7ff9e406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8006fd0 tx=0x7ff9e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.031 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.029+0000 7ff9df7fe640 1 -- 172.21.15.1:0/615079318 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9f80b7630 con 0x7ff9f80d17a0 2023-12-02T01:29:38.210 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.209+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9f80b7630 con 0x7ff9f80d17a0 2023-12-02T01:29:38.211 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.210+0000 7ff9df7fe640 1 -- 172.21.15.1:0/615079318 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7ff9f80b7630 con 0x7ff9f80d17a0 2023-12-02T01:29:38.211 INFO:teuthology.misc.health.smithi001.stdout: 2023-12-02T01:29:38.211 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":16,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:34.730980+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:38.213 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.211+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff9e406ae40 msgr2=0x7ff9e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.213 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.211+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff9e406ae40 0x7ff9e406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8006fd0 tx=0x7ff9e8008040 comp rx=0 tx=0).stop 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f80d17a0 msgr2=0x7ff9f81505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f80d17a0 0x7ff9f81505a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009890 tx=0x7ff9ec0046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 shutdown_connections 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f815d670 0x7ff9f81f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9f80d17a0 0x7ff9f81505a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff9e406ae40 0x7ff9e406d300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 --2- 172.21.15.1:0/615079318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f80d12d0 0x7ff9f80cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 >> 172.21.15.1:0/615079318 conn(0x7ff9f809c490 msgr2=0x7ff9f80c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 shutdown_connections 2023-12-02T01:29:38.214 INFO:teuthology.misc.health.smithi001.stderr:2023-12-02T01:29:38.212+0000 7ff9fd2da640 1 -- 172.21.15.1:0/615079318 wait complete. 2023-12-02T01:29:38.223 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-02T01:29:38.223 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-02T01:29:38.223 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-02T01:29:38.224 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-02T01:29:38.226 INFO:tasks.ceph.mds.a:Started 2023-12-02T01:29:38.227 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-02T01:29:38.227 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-02T01:29:38.229 INFO:tasks.ceph.mds.c:Started 2023-12-02T01:29:38.230 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-02T01:29:38.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-02T01:29:38.233 INFO:tasks.ceph.mds.b:Started 2023-12-02T01:29:38.234 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-02T01:29:38.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-02T01:29:38.236 INFO:tasks.ceph.mds.d:Started 2023-12-02T01:29:38.236 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-02T01:29:38.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:38.307 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-12-02T01:29:38.308 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-12-02T01:29:38.320 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-12-02T01:29:38.322 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2023-12-02T01:29:38.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.348+0000 7f1f84e07640 1 Processor -- start 2023-12-02T01:29:38.350 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.348+0000 7f1f84e07640 1 -- start start 2023-12-02T01:29:38.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f84e07640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f8015e1c0 0x7f1f800b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f84e07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b3fa0 0x7f1f800d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f84e07640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f8015e5a0 0x7f1f800d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.351 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f84e07640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8015dd50 con 0x7f1f8015e1c0 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f84e07640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f80161e60 con 0x7f1f8015e5a0 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f84e07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b2fc0 con 0x7f1f800b3fa0 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f7e59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f8015e1c0 0x7f1f800b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.349+0000 7f1f7e59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f8015e1c0 0x7f1f800b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40392/0 (socket says 172.21.15.1:40392) 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7e59c640 1 -- 172.21.15.1:0/3667660912 learned_addr learned my addr 172.21.15.1:0/3667660912 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7dd9b640 1 --2- 172.21.15.1:0/3667660912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b3fa0 0x7f1f800d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7ed9d640 1 --2- 172.21.15.1:0/3667660912 >> v2:172.21.15.167:3300/0 conn(0x7f1f8015e5a0 0x7f1f800d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7e59c640 1 -- 172.21.15.1:0/3667660912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b3fa0 msgr2=0x7f1f800d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7e59c640 1 --2- 172.21.15.1:0/3667660912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b3fa0 0x7f1f800d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7e59c640 1 -- 172.21.15.1:0/3667660912 >> v2:172.21.15.167:3300/0 conn(0x7f1f8015e5a0 msgr2=0x7f1f800d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7e59c640 1 --2- 172.21.15.1:0/3667660912 >> v2:172.21.15.167:3300/0 conn(0x7f1f8015e5a0 0x7f1f800d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.352 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.350+0000 7f1f7e59c640 1 -- 172.21.15.1:0/3667660912 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80161b80 con 0x7f1f8015e1c0 2023-12-02T01:29:38.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f7e59c640 1 --2- 172.21.15.1:0/3667660912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800b3a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f800b2c20 tx=0x7f1f6802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135e04ba359922ee server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f7d59a640 1 -- 172.21.15.1:0/3667660912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f680317e0 con 0x7f1f8015e1c0 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f7d59a640 1 -- 172.21.15.1:0/3667660912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f68031940 con 0x7f1f8015e1c0 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f7d59a640 1 -- 172.21.15.1:0/3667660912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f68031cd0 con 0x7f1f8015e1c0 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 -- 172.21.15.1:0/3667660912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 msgr2=0x7f1f800b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 --2- 172.21.15.1:0/3667660912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800b3a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f800b2c20 tx=0x7f1f6802b880 comp rx=0 tx=0).stop 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 -- 172.21.15.1:0/3667660912 shutdown_connections 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 --2- 172.21.15.1:0/3667660912 >> v2:172.21.15.167:3300/0 conn(0x7f1f8015e5a0 0x7f1f800d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 --2- 172.21.15.1:0/3667660912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800b3fa0 0x7f1f800d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 --2- 172.21.15.1:0/3667660912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800b3a60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 -- 172.21.15.1:0/3667660912 >> 172.21.15.1:0/3667660912 conn(0x7f1f8008cbc0 msgr2=0x7f1f8009c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 -- 172.21.15.1:0/3667660912 shutdown_connections 2023-12-02T01:29:38.354 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.351+0000 7f1f84e07640 1 -- 172.21.15.1:0/3667660912 wait complete. 2023-12-02T01:29:38.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 Processor -- start 2023-12-02T01:29:38.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 -- start start 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015e5a0 0x7f1f800cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800cfd80 0x7f1f800c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800d0230 con 0x7f1f8015e1c0 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800cad60 con 0x7f1f8015e5a0 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f84e07640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c7c70 con 0x7f1f800cfd80 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.353+0000 7f1f7e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40396/0 (socket says 172.21.15.1:40396) 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015e5a0 0x7f1f800cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7ed9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800cfd80 0x7f1f800c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7e59c640 1 -- 172.21.15.1:0/1770927014 learned_addr learned my addr 172.21.15.1:0/1770927014 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7ed9d640 1 -- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015e5a0 msgr2=0x7f1f800cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.359 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7ed9d640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015e5a0 0x7f1f800cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7ed9d640 1 -- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 msgr2=0x7f1f800c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7ed9d640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7ed9d640 1 -- 172.21.15.1:0/1770927014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680094d0 con 0x7f1f800cfd80 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7e59c640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7dd9b640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015e5a0 0x7f1f800cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f7ed9d640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800cfd80 0x7f1f800c6f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800eba0 tx=0x7f1f7800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f76ffd640 1 -- 172.21.15.1:0/1770927014 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800cd20 con 0x7f1f800cfd80 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f76ffd640 1 -- 172.21.15.1:0/1770927014 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7800f040 con 0x7f1f800cfd80 2023-12-02T01:29:38.360 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800c7f50 con 0x7f1f800cfd80 2023-12-02T01:29:38.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f76ffd640 1 -- 172.21.15.1:0/1770927014 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780146c0 con 0x7f1f800cfd80 2023-12-02T01:29:38.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.354+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f800c8510 con 0x7f1f800cfd80 2023-12-02T01:29:38.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.355+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800d2450 con 0x7f1f800cfd80 2023-12-02T01:29:38.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.356+0000 7f1f76ffd640 1 -- 172.21.15.1:0/1770927014 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f78014820 con 0x7f1f800cfd80 2023-12-02T01:29:38.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.356+0000 7f1f76ffd640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1f6006ae40 0x7f1f6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.356+0000 7f1f76ffd640 1 -- 172.21.15.1:0/1770927014 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f78089e10 con 0x7f1f800cfd80 2023-12-02T01:29:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.356+0000 7f1f7e59c640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1f6006ae40 0x7f1f6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.357+0000 7f1f7e59c640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1f6006ae40 0x7f1f6006d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f68034040 tx=0x7f1f6803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.362+0000 7f1f76ffd640 1 -- 172.21.15.1:0/1770927014 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f78055350 con 0x7f1f800cfd80 2023-12-02T01:29:38.539 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.538+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f800caea0 con 0x7f1f800cfd80 2023-12-02T01:29:38.540 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.540+0000 7f1f76ffd640 1 -- 172.21.15.1:0/1770927014 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f1f78018090 con 0x7f1f800cfd80 2023-12-02T01:29:38.541 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:38.541 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":16,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:34.730980+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1f6006ae40 msgr2=0x7f1f6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1f6006ae40 0x7f1f6006d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f68034040 tx=0x7f1f6803d040 comp rx=0 tx=0).stop 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800cfd80 msgr2=0x7f1f800c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800cfd80 0x7f1f800c6f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800eba0 tx=0x7f1f7800c490 comp rx=0 tx=0).stop 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 shutdown_connections 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f800cfd80 0x7f1f800c6f00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1f6006ae40 0x7f1f6006d300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8015e5a0 0x7f1f800cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 --2- 172.21.15.1:0/1770927014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f8015e1c0 0x7f1f800c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 >> 172.21.15.1:0/1770927014 conn(0x7f1f8008cbc0 msgr2=0x7f1f800b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 shutdown_connections 2023-12-02T01:29:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.541+0000 7f1f84e07640 1 -- 172.21.15.1:0/1770927014 wait complete. 2023-12-02T01:29:38.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:29:38.553 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:29:38.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.661+0000 7fea2f2e1640 1 Processor -- start 2023-12-02T01:29:38.663 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.661+0000 7fea2f2e1640 1 -- start start 2023-12-02T01:29:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2f2e1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea2815d6c0 0x7fea280cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2f2e1640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280d11d0 con 0x7fea280d1980 2023-12-02T01:29:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2f2e1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280ce2b0 con 0x7fea280d1d60 2023-12-02T01:29:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2f2e1640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea280ce590 con 0x7fea2815d6c0 2023-12-02T01:29:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2c87c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea2815d6c0 0x7fea280cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2c87c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea2815d6c0 0x7fea280cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40402/0 (socket says 172.21.15.1:40402) 2023-12-02T01:29:38.664 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2d07d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fea280d1980 0x7fea2815cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:48000/0 (socket says 172.21.15.1:48000) 2023-12-02T01:29:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.662+0000 7fea2c87c640 1 -- 172.21.15.1:0/3459002042 learned_addr learned my addr 172.21.15.1:0/3459002042 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea2c87c640 1 -- 172.21.15.1:0/3459002042 >> v1:172.21.15.167:6789/0 conn(0x7fea280d1d60 legacy=0x7fea280b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea2c87c640 1 -- 172.21.15.1:0/3459002042 >> v1:172.21.15.1:6789/0 conn(0x7fea280d1980 legacy=0x7fea2815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea2c87c640 1 -- 172.21.15.1:0/3459002042 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280ce870 con 0x7fea2815d6c0 2023-12-02T01:29:38.665 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea1ffff640 1 -- 172.21.15.1:0/3459002042 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426288281 0 0) 0x7fea280d11d0 con 0x7fea280d1980 2023-12-02T01:29:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea2c87c640 1 --2- 172.21.15.1:0/3459002042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea2815d6c0 0x7fea280cdc40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea18009870 tx=0x7fea1802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f94a969f3b3f4e server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea1ffff640 1 -- 172.21.15.1:0/3459002042 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18031870 con 0x7fea2815d6c0 2023-12-02T01:29:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea1ffff640 1 -- 172.21.15.1:0/3459002042 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea180319d0 con 0x7fea2815d6c0 2023-12-02T01:29:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.663+0000 7fea1ffff640 1 -- 172.21.15.1:0/3459002042 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18031d60 con 0x7fea2815d6c0 2023-12-02T01:29:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.664+0000 7fea2f2e1640 1 -- 172.21.15.1:0/3459002042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea2815d6c0 msgr2=0x7fea280cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.664+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/3459002042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea2815d6c0 0x7fea280cdc40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea18009870 tx=0x7fea1802b910 comp rx=0 tx=0).stop 2023-12-02T01:29:38.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.664+0000 7fea2f2e1640 1 -- 172.21.15.1:0/3459002042 shutdown_connections 2023-12-02T01:29:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.664+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/3459002042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea2815d6c0 0x7fea280cdc40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.664+0000 7fea2f2e1640 1 -- 172.21.15.1:0/3459002042 >> 172.21.15.1:0/3459002042 conn(0x7fea2809c470 msgr2=0x7fea280d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.664+0000 7fea2f2e1640 1 -- 172.21.15.1:0/3459002042 shutdown_connections 2023-12-02T01:29:38.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.664+0000 7fea2f2e1640 1 -- 172.21.15.1:0/3459002042 wait complete. 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.665+0000 7fea2f2e1640 1 Processor -- start 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.665+0000 7fea2f2e1640 1 -- start start 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2f2e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea280d1980 0x7fea280ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2f2e1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280d1d60 0x7fea281e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2f2e1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2815d6c0 0x7fea2815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2f2e1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280b3770 con 0x7fea280d1d60 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2f2e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280cc6f0 con 0x7fea280d1980 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2f2e1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea280b3490 con 0x7fea2815d6c0 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280d1d60 0x7fea281e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280d1d60 0x7fea281e9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40414/0 (socket says 172.21.15.1:40414) 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 -- 172.21.15.1:0/1900643133 learned_addr learned my addr 172.21.15.1:0/1900643133 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 -- 172.21.15.1:0/1900643133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2815d6c0 msgr2=0x7fea2815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.669 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2815d6c0 0x7fea2815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 -- 172.21.15.1:0/1900643133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea280d1980 msgr2=0x7fea280ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea280d1980 0x7fea280ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.666+0000 7fea2c87c640 1 -- 172.21.15.1:0/1900643133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180094d0 con 0x7fea280d1d60 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.667+0000 7fea2c87c640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280d1d60 0x7fea281e9760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea18009870 tx=0x7fea180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.667+0000 7fea1dffb640 1 -- 172.21.15.1:0/1900643133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18004230 con 0x7fea280d1d60 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.667+0000 7fea1dffb640 1 -- 172.21.15.1:0/1900643133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea180043b0 con 0x7fea280d1d60 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.667+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea280cc0a0 con 0x7fea280d1d60 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.667+0000 7fea1dffb640 1 -- 172.21.15.1:0/1900643133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18004520 con 0x7fea280d1d60 2023-12-02T01:29:38.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.667+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea280b27b0 con 0x7fea280d1d60 2023-12-02T01:29:38.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.668+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea280cbf00 con 0x7fea280d1d60 2023-12-02T01:29:38.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.668+0000 7fea1dffb640 1 -- 172.21.15.1:0/1900643133 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea18042070 con 0x7fea280d1d60 2023-12-02T01:29:38.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.669+0000 7fea1dffb640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fea0c06ae40 0x7fea0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.669+0000 7fea1dffb640 1 -- 172.21.15.1:0/1900643133 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea1802d040 con 0x7fea280d1d60 2023-12-02T01:29:38.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.669+0000 7fea2d07d640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fea0c06ae40 0x7fea0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.669+0000 7fea2d07d640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fea0c06ae40 0x7fea0c06d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea20007fd0 tx=0x7fea20007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.673+0000 7fea1dffb640 1 -- 172.21.15.1:0/1900643133 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea280cbf00 con 0x7fea280d1d60 2023-12-02T01:29:38.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.847+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea280cbf00 con 0x7fea280d1d60 2023-12-02T01:29:38.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.848+0000 7fea1dffb640 1 -- 172.21.15.1:0/1900643133 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea280cbf00 con 0x7fea280d1d60 2023-12-02T01:29:38.850 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fea0c06ae40 msgr2=0x7fea0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fea0c06ae40 0x7fea0c06d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea20007fd0 tx=0x7fea20007920 comp rx=0 tx=0).stop 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280d1d60 msgr2=0x7fea281e9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280d1d60 0x7fea281e9760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea18009870 tx=0x7fea180046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 shutdown_connections 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea2815d6c0 0x7fea2815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280d1d60 0x7fea281e9760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fea0c06ae40 0x7fea0c06d300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 --2- 172.21.15.1:0/1900643133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea280d1980 0x7fea280ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 >> 172.21.15.1:0/1900643133 conn(0x7fea2809c470 msgr2=0x7fea2815fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:38.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 shutdown_connections 2023-12-02T01:29:38.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.850+0000 7fea2f2e1640 1 -- 172.21.15.1:0/1900643133 wait complete. 2023-12-02T01:29:38.862 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:29:38.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.966+0000 7fad9ef00640 1 Processor -- start 2023-12-02T01:29:38.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.966+0000 7fad9ef00640 1 -- start start 2023-12-02T01:29:38.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad9ef00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad9806a4d0 0x7fad980cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad9ef00640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fad98071d40 0x7fad9806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad9ef00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806ef90 0x7fad9815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad9ef00640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980cc720 con 0x7fad98071d40 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad9ef00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9815b780 con 0x7fad9806a4d0 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad9ef00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980721d0 con 0x7fad9806ef90 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad97fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fad98071d40 0x7fad9806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad97fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fad98071d40 0x7fad9806a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40428/0 (socket says 172.21.15.1:40428) 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.967+0000 7fad97fff640 1 -- 172.21.15.1:0/1067839699 learned_addr learned my addr 172.21.15.1:0/1067839699 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad9cc9c640 1 --2- 172.21.15.1:0/1067839699 >> v2:172.21.15.167:3300/0 conn(0x7fad9806a4d0 0x7fad980cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad9d49d640 1 --2- 172.21.15.1:0/1067839699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806ef90 0x7fad9815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad97fff640 1 -- 172.21.15.1:0/1067839699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806ef90 msgr2=0x7fad9815ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad97fff640 1 --2- 172.21.15.1:0/1067839699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806ef90 0x7fad9815ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad97fff640 1 -- 172.21.15.1:0/1067839699 >> v2:172.21.15.167:3300/0 conn(0x7fad9806a4d0 msgr2=0x7fad980cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad97fff640 1 --2- 172.21.15.1:0/1067839699 >> v2:172.21.15.167:3300/0 conn(0x7fad9806a4d0 0x7fad980cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad97fff640 1 -- 172.21.15.1:0/1067839699 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9806ebf0 con 0x7fad98071d40 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.968+0000 7fad97fff640 1 --2- 172.21.15.1:0/1067839699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad98071d40 0x7fad9806a8b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad98068080 tx=0x7fad8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d43175f8a81564 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad977fe640 1 -- 172.21.15.1:0/1067839699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c031870 con 0x7fad98071d40 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad977fe640 1 -- 172.21.15.1:0/1067839699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c0319d0 con 0x7fad98071d40 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad977fe640 1 -- 172.21.15.1:0/1067839699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c031d60 con 0x7fad98071d40 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 -- 172.21.15.1:0/1067839699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad98071d40 msgr2=0x7fad9806a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 --2- 172.21.15.1:0/1067839699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad98071d40 0x7fad9806a8b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad98068080 tx=0x7fad8c02b910 comp rx=0 tx=0).stop 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 -- 172.21.15.1:0/1067839699 shutdown_connections 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 --2- 172.21.15.1:0/1067839699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806ef90 0x7fad9815ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 --2- 172.21.15.1:0/1067839699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad98071d40 0x7fad9806a8b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 --2- 172.21.15.1:0/1067839699 >> v2:172.21.15.167:3300/0 conn(0x7fad9806a4d0 0x7fad980cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 -- 172.21.15.1:0/1067839699 >> 172.21.15.1:0/1067839699 conn(0x7fad980cfe80 msgr2=0x7fad980d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:38.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 -- 172.21.15.1:0/1067839699 shutdown_connections 2023-12-02T01:29:38.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.969+0000 7fad9ef00640 1 -- 172.21.15.1:0/1067839699 wait complete. 2023-12-02T01:29:38.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.970+0000 7fad9ef00640 1 Processor -- start 2023-12-02T01:29:38.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.970+0000 7fad9ef00640 1 -- start start 2023-12-02T01:29:38.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad9ef00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806a4d0 0x7fad980c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad9ef00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9806ef90 0x7fad98154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad9ef00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad980b2a80 0x7fad98159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad9ef00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad98154cc0 con 0x7fad9806ef90 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad9ef00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980b3430 con 0x7fad980b2a80 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad9ef00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980b36d0 con 0x7fad9806a4d0 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad97fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9806ef90 0x7fad98154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad97fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9806ef90 0x7fad98154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40444/0 (socket says 172.21.15.1:40444) 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.971+0000 7fad97fff640 1 -- 172.21.15.1:0/128713694 learned_addr learned my addr 172.21.15.1:0/128713694 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad9d49d640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad980b2a80 0x7fad98159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad9cc9c640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806a4d0 0x7fad980c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad97fff640 1 -- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806a4d0 msgr2=0x7fad980c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad97fff640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806a4d0 0x7fad980c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad97fff640 1 -- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad980b2a80 msgr2=0x7fad98159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad97fff640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad980b2a80 0x7fad98159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad97fff640 1 -- 172.21.15.1:0/128713694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0094d0 con 0x7fad9806ef90 2023-12-02T01:29:38.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad97fff640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9806ef90 0x7fad98154780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02b950 tx=0x7fad8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad957fa640 1 -- 172.21.15.1:0/128713694 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c03bcc0 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad957fa640 1 -- 172.21.15.1:0/128713694 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c03be40 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad981596b0 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad957fa640 1 -- 172.21.15.1:0/128713694 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c045630 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.972+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980b39b0 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.973+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad98159bd0 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.974+0000 7fad957fa640 1 -- 172.21.15.1:0/128713694 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad8c04e450 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.974+0000 7fad957fa640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fad8406ae40 0x7fad8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.974+0000 7fad957fa640 1 -- 172.21.15.1:0/128713694 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad8c02d040 con 0x7fad9806ef90 2023-12-02T01:29:38.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.974+0000 7fad9cc9c640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fad8406ae40 0x7fad8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:38.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.974+0000 7fad9cc9c640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fad8406ae40 0x7fad8406d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad980b5d80 tx=0x7fad90003a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:38.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:38.978+0000 7fad957fa640 1 -- 172.21.15.1:0/128713694 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad98159bd0 con 0x7fad9806ef90 2023-12-02T01:29:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.190+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad98159bd0 con 0x7fad9806ef90 2023-12-02T01:29:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.191+0000 7fad957fa640 1 -- 172.21.15.1:0/128713694 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7fad8c035540 con 0x7fad9806ef90 2023-12-02T01:29:39.192 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:39.193 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-02T01:29:39.193 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fad8406ae40 msgr2=0x7fad8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fad8406ae40 0x7fad8406d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad980b5d80 tx=0x7fad90003a50 comp rx=0 tx=0).stop 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9806ef90 msgr2=0x7fad98154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9806ef90 0x7fad98154780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02b950 tx=0x7fad8c0046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 shutdown_connections 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fad8406ae40 0x7fad8406d300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad980b2a80 0x7fad98159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9806ef90 0x7fad98154780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 --2- 172.21.15.1:0/128713694 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad9806a4d0 0x7fad980c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 >> 172.21.15.1:0/128713694 conn(0x7fad980cfe80 msgr2=0x7fad980ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 shutdown_connections 2023-12-02T01:29:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:39.193+0000 7fad9ef00640 1 -- 172.21.15.1:0/128713694 wait complete. 2023-12-02T01:29:41.205 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:29:41.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.322+0000 7f6eb187c640 1 Processor -- start 2023-12-02T01:29:41.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.322+0000 7f6eb187c640 1 -- start start 2023-12-02T01:29:41.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.323+0000 7f6eb187c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6eac15e5a0 0x7f6eac0d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.323+0000 7f6eb187c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6eac0d1320 0x7f6eac0d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.323+0000 7f6eb187c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac161e60 con 0x7f6eac15e1c0 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.323+0000 7f6eb187c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac15dd50 con 0x7f6eac0d1320 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.323+0000 7f6eb187c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0b2fc0 con 0x7f6eac15e5a0 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.323+0000 7f6eab7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6eac0d1320 0x7f6eac0d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.323+0000 7f6eab7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6eac0d1320 0x7f6eac0d2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40458/0 (socket says 172.21.15.1:40458) 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.324+0000 7f6eab7fe640 1 -- 172.21.15.1:0/292694459 learned_addr learned my addr 172.21.15.1:0/292694459 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.324+0000 7f6ea3fff640 1 --2- 172.21.15.1:0/292694459 >> v2:172.21.15.167:3300/0 conn(0x7f6eac15e5a0 0x7f6eac0d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.324+0000 7f6eab7fe640 1 -- 172.21.15.1:0/292694459 >> v2:172.21.15.167:3300/0 conn(0x7f6eac15e5a0 msgr2=0x7f6eac0d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.324+0000 7f6eab7fe640 1 --2- 172.21.15.1:0/292694459 >> v2:172.21.15.167:3300/0 conn(0x7f6eac15e5a0 0x7f6eac0d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.324+0000 7f6eab7fe640 1 -- 172.21.15.1:0/292694459 >> v1:172.21.15.167:6789/0 conn(0x7f6eac15e1c0 legacy=0x7f6eac0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:41.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.324+0000 7f6eab7fe640 1 -- 172.21.15.1:0/292694459 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0b4170 con 0x7f6eac0d1320 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eab7fe640 1 --2- 172.21.15.1:0/292694459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac0d1320 0x7f6eac0d2f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0d0d20 tx=0x7f6ea402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60aa2388815eca5b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eaa7fc640 1 -- 172.21.15.1:0/292694459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea402ca80 con 0x7f6eac0d1320 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eaa7fc640 1 -- 172.21.15.1:0/292694459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea402cbe0 con 0x7f6eac0d1320 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eaa7fc640 1 -- 172.21.15.1:0/292694459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40343f0 con 0x7f6eac0d1320 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 -- 172.21.15.1:0/292694459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac0d1320 msgr2=0x7f6eac0d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 --2- 172.21.15.1:0/292694459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac0d1320 0x7f6eac0d2f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0d0d20 tx=0x7f6ea402bee0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 -- 172.21.15.1:0/292694459 shutdown_connections 2023-12-02T01:29:41.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 --2- 172.21.15.1:0/292694459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac0d1320 0x7f6eac0d2f60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 --2- 172.21.15.1:0/292694459 >> v2:172.21.15.167:3300/0 conn(0x7f6eac15e5a0 0x7f6eac0d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 -- 172.21.15.1:0/292694459 >> 172.21.15.1:0/292694459 conn(0x7f6eac08cbc0 msgr2=0x7f6eac09c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:41.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 -- 172.21.15.1:0/292694459 shutdown_connections 2023-12-02T01:29:41.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.325+0000 7f6eb187c640 1 -- 172.21.15.1:0/292694459 wait complete. 2023-12-02T01:29:41.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 Processor -- start 2023-12-02T01:29:41.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 -- start start 2023-12-02T01:29:41.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eac0d1320 0x7f6eac0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac15e1c0 0x7f6eac0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eac15e5a0 0x7f6eac150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c8ff0 con 0x7f6eac15e1c0 2023-12-02T01:29:41.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac150bc0 con 0x7f6eac15e5a0 2023-12-02T01:29:41.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6eb187c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c8370 con 0x7f6eac0d1320 2023-12-02T01:29:41.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6ea3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac15e1c0 0x7f6eac0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.327+0000 7f6ea3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac15e1c0 0x7f6eac0cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40460/0 (socket says 172.21.15.1:40460) 2023-12-02T01:29:41.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea3fff640 1 -- 172.21.15.1:0/3095259926 learned_addr learned my addr 172.21.15.1:0/3095259926 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:41.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6eab7fe640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eac15e5a0 0x7f6eac150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6eaaffd640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eac0d1320 0x7f6eac0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea3fff640 1 -- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eac0d1320 msgr2=0x7f6eac0c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea3fff640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eac0d1320 0x7f6eac0c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea3fff640 1 -- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eac15e5a0 msgr2=0x7f6eac150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea3fff640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eac15e5a0 0x7f6eac150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea3fff640 1 -- 172.21.15.1:0/3095259926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009b30 con 0x7f6eac15e1c0 2023-12-02T01:29:41.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6eab7fe640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eac15e5a0 0x7f6eac150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:41.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea3fff640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac15e1c0 0x7f6eac0cb470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400d5f0 tx=0x7f6e9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea8ff9640 1 -- 172.21.15.1:0/3095259926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940125f0 con 0x7f6eac15e1c0 2023-12-02T01:29:41.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea8ff9640 1 -- 172.21.15.1:0/3095259926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e94012750 con 0x7f6eac15e1c0 2023-12-02T01:29:41.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac0c8650 con 0x7f6eac15e1c0 2023-12-02T01:29:41.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6ea8ff9640 1 -- 172.21.15.1:0/3095259926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94012b00 con 0x7f6eac15e1c0 2023-12-02T01:29:41.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.328+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac0c8c10 con 0x7f6eac15e1c0 2023-12-02T01:29:41.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.329+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac068470 con 0x7f6eac15e1c0 2023-12-02T01:29:41.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.330+0000 7f6ea8ff9640 1 -- 172.21.15.1:0/3095259926 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e94012c60 con 0x7f6eac15e1c0 2023-12-02T01:29:41.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.330+0000 7f6ea8ff9640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6e8c06ae40 0x7f6e8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.330+0000 7f6ea8ff9640 1 -- 172.21.15.1:0/3095259926 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e940896d0 con 0x7f6eac15e1c0 2023-12-02T01:29:41.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.330+0000 7f6eaaffd640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6e8c06ae40 0x7f6e8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.331+0000 7f6eaaffd640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6e8c06ae40 0x7f6e8c06d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c000f60 tx=0x7f6e9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.335+0000 7f6ea8ff9640 1 -- 172.21.15.1:0/3095259926 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e94054b60 con 0x7f6eac15e1c0 2023-12-02T01:29:41.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.550+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eac0b2c70 con 0x7f6eac15e1c0 2023-12-02T01:29:41.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.550+0000 7f6ea8ff9640 1 -- 172.21.15.1:0/3095259926 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f6e94058180 con 0x7f6eac15e1c0 2023-12-02T01:29:41.553 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:41.553 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-02T01:29:41.553 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 3 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6e8c06ae40 msgr2=0x7f6e8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6e8c06ae40 0x7f6e8c06d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c000f60 tx=0x7f6e9c009040 comp rx=0 tx=0).stop 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac15e1c0 msgr2=0x7f6eac0cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac15e1c0 0x7f6eac0cb470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400d5f0 tx=0x7f6e9400dab0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 shutdown_connections 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6e8c06ae40 0x7f6e8c06d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eac15e5a0 0x7f6eac150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6eac15e1c0 0x7f6eac0cb470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 --2- 172.21.15.1:0/3095259926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eac0d1320 0x7f6eac0c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 >> 172.21.15.1:0/3095259926 conn(0x7f6eac08cbc0 msgr2=0x7f6eac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:41.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 shutdown_connections 2023-12-02T01:29:41.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.552+0000 7f6eb187c640 1 -- 172.21.15.1:0/3095259926 wait complete. 2023-12-02T01:29:41.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.669+0000 7fbca3f39640 1 Processor -- start 2023-12-02T01:29:41.672 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.670+0000 7fbca3f39640 1 -- start start 2023-12-02T01:29:41.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.670+0000 7fbca3f39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c0ceef0 0x7fbc9c071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.670+0000 7fbca3f39640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c0cc3f0 con 0x7fbc9c15a100 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.670+0000 7fbca3f39640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c0cb7e0 con 0x7fbc9c071870 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.670+0000 7fbca3f39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c071d00 con 0x7fbc9c0ceef0 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.670+0000 7fbca1cd5640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbc9c15a100 0x7fbc9c0cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44958/0 (socket says 172.21.15.1:44958) 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca1cd5640 1 -- 172.21.15.1:0/2548582651 learned_addr learned my addr 172.21.15.1:0/2548582651 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca14d4640 1 --2- 172.21.15.1:0/2548582651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c0ceef0 0x7fbc9c071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844065879 0 0) 0x7fbc9c0cc3f0 con 0x7fbc9c15a100 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc84005730 con 0x7fbc9c15a100 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126993914 0 0) 0x7fbc9c0cb7e0 con 0x7fbc9c071870 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc9c0cc3f0 con 0x7fbc9c071870 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3349266726 0 0) 0x7fbc84005730 con 0x7fbc9c15a100 2023-12-02T01:29:41.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca14d4640 1 -- 172.21.15.1:0/2548582651 >> v1:172.21.15.167:6789/0 conn(0x7fbc9c071870 legacy=0x7fbc9c06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca14d4640 1 -- 172.21.15.1:0/2548582651 >> v1:172.21.15.1:6789/0 conn(0x7fbc9c15a100 legacy=0x7fbc9c0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.671+0000 7fbca14d4640 1 -- 172.21.15.1:0/2548582651 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c0cbac0 con 0x7fbc9c0ceef0 2023-12-02T01:29:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.672+0000 7fbca14d4640 1 --2- 172.21.15.1:0/2548582651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c0ceef0 0x7fbc9c071330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009800 tx=0x7fbc9002b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dcf15b715fa945e server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.672+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94001670 con 0x7fbc9c0ceef0 2023-12-02T01:29:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.672+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9002e050 con 0x7fbc9c0ceef0 2023-12-02T01:29:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.672+0000 7fbca0cd3640 1 -- 172.21.15.1:0/2548582651 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90030710 con 0x7fbc9c0ceef0 2023-12-02T01:29:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.672+0000 7fbca3f39640 1 -- 172.21.15.1:0/2548582651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c0ceef0 msgr2=0x7fbc9c071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.673+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2548582651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c0ceef0 0x7fbc9c071330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009800 tx=0x7fbc9002b760 comp rx=0 tx=0).stop 2023-12-02T01:29:41.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.673+0000 7fbca3f39640 1 -- 172.21.15.1:0/2548582651 shutdown_connections 2023-12-02T01:29:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.673+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2548582651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c0ceef0 0x7fbc9c071330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.673+0000 7fbca3f39640 1 -- 172.21.15.1:0/2548582651 >> 172.21.15.1:0/2548582651 conn(0x7fbc9c0cfe80 msgr2=0x7fbc9c0d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.673+0000 7fbca3f39640 1 -- 172.21.15.1:0/2548582651 shutdown_connections 2023-12-02T01:29:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.673+0000 7fbca3f39640 1 -- 172.21.15.1:0/2548582651 wait complete. 2023-12-02T01:29:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.674+0000 7fbca3f39640 1 Processor -- start 2023-12-02T01:29:41.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.674+0000 7fbca3f39640 1 -- start start 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca3f39640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c071870 0x7fbc9c0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca3f39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc9c0ceef0 0x7fbc9c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca3f39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c15a100 0x7fbc9c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca3f39640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c15b400 con 0x7fbc9c15a100 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca3f39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0c3eb0 con 0x7fbc9c0ceef0 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca3f39640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0b3be0 con 0x7fbc9c071870 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c15a100 0x7fbc9c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c15a100 0x7fbc9c1576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58126/0 (socket says 172.21.15.1:58126) 2023-12-02T01:29:41.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 -- 172.21.15.1:0/2420440920 learned_addr learned my addr 172.21.15.1:0/2420440920 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca1cd5640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c071870 0x7fbc9c0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca14d4640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc9c0ceef0 0x7fbc9c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 -- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c071870 msgr2=0x7fbc9c0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c071870 0x7fbc9c0c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 -- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc9c0ceef0 msgr2=0x7fbc9c15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc9c0ceef0 0x7fbc9c15cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 -- 172.21.15.1:0/2420440920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90009400 con 0x7fbc9c15a100 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca24d6640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c15a100 0x7fbc9c1576d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c7c0 tx=0x7fbc8c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbc9a7fc640 1 -- 172.21.15.1:0/2420440920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c003b70 con 0x7fbc9c15a100 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbc9a7fc640 1 -- 172.21.15.1:0/2420440920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c003cd0 con 0x7fbc9c15a100 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c0b3ec0 con 0x7fbc9c15a100 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.675+0000 7fbc9a7fc640 1 -- 172.21.15.1:0/2420440920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c00aa50 con 0x7fbc9c15a100 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.676+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c0b4480 con 0x7fbc9c15a100 2023-12-02T01:29:41.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.676+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c068470 con 0x7fbc9c15a100 2023-12-02T01:29:41.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.677+0000 7fbc9a7fc640 1 -- 172.21.15.1:0/2420440920 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc8c00abb0 con 0x7fbc9c15a100 2023-12-02T01:29:41.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.677+0000 7fbc9a7fc640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbc8806ae40 0x7fbc8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.677+0000 7fbc9a7fc640 1 -- 172.21.15.1:0/2420440920 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc8c089070 con 0x7fbc9c15a100 2023-12-02T01:29:41.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.677+0000 7fbca1cd5640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbc8806ae40 0x7fbc8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.678+0000 7fbca1cd5640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbc8806ae40 0x7fbc8806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc940011e0 tx=0x7fbc94001670 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.681+0000 7fbc9a7fc640 1 -- 172.21.15.1:0/2420440920 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc8c0544a0 con 0x7fbc9c15a100 2023-12-02T01:29:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.856+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc9c071e60 con 0x7fbc9c15a100 2023-12-02T01:29:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.857+0000 7fbc9a7fc640 1 -- 172.21.15.1:0/2420440920 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fbc8c00ae60 con 0x7fbc9c15a100 2023-12-02T01:29:41.860 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:41.860 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":16,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:34.730980+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbc8806ae40 msgr2=0x7fbc8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbc8806ae40 0x7fbc8806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc940011e0 tx=0x7fbc94001670 comp rx=0 tx=0).stop 2023-12-02T01:29:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c15a100 msgr2=0x7fbc9c1576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c15a100 0x7fbc9c1576d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c7c0 tx=0x7fbc8c00cc80 comp rx=0 tx=0).stop 2023-12-02T01:29:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 shutdown_connections 2023-12-02T01:29:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc9c15a100 0x7fbc9c1576d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbc8806ae40 0x7fbc8806d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc9c0ceef0 0x7fbc9c15cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 --2- 172.21.15.1:0/2420440920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc9c071870 0x7fbc9c0c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 >> 172.21.15.1:0/2420440920 conn(0x7fbc9c0cfe80 msgr2=0x7fbc9c06a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 shutdown_connections 2023-12-02T01:29:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.859+0000 7fbca3f39640 1 -- 172.21.15.1:0/2420440920 wait complete. 2023-12-02T01:29:41.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:29:41.873 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:29:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.980+0000 7f3f5227c640 1 Processor -- start 2023-12-02T01:29:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.980+0000 7f3f5227c640 1 -- start start 2023-12-02T01:29:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.980+0000 7f3f5227c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3f4c15d8d0 0x7f3f4c099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.980+0000 7f3f5227c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3f4c0cf640 0x7f3f4c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.980+0000 7f3f5227c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c0cfca0 con 0x7f3f4c099eb0 2023-12-02T01:29:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.980+0000 7f3f5227c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c09a340 con 0x7f3f4c0cf640 2023-12-02T01:29:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.980+0000 7f3f5227c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c0cfa90 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f50819640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3f4c0cf640 0x7f3f4c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f50819640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3f4c0cf640 0x7f3f4c0b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58138/0 (socket says 172.21.15.1:58138) 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f50819640 1 -- 172.21.15.1:0/1658025107 learned_addr learned my addr 172.21.15.1:0/1658025107 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f4bfff640 1 --2- 172.21.15.1:0/1658025107 >> v2:172.21.15.167:3300/0 conn(0x7f3f4c15d8d0 0x7f3f4c099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f50819640 1 -- 172.21.15.1:0/1658025107 >> v2:172.21.15.167:3300/0 conn(0x7f3f4c15d8d0 msgr2=0x7f3f4c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f50819640 1 --2- 172.21.15.1:0/1658025107 >> v2:172.21.15.167:3300/0 conn(0x7f3f4c15d8d0 0x7f3f4c099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f50819640 1 -- 172.21.15.1:0/1658025107 >> v1:172.21.15.167:6789/0 conn(0x7f3f4c099eb0 legacy=0x7f3f4c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f50819640 1 -- 172.21.15.1:0/1658025107 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0b0720 con 0x7f3f4c0cf640 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.981+0000 7f3f4bfff640 1 --2- 172.21.15.1:0/1658025107 >> v2:172.21.15.167:3300/0 conn(0x7f3f4c15d8d0 0x7f3f4c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:41.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f50819640 1 --2- 172.21.15.1:0/1658025107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b1200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c066c60 tx=0x7f3f4402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0272741746a9f50 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f4affd640 1 -- 172.21.15.1:0/1658025107 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4402cb20 con 0x7f3f4c0cf640 2023-12-02T01:29:41.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f4affd640 1 -- 172.21.15.1:0/1658025107 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4402cc80 con 0x7f3f4c0cf640 2023-12-02T01:29:41.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f4affd640 1 -- 172.21.15.1:0/1658025107 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f440343f0 con 0x7f3f4c0cf640 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f5227c640 1 -- 172.21.15.1:0/1658025107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c0cf640 msgr2=0x7f3f4c0b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f5227c640 1 --2- 172.21.15.1:0/1658025107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b1200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c066c60 tx=0x7f3f4402bf80 comp rx=0 tx=0).stop 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f5227c640 1 -- 172.21.15.1:0/1658025107 shutdown_connections 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f5227c640 1 --2- 172.21.15.1:0/1658025107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b1200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f5227c640 1 --2- 172.21.15.1:0/1658025107 >> v2:172.21.15.167:3300/0 conn(0x7f3f4c15d8d0 0x7f3f4c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f5227c640 1 -- 172.21.15.1:0/1658025107 >> 172.21.15.1:0/1658025107 conn(0x7f3f4c0b2ab0 msgr2=0x7f3f4c0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.982+0000 7f3f5227c640 1 -- 172.21.15.1:0/1658025107 shutdown_connections 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.983+0000 7f3f5227c640 1 -- 172.21.15.1:0/1658025107 wait complete. 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.984+0000 7f3f5227c640 1 Processor -- start 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.984+0000 7f3f5227c640 1 -- start start 2023-12-02T01:29:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f4c099eb0 0x7f3f4c151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c15d8d0 0x7f3f4c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c1f2c70 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0cce50 con 0x7f3f4c0cf640 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0b53d0 con 0x7f3f4c099eb0 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c15d8d0 0x7f3f4c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c15d8d0 0x7f3f4c0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58144/0 (socket says 172.21.15.1:58144) 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 -- 172.21.15.1:0/819783724 learned_addr learned my addr 172.21.15.1:0/819783724 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f4b7fe640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f4bfff640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f4c099eb0 0x7f3f4c151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 -- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f4c099eb0 msgr2=0x7f3f4c151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f4c099eb0 0x7f3f4c151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 -- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c0cf640 msgr2=0x7f3f4c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 -- 172.21.15.1:0/819783724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44009b30 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f4bfff640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f4c099eb0 0x7f3f4c151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f4b7fe640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f50819640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c15d8d0 0x7f3f4c0b4e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009f40 tx=0x7f3f44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f48ff9640 1 -- 172.21.15.1:0/819783724 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44007e70 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f48ff9640 1 -- 172.21.15.1:0/819783724 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f44009510 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c0cd2f0 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f48ff9640 1 -- 172.21.15.1:0/819783724 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4403e6b0 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.985+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c0c84a0 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.986+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c09f0b0 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.987+0000 7f3f48ff9640 1 -- 172.21.15.1:0/819783724 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f4403e810 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.987+0000 7f3f48ff9640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3f3806ae40 0x7f3f3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.987+0000 7f3f48ff9640 1 -- 172.21.15.1:0/819783724 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f440abd30 con 0x7f3f4c15d8d0 2023-12-02T01:29:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.987+0000 7f3f4bfff640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3f3806ae40 0x7f3f3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:41.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.988+0000 7f3f4bfff640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3f3806ae40 0x7f3f3806d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c006fd0 tx=0x7f3f3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:41.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:41.991+0000 7f3f48ff9640 1 -- 172.21.15.1:0/819783724 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3f44077130 con 0x7f3f4c15d8d0 2023-12-02T01:29:42.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.164+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f4c04e920 con 0x7f3f4c15d8d0 2023-12-02T01:29:42.167 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.165+0000 7f3f48ff9640 1 -- 172.21.15.1:0/819783724 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f440430a0 con 0x7f3f4c15d8d0 2023-12-02T01:29:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3f3806ae40 msgr2=0x7f3f3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3f3806ae40 0x7f3f3806d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c006fd0 tx=0x7f3f3c008040 comp rx=0 tx=0).stop 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c15d8d0 msgr2=0x7f3f4c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c15d8d0 0x7f3f4c0b4e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009f40 tx=0x7f3f44004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 shutdown_connections 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f4c15d8d0 0x7f3f4c0b4e90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3f3806ae40 0x7f3f3806d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c0cf640 0x7f3f4c0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.170 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 --2- 172.21.15.1:0/819783724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f4c099eb0 0x7f3f4c151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 >> 172.21.15.1:0/819783724 conn(0x7f3f4c0b2ab0 msgr2=0x7f3f4c0b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 shutdown_connections 2023-12-02T01:29:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.167+0000 7f3f5227c640 1 -- 172.21.15.1:0/819783724 wait complete. 2023-12-02T01:29:42.180 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-02T01:29:42.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.283+0000 7f6ba9815640 1 Processor -- start 2023-12-02T01:29:42.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.283+0000 7f6ba9815640 1 -- start start 2023-12-02T01:29:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.284+0000 7f6ba9815640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 0x7f6ba40d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.284+0000 7f6ba9815640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6ba40d2010 0x7f6ba40d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.284+0000 7f6ba9815640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40cf260 con 0x7f6ba40d3620 2023-12-02T01:29:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.284+0000 7f6ba9815640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba40d3ab0 con 0x7f6ba40d2010 2023-12-02T01:29:42.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.284+0000 7f6ba9815640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40b49c0 con 0x7f6ba415d460 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.284+0000 7f6ba37fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6ba40d3620 0x7f6ba40cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44972/0 (socket says 172.21.15.1:44972) 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.284+0000 7f6ba37fe640 1 -- 172.21.15.1:0/3377721279 learned_addr learned my addr 172.21.15.1:0/3377721279 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6b9bfff640 1 --2- 172.21.15.1:0/3377721279 >> v2:172.21.15.167:3300/0 conn(0x7f6ba40d2010 0x7f6ba40d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 0x7f6ba40d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601638545 0 0) 0x7f6ba40cf260 con 0x7f6ba40d3620 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b90003520 con 0x7f6ba40d3620 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2942274945 0 0) 0x7f6b90003520 con 0x7f6ba40d3620 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 msgr2=0x7f6ba40d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 0x7f6ba40d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 >> v2:172.21.15.167:3300/0 conn(0x7f6ba40d2010 msgr2=0x7f6ba40d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 --2- 172.21.15.1:0/3377721279 >> v2:172.21.15.167:3300/0 conn(0x7f6ba40d2010 0x7f6ba40d30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40ceca0 con 0x7f6ba40d3620 2023-12-02T01:29:42.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f6b9c0019f0 con 0x7f6ba40d3620 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 >> v1:172.21.15.1:6789/0 conn(0x7f6ba40d3620 legacy=0x7f6ba40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b90003970 0x7f6b90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 0x7f6b900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b90004d00 0x7f6b90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40d3ab0 con 0x7f6b90003970 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40b49c0 con 0x7f6b90004d00 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000b980 con 0x7f6ba415d460 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b90003970 0x7f6b90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6b9bfff640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 0x7f6b900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba37fe640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b90004d00 0x7f6b90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 msgr2=0x7f6b900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba415d460 0x7f6b900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b90004d00 msgr2=0x7f6b90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:42.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b90004d00 0x7f6b90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.285+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/3377721279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90003520 con 0x7f6b90003970 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.286+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b90003970 0x7f6b90003d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009ac0 tx=0x7f6b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866078a0b59f5546 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.286+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9402c6b0 con 0x7f6b90003970 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.286+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9402c810 con 0x7f6b90003970 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.286+0000 7f6ba27fc640 1 -- 172.21.15.1:0/3377721279 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9402cba0 con 0x7f6b90003970 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.287+0000 7f6ba9815640 1 -- 172.21.15.1:0/3377721279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b90003970 msgr2=0x7f6b90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.287+0000 7f6ba9815640 1 --2- 172.21.15.1:0/3377721279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b90003970 0x7f6b90003d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009ac0 tx=0x7f6b900057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.287+0000 7f6ba37fe640 1 -- 172.21.15.1:0/3377721279 reap_dead start 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.287+0000 7f6ba9815640 1 -- 172.21.15.1:0/3377721279 shutdown_connections 2023-12-02T01:29:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.287+0000 7f6ba9815640 1 -- 172.21.15.1:0/3377721279 >> 172.21.15.1:0/3377721279 conn(0x7f6ba408cb60 msgr2=0x7f6ba409c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.287+0000 7f6ba9815640 1 -- 172.21.15.1:0/3377721279 shutdown_connections 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.287+0000 7f6ba9815640 1 -- 172.21.15.1:0/3377721279 wait complete. 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.288+0000 7f6ba9815640 1 Processor -- start 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.288+0000 7f6ba9815640 1 -- start start 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba9815640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ba4156bc0 0x7f6ba41572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba9815640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba40c9210 0x7f6ba415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba9815640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ba415b9a0 0x7f6ba41fb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba9815640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c6de0 con 0x7f6ba415b9a0 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba9815640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c6ad0 con 0x7f6ba4156bc0 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba9815640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba415be20 con 0x7f6ba40c9210 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ba415b9a0 0x7f6ba41fb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ba415b9a0 0x7f6ba41fb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58174/0 (socket says 172.21.15.1:58174) 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1786187164 learned_addr learned my addr 172.21.15.1:0/1786187164 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6b9bfff640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba40c9210 0x7f6ba415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ba4156bc0 0x7f6ba41572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba40c9210 msgr2=0x7f6ba415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba40c9210 0x7f6ba415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ba4156bc0 msgr2=0x7f6ba41572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ba4156bc0 0x7f6ba41572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 -- 172.21.15.1:0/1786187164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40ccf70 con 0x7f6ba415b9a0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba37fe640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ba415b9a0 0x7f6ba41fb740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ba408ba80 tx=0x7f6b9c00a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.289+0000 7f6ba0ff9640 1 -- 172.21.15.1:0/1786187164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0133f0 con 0x7f6ba415b9a0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.290+0000 7f6ba0ff9640 1 -- 172.21.15.1:0/1786187164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c013590 con 0x7f6ba415b9a0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.290+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba40cd250 con 0x7f6ba415b9a0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.290+0000 7f6ba0ff9640 1 -- 172.21.15.1:0/1786187164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c013940 con 0x7f6ba415b9a0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.290+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba40ccbb0 con 0x7f6ba415b9a0 2023-12-02T01:29:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.291+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4067420 con 0x7f6ba415b9a0 2023-12-02T01:29:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.291+0000 7f6ba0ff9640 1 -- 172.21.15.1:0/1786187164 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b9c013aa0 con 0x7f6ba415b9a0 2023-12-02T01:29:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.291+0000 7f6ba0ff9640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b8406ae40 0x7f6b8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.291+0000 7f6ba0ff9640 1 -- 172.21.15.1:0/1786187164 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b9c089c60 con 0x7f6ba415b9a0 2023-12-02T01:29:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.291+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b8406ae40 0x7f6b8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.292+0000 7f6ba2ffd640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b8406ae40 0x7f6b8406d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b94036000 tx=0x7f6b94030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.296+0000 7f6ba0ff9640 1 -- 172.21.15.1:0/1786187164 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b9c055060 con 0x7f6ba415b9a0 2023-12-02T01:29:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.475+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6ba40ce180 con 0x7f6ba415b9a0 2023-12-02T01:29:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.476+0000 7f6ba0ff9640 1 -- 172.21.15.1:0/1786187164 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6b9c058680 con 0x7f6ba415b9a0 2023-12-02T01:29:42.478 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:42.479 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-12-02T01:29:42.479 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:29:42.479 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-12-02T01:29:42.479 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2023-12-02T01:29:42.479 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:29:42.479 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-12-02T01:29:42.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b8406ae40 msgr2=0x7f6b8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b8406ae40 0x7f6b8406d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b94036000 tx=0x7f6b94030000 comp rx=0 tx=0).stop 2023-12-02T01:29:42.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ba415b9a0 msgr2=0x7f6ba41fb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ba415b9a0 0x7f6ba41fb740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ba408ba80 tx=0x7f6b9c00a730 comp rx=0 tx=0).stop 2023-12-02T01:29:42.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 shutdown_connections 2023-12-02T01:29:42.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ba415b9a0 0x7f6ba41fb740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ba40c9210 0x7f6ba415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b8406ae40 0x7f6b8406d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 --2- 172.21.15.1:0/1786187164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ba4156bc0 0x7f6ba41572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.477+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 >> 172.21.15.1:0/1786187164 conn(0x7f6ba408cb60 msgr2=0x7f6ba415f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.478+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 shutdown_connections 2023-12-02T01:29:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.478+0000 7f6ba9815640 1 -- 172.21.15.1:0/1786187164 wait complete. 2023-12-02T01:29:42.491 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-02T01:29:42.491 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-02T01:29:42.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.599+0000 7f97b181e640 1 Processor -- start 2023-12-02T01:29:42.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.599+0000 7f97b181e640 1 -- start start 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97b181e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97ac15b340 0x7f97ac0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97b181e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f97ac0cde80 0x7f97ac0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97b181e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac0cf620 con 0x7f97ac0c4e40 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97b181e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac06b390 con 0x7f97ac15b340 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97b181e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac0cf8c0 con 0x7f97ac0cde80 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97aaffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97ac15b340 0x7f97ac0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97aaffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f97ac15b340 0x7f97ac0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58176/0 (socket says 172.21.15.1:58176) 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97aaffd640 1 -- 172.21.15.1:0/605503185 learned_addr learned my addr 172.21.15.1:0/605503185 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:42.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.600+0000 7f97ab7fe640 1 --1- 172.21.15.1:0/605503185 >> v1:172.21.15.1:6789/0 conn(0x7f97ac0c4e40 0x7f97ac0c5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44986/0 (socket says 172.21.15.1:44986) 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97aa7fc640 1 --2- 172.21.15.1:0/605503185 >> v2:172.21.15.167:3300/0 conn(0x7f97ac0cde80 0x7f97ac0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97aaffd640 1 -- 172.21.15.1:0/605503185 >> v2:172.21.15.167:3300/0 conn(0x7f97ac0cde80 msgr2=0x7f97ac0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97aaffd640 1 --2- 172.21.15.1:0/605503185 >> v2:172.21.15.167:3300/0 conn(0x7f97ac0cde80 0x7f97ac0ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97aaffd640 1 -- 172.21.15.1:0/605503185 >> v1:172.21.15.1:6789/0 conn(0x7f97ac0c4e40 legacy=0x7f97ac0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97a9ffb640 1 -- 172.21.15.1:0/605503185 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278411596 0 0) 0x7f97ac0cf620 con 0x7f97ac0c4e40 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97aaffd640 1 -- 172.21.15.1:0/605503185 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0cfba0 con 0x7f97ac15b340 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97aa7fc640 1 --2- 172.21.15.1:0/605503185 >> v2:172.21.15.167:3300/0 conn(0x7f97ac0cde80 0x7f97ac0ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.601+0000 7f97aaffd640 1 --2- 172.21.15.1:0/605503185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac0cd940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0726c0 tx=0x7f97a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4719e83ad035c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97a9ffb640 1 -- 172.21.15.1:0/605503185 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4030860 con 0x7f97ac15b340 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97a9ffb640 1 -- 172.21.15.1:0/605503185 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a40309c0 con 0x7f97ac15b340 2023-12-02T01:29:42.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97a9ffb640 1 -- 172.21.15.1:0/605503185 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4030d50 con 0x7f97ac15b340 2023-12-02T01:29:42.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 -- 172.21.15.1:0/605503185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 msgr2=0x7f97ac0cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 --2- 172.21.15.1:0/605503185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac0cd940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0726c0 tx=0x7f97a402b9a0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 -- 172.21.15.1:0/605503185 shutdown_connections 2023-12-02T01:29:42.606 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 --2- 172.21.15.1:0/605503185 >> v2:172.21.15.167:3300/0 conn(0x7f97ac0cde80 0x7f97ac0ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 --2- 172.21.15.1:0/605503185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac0cd940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 -- 172.21.15.1:0/605503185 >> 172.21.15.1:0/605503185 conn(0x7f97ac099970 msgr2=0x7f97ac099d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:42.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 -- 172.21.15.1:0/605503185 shutdown_connections 2023-12-02T01:29:42.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.602+0000 7f97b181e640 1 -- 172.21.15.1:0/605503185 wait complete. 2023-12-02T01:29:42.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.603+0000 7f97b181e640 1 Processor -- start 2023-12-02T01:29:42.607 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97b181e640 1 -- start start 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97b181e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97ac0c4e40 0x7f97ac1f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97b181e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97ac0cde80 0x7f97ac148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97b181e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97b181e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac1f1150 con 0x7f97ac15b340 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97b181e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0b1b50 con 0x7f97ac0cde80 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97b181e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac155b10 con 0x7f97ac0c4e40 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58178/0 (socket says 172.21.15.1:58178) 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.604+0000 7f97ab7fe640 1 -- 172.21.15.1:0/3561412401 learned_addr learned my addr 172.21.15.1:0/3561412401 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97aa7fc640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97ac0cde80 0x7f97ac148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97aaffd640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97ac0c4e40 0x7f97ac1f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97ab7fe640 1 -- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97ac0c4e40 msgr2=0x7f97ac1f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97ab7fe640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97ac0c4e40 0x7f97ac1f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97ab7fe640 1 -- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97ac0cde80 msgr2=0x7f97ac148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97ab7fe640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97ac0cde80 0x7f97ac148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97ab7fe640 1 -- 172.21.15.1:0/3561412401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a40094d0 con 0x7f97ac15b340 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97aa7fc640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97ac0cde80 0x7f97ac148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97ab7fe640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac155070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c810 tx=0x7f979c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97a3fff640 1 -- 172.21.15.1:0/3561412401 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00a640 con 0x7f97ac15b340 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97a3fff640 1 -- 172.21.15.1:0/3561412401 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00a7c0 con 0x7f97ac15b340 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97a3fff640 1 -- 172.21.15.1:0/3561412401 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00ab70 con 0x7f97ac15b340 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac155df0 con 0x7f97ac15b340 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.605+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac1563b0 con 0x7f97ac15b340 2023-12-02T01:29:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.606+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac068470 con 0x7f97ac15b340 2023-12-02T01:29:42.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.607+0000 7f97a3fff640 1 -- 172.21.15.1:0/3561412401 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f979c00acd0 con 0x7f97ac15b340 2023-12-02T01:29:42.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.607+0000 7f97a3fff640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f978c06ae40 0x7f978c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:42.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.607+0000 7f97a3fff640 1 -- 172.21.15.1:0/3561412401 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f979c088740 con 0x7f97ac15b340 2023-12-02T01:29:42.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.607+0000 7f97aaffd640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f978c06ae40 0x7f978c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:42.612 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.607+0000 7f97aaffd640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f978c06ae40 0x7f978c06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97a4036000 tx=0x7f97a403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:42.613 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.611+0000 7f97a3fff640 1 -- 172.21.15.1:0/3561412401 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f979c053b40 con 0x7f97ac15b340 2023-12-02T01:29:42.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:42.788+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f97ac06b170 con 0x7f97ac15b340 2023-12-02T01:29:43.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.327+0000 7f97a3fff640 1 -- 172.21.15.1:0/3561412401 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f979c0180b0 con 0x7f97ac15b340 2023-12-02T01:29:43.329 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-12-02T01:29:43.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f978c06ae40 msgr2=0x7f978c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:43.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f978c06ae40 0x7f978c06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97a4036000 tx=0x7f97a403b040 comp rx=0 tx=0).stop 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 msgr2=0x7f97ac155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac155070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f979c00c810 tx=0x7f979c00ccd0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 shutdown_connections 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97ac15b340 0x7f97ac155070 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f978c06ae40 0x7f978c06d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97ac0cde80 0x7f97ac148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 --2- 172.21.15.1:0/3561412401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97ac0c4e40 0x7f97ac1f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 >> 172.21.15.1:0/3561412401 conn(0x7f97ac099970 msgr2=0x7f97ac0c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 shutdown_connections 2023-12-02T01:29:43.333 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.330+0000 7f97b181e640 1 -- 172.21.15.1:0/3561412401 wait complete. 2023-12-02T01:29:43.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-02T01:29:43.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.465+0000 7f0c9b948640 1 Processor -- start 2023-12-02T01:29:43.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.465+0000 7f0c9b948640 1 -- start start 2023-12-02T01:29:43.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c9b948640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c9415d8d0 0x7f0c94099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:43.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c9b948640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c94099eb0 0x7f0c940cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c9b948640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9409a310 con 0x7f0c940cf470 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c9b948640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c940cfca0 con 0x7f0c9415d8d0 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c9b948640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940b0720 con 0x7f0c94099eb0 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c996e4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c9415d8d0 0x7f0c94099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c996e4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0c9415d8d0 0x7f0c94099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58180/0 (socket says 172.21.15.1:58180) 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.466+0000 7f0c996e4640 1 -- 172.21.15.1:0/1605508963 learned_addr learned my addr 172.21.15.1:0/1605508963 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.467+0000 7f0c98ee3640 1 --2- 172.21.15.1:0/1605508963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c94099eb0 0x7f0c940cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.467+0000 7f0c996e4640 1 -- 172.21.15.1:0/1605508963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c94099eb0 msgr2=0x7f0c940cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.467+0000 7f0c996e4640 1 --2- 172.21.15.1:0/1605508963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c94099eb0 0x7f0c940cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.467+0000 7f0c996e4640 1 -- 172.21.15.1:0/1605508963 >> v1:172.21.15.1:6789/0 conn(0x7f0c940cf470 legacy=0x7f0c9406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.467+0000 7f0c996e4640 1 -- 172.21.15.1:0/1605508963 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940b0a00 con 0x7f0c9415d8d0 2023-12-02T01:29:43.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.467+0000 7f0c8bfff640 1 -- 172.21.15.1:0/1605508963 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075967729 0 0) 0x7f0c9409a310 con 0x7f0c940cf470 2023-12-02T01:29:43.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.467+0000 7f0c996e4640 1 --2- 172.21.15.1:0/1605508963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94099970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009870 tx=0x7f0c9002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f762edc92260b67 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:43.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c8bfff640 1 -- 172.21.15.1:0/1605508963 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90030840 con 0x7f0c9415d8d0 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c8bfff640 1 -- 172.21.15.1:0/1605508963 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900309a0 con 0x7f0c9415d8d0 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c8bfff640 1 -- 172.21.15.1:0/1605508963 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90030d30 con 0x7f0c9415d8d0 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 -- 172.21.15.1:0/1605508963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 msgr2=0x7f0c94099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1605508963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94099970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009870 tx=0x7f0c9002b980 comp rx=0 tx=0).stop 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 -- 172.21.15.1:0/1605508963 shutdown_connections 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1605508963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c94099eb0 0x7f0c940cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1605508963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94099970 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 -- 172.21.15.1:0/1605508963 >> 172.21.15.1:0/1605508963 conn(0x7f0c940b2ab0 msgr2=0x7f0c940b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 -- 172.21.15.1:0/1605508963 shutdown_connections 2023-12-02T01:29:43.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.468+0000 7f0c9b948640 1 -- 172.21.15.1:0/1605508963 wait complete. 2023-12-02T01:29:43.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.469+0000 7f0c9b948640 1 Processor -- start 2023-12-02T01:29:43.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.469+0000 7f0c9b948640 1 -- start start 2023-12-02T01:29:43.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c9b948640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c94099eb0 0x7f0c941f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c9b948640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c940cf470 0x7f0c940af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c9b948640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c9b948640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940afce0 con 0x7f0c9415d8d0 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c9b948640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940c4be0 con 0x7f0c94099eb0 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c9b948640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941f7630 con 0x7f0c940cf470 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c99ee5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c99ee5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58186/0 (socket says 172.21.15.1:58186) 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.470+0000 7f0c99ee5640 1 -- 172.21.15.1:0/1543129056 learned_addr learned my addr 172.21.15.1:0/1543129056 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c996e4640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c94099eb0 0x7f0c941f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c98ee3640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c940cf470 0x7f0c940af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c99ee5640 1 -- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c940cf470 msgr2=0x7f0c940af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:43.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c99ee5640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c940cf470 0x7f0c940af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c99ee5640 1 -- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c94099eb0 msgr2=0x7f0c941f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c99ee5640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c94099eb0 0x7f0c941f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c99ee5640 1 -- 172.21.15.1:0/1543129056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900094d0 con 0x7f0c9415d8d0 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c996e4640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c94099eb0 0x7f0c941f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c99ee5640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94151e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001560 tx=0x7f0c8c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c89ffb640 1 -- 172.21.15.1:0/1543129056 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c003da0 con 0x7f0c9415d8d0 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c89ffb640 1 -- 172.21.15.1:0/1543129056 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c005070 con 0x7f0c9415d8d0 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c941523b0 con 0x7f0c9415d8d0 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c89ffb640 1 -- 172.21.15.1:0/1543129056 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c005420 con 0x7f0c9415d8d0 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.471+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c941f7070 con 0x7f0c9415d8d0 2023-12-02T01:29:43.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.472+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c940c4d90 con 0x7f0c9415d8d0 2023-12-02T01:29:43.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.472+0000 7f0c89ffb640 1 -- 172.21.15.1:0/1543129056 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c8c005580 con 0x7f0c9415d8d0 2023-12-02T01:29:43.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.473+0000 7f0c89ffb640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0c7806ae40 0x7f0c7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:43.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.473+0000 7f0c89ffb640 1 -- 172.21.15.1:0/1543129056 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0c8c088c50 con 0x7f0c9415d8d0 2023-12-02T01:29:43.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.473+0000 7f0c996e4640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0c7806ae40 0x7f0c7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:43.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.473+0000 7f0c996e4640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0c7806ae40 0x7f0c7806d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c90036000 tx=0x7f0c9003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:43.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.477+0000 7f0c89ffb640 1 -- 172.21.15.1:0/1543129056 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c940c4d90 con 0x7f0c9415d8d0 2023-12-02T01:29:43.656 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:43.653+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0c940c4d50 con 0x7f0c9415d8d0 2023-12-02T01:29:44.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.329+0000 7f0c89ffb640 1 -- 172.21.15.1:0/1543129056 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0c8c017070 con 0x7f0c9415d8d0 2023-12-02T01:29:44.332 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-12-02T01:29:44.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.333+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0c7806ae40 msgr2=0x7f0c7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.333+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0c7806ae40 0x7f0c7806d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c90036000 tx=0x7f0c9003b040 comp rx=0 tx=0).stop 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.333+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 msgr2=0x7f0c94151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.333+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94151e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001560 tx=0x7f0c8c00cc70 comp rx=0 tx=0).stop 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.334+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 shutdown_connections 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.334+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c9415d8d0 0x7f0c94151e70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.334+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c940cf470 0x7f0c940af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.334+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0c7806ae40 0x7f0c7806d300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.334+0000 7f0c9b948640 1 --2- 172.21.15.1:0/1543129056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c94099eb0 0x7f0c941f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.334+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 >> 172.21.15.1:0/1543129056 conn(0x7f0c940b2ab0 msgr2=0x7f0c9406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:44.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.334+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 shutdown_connections 2023-12-02T01:29:44.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.335+0000 7f0c9b948640 1 -- 172.21.15.1:0/1543129056 wait complete. 2023-12-02T01:29:44.363 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-02T01:29:44.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.475+0000 7f0240875640 1 Processor -- start 2023-12-02T01:29:44.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.475+0000 7f0240875640 1 -- start start 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f0240875640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f023c15d7b0 0x7f023c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f0240875640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c0d0050 0x7f023c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f0240875640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c0b04d0 con 0x7f023c0b0ea0 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f0240875640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c0d04d0 con 0x7f023c15d7b0 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f0240875640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c0d1e40 con 0x7f023c0d0050 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f023a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f023c15d7b0 0x7f023c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f023a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f023c15d7b0 0x7f023c0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58202/0 (socket says 172.21.15.1:58202) 2023-12-02T01:29:44.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f023a59c640 1 -- 172.21.15.1:0/4079112464 learned_addr learned my addr 172.21.15.1:0/4079112464 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.476+0000 7f0239d9b640 1 --2- 172.21.15.1:0/4079112464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c0d0050 0x7f023c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.477+0000 7f023a59c640 1 -- 172.21.15.1:0/4079112464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c0d0050 msgr2=0x7f023c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.477+0000 7f023a59c640 1 --2- 172.21.15.1:0/4079112464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c0d0050 0x7f023c0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.477+0000 7f023a59c640 1 -- 172.21.15.1:0/4079112464 >> v1:172.21.15.1:6789/0 conn(0x7f023c0b0ea0 legacy=0x7f023c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.477+0000 7f023959a640 1 -- 172.21.15.1:0/4079112464 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264475512 0 0) 0x7f023c0b04d0 con 0x7f023c0b0ea0 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.477+0000 7f023a59c640 1 -- 172.21.15.1:0/4079112464 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0afe80 con 0x7f023c15d7b0 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.477+0000 7f0239d9b640 1 --2- 172.21.15.1:0/4079112464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c0d0050 0x7f023c0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.477+0000 7f023a59c640 1 --2- 172.21.15.1:0/4079112464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c15d7b0 0x7f023c0cfb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0234009870 tx=0x7f023402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bacd50890faa4a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f023959a640 1 -- 172.21.15.1:0/4079112464 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234030840 con 0x7f023c15d7b0 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f023959a640 1 -- 172.21.15.1:0/4079112464 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02340309a0 con 0x7f023c15d7b0 2023-12-02T01:29:44.481 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f023959a640 1 -- 172.21.15.1:0/4079112464 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234030d30 con 0x7f023c15d7b0 2023-12-02T01:29:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 -- 172.21.15.1:0/4079112464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c15d7b0 msgr2=0x7f023c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 --2- 172.21.15.1:0/4079112464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c15d7b0 0x7f023c0cfb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0234009870 tx=0x7f023402b980 comp rx=0 tx=0).stop 2023-12-02T01:29:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 -- 172.21.15.1:0/4079112464 shutdown_connections 2023-12-02T01:29:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 --2- 172.21.15.1:0/4079112464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c0d0050 0x7f023c0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 --2- 172.21.15.1:0/4079112464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c15d7b0 0x7f023c0cfb10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 -- 172.21.15.1:0/4079112464 >> 172.21.15.1:0/4079112464 conn(0x7f023c09c480 msgr2=0x7f023c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 -- 172.21.15.1:0/4079112464 shutdown_connections 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.478+0000 7f0240875640 1 -- 172.21.15.1:0/4079112464 wait complete. 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 Processor -- start 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 -- start start 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f023c0b0ea0 0x7f023c15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c0d0050 0x7f023c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c15d7b0 0x7f023c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c160d30 con 0x7f023c0d0050 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c0b7650 con 0x7f023c0b0ea0 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0240875640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1601b0 con 0x7f023c15d7b0 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0239d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c0d0050 0x7f023c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0239d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c0d0050 0x7f023c0b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58212/0 (socket says 172.21.15.1:58212) 2023-12-02T01:29:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.480+0000 7f0239d9b640 1 -- 172.21.15.1:0/2355497391 learned_addr learned my addr 172.21.15.1:0/2355497391 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f023a59c640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f023c0b0ea0 0x7f023c15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f023ad9d640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c15d7b0 0x7f023c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0239d9b640 1 -- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c15d7b0 msgr2=0x7f023c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0239d9b640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c15d7b0 0x7f023c0cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0239d9b640 1 -- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f023c0b0ea0 msgr2=0x7f023c15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0239d9b640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f023c0b0ea0 0x7f023c15a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0239d9b640 1 -- 172.21.15.1:0/2355497391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340094d0 con 0x7f023c0d0050 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0239d9b640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c0d0050 0x7f023c0b7110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f023000e7e0 tx=0x7f023000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f022affd640 1 -- 172.21.15.1:0/2355497391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230004030 con 0x7f023c0d0050 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f022affd640 1 -- 172.21.15.1:0/2355497391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230004190 con 0x7f023c0d0050 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c160490 con 0x7f023c0d0050 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f022affd640 1 -- 172.21.15.1:0/2355497391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230004520 con 0x7f023c0d0050 2023-12-02T01:29:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.481+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c160a50 con 0x7f023c0d0050 2023-12-02T01:29:44.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.482+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c0a1160 con 0x7f023c0d0050 2023-12-02T01:29:44.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.483+0000 7f022affd640 1 -- 172.21.15.1:0/2355497391 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f023000c6d0 con 0x7f023c0d0050 2023-12-02T01:29:44.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.483+0000 7f022affd640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f021c06ae40 0x7f021c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:44.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.483+0000 7f023a59c640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f021c06ae40 0x7f021c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:44.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.483+0000 7f022affd640 1 -- 172.21.15.1:0/2355497391 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0230089260 con 0x7f023c0d0050 2023-12-02T01:29:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.484+0000 7f023a59c640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f021c06ae40 0x7f021c06d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0234036000 tx=0x7f0234008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:44.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.488+0000 7f022affd640 1 -- 172.21.15.1:0/2355497391 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0230054420 con 0x7f023c0d0050 2023-12-02T01:29:44.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:44.701+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f023c0b78f0 con 0x7f023c0d0050 2023-12-02T01:29:45.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.341+0000 7f022affd640 1 -- 172.21.15.1:0/2355497391 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0230057a40 con 0x7f023c0d0050 2023-12-02T01:29:45.344 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2023-12-02T01:29:45.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f021c06ae40 msgr2=0x7f021c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f021c06ae40 0x7f021c06d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0234036000 tx=0x7f0234008030 comp rx=0 tx=0).stop 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c0d0050 msgr2=0x7f023c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c0d0050 0x7f023c0b7110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f023000e7e0 tx=0x7f023000eca0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 shutdown_connections 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f023c15d7b0 0x7f023c0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f023c0d0050 0x7f023c0b7110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f021c06ae40 0x7f021c06d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 --2- 172.21.15.1:0/2355497391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f023c0b0ea0 0x7f023c15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 >> 172.21.15.1:0/2355497391 conn(0x7f023c09c480 msgr2=0x7f023c0cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 shutdown_connections 2023-12-02T01:29:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.346+0000 7f0240875640 1 -- 172.21.15.1:0/2355497391 wait complete. 2023-12-02T01:29:45.365 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:45.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.474+0000 7f31e5d6e640 1 Processor -- start 2023-12-02T01:29:45.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.474+0000 7f31e5d6e640 1 -- start start 2023-12-02T01:29:45.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31e5d6e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31e00b4810 0x7f31e015b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31e5d6e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f31e015bd90 0x7f31e00cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31e5d6e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e006de80 con 0x7f31e013e2d0 2023-12-02T01:29:45.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31e5d6e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e015fc60 con 0x7f31e015bd90 2023-12-02T01:29:45.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31e5d6e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e006d5c0 con 0x7f31e00b4810 2023-12-02T01:29:45.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31dffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f31e015bd90 0x7f31e00cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31dffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f31e015bd90 0x7f31e00cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58222/0 (socket says 172.21.15.1:58222) 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31dffff640 1 -- 172.21.15.1:0/1181145306 learned_addr learned my addr 172.21.15.1:0/1181145306 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31df7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f31e013e2d0 0x7f31e00b4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45022/0 (socket says 172.21.15.1:45022) 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.475+0000 7f31deffd640 1 --2- 172.21.15.1:0/1181145306 >> v2:172.21.15.167:3300/0 conn(0x7f31e00b4810 0x7f31e015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31dffff640 1 -- 172.21.15.1:0/1181145306 >> v2:172.21.15.167:3300/0 conn(0x7f31e00b4810 msgr2=0x7f31e015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31dffff640 1 --2- 172.21.15.1:0/1181145306 >> v2:172.21.15.167:3300/0 conn(0x7f31e00b4810 0x7f31e015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31dffff640 1 -- 172.21.15.1:0/1181145306 >> v1:172.21.15.1:6789/0 conn(0x7f31e013e2d0 legacy=0x7f31e00b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31de7fc640 1 -- 172.21.15.1:0/1181145306 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345772754 0 0) 0x7f31e006de80 con 0x7f31e013e2d0 2023-12-02T01:29:45.478 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31dffff640 1 -- 172.21.15.1:0/1181145306 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e006d830 con 0x7f31e015bd90 2023-12-02T01:29:45.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31dffff640 1 --2- 172.21.15.1:0/1181145306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e015bd90 0x7f31e00cd810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31e00cebf0 tx=0x7f31d802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ba0b3c0788a1e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:45.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31de7fc640 1 -- 172.21.15.1:0/1181145306 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d802cb20 con 0x7f31e015bd90 2023-12-02T01:29:45.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31de7fc640 1 -- 172.21.15.1:0/1181145306 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d802cc80 con 0x7f31e015bd90 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.476+0000 7f31de7fc640 1 -- 172.21.15.1:0/1181145306 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80343f0 con 0x7f31e015bd90 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 -- 172.21.15.1:0/1181145306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e015bd90 msgr2=0x7f31e00cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/1181145306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e015bd90 0x7f31e00cd810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31e00cebf0 tx=0x7f31d802bf80 comp rx=0 tx=0).stop 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 -- 172.21.15.1:0/1181145306 shutdown_connections 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/1181145306 >> v2:172.21.15.167:3300/0 conn(0x7f31e00b4810 0x7f31e015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/1181145306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e015bd90 0x7f31e00cd810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 -- 172.21.15.1:0/1181145306 >> 172.21.15.1:0/1181145306 conn(0x7f31e00b0af0 msgr2=0x7f31e00b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 -- 172.21.15.1:0/1181145306 shutdown_connections 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.477+0000 7f31e5d6e640 1 -- 172.21.15.1:0/1181145306 wait complete. 2023-12-02T01:29:45.480 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.478+0000 7f31e5d6e640 1 Processor -- start 2023-12-02T01:29:45.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.478+0000 7f31e5d6e640 1 -- start start 2023-12-02T01:29:45.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31e5d6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00b4810 0x7f31e01f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31e5d6e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31e013e2d0 0x7f31e0154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.482 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31e5d6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31e015bd90 0x7f31e0158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31e5d6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0159130 con 0x7f31e00b4810 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31e5d6e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00a8570 con 0x7f31e013e2d0 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31e5d6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01542e0 con 0x7f31e015bd90 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00b4810 0x7f31e01f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00b4810 0x7f31e01f4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58230/0 (socket says 172.21.15.1:58230) 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31df7fe640 1 -- 172.21.15.1:0/2550400060 learned_addr learned my addr 172.21.15.1:0/2550400060 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31deffd640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31e013e2d0 0x7f31e0154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31dffff640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31e015bd90 0x7f31e0158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.479+0000 7f31df7fe640 1 -- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31e015bd90 msgr2=0x7f31e0158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31df7fe640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31e015bd90 0x7f31e0158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31df7fe640 1 -- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31e013e2d0 msgr2=0x7f31e0154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.483 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31df7fe640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31e013e2d0 0x7f31e0154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31df7fe640 1 -- 172.21.15.1:0/2550400060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009b30 con 0x7f31e00b4810 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31dffff640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31e015bd90 0x7f31e0158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31df7fe640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00b4810 0x7f31e01f4bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c4d0 tx=0x7f31d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31c7fff640 1 -- 172.21.15.1:0/2550400060 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00074e0 con 0x7f31e00b4810 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31c7fff640 1 -- 172.21.15.1:0/2550400060 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0007660 con 0x7f31e00b4810 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e006e490 con 0x7f31e00b4810 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31c7fff640 1 -- 172.21.15.1:0/2550400060 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0004a20 con 0x7f31e00b4810 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.480+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e01548a0 con 0x7f31e00b4810 2023-12-02T01:29:45.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.481+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e006e2d0 con 0x7f31e00b4810 2023-12-02T01:29:45.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.481+0000 7f31c7fff640 1 -- 172.21.15.1:0/2550400060 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31d0004b80 con 0x7f31e00b4810 2023-12-02T01:29:45.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.482+0000 7f31c7fff640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f31cc06ae70 0x7f31cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.482+0000 7f31c7fff640 1 -- 172.21.15.1:0/2550400060 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d0088a40 con 0x7f31e00b4810 2023-12-02T01:29:45.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.482+0000 7f31deffd640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f31cc06ae70 0x7f31cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.482+0000 7f31deffd640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f31cc06ae70 0x7f31cc06d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31e015cdf0 tx=0x7f31d4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:45.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.486+0000 7f31c7fff640 1 -- 172.21.15.1:0/2550400060 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31d008ae60 con 0x7f31e00b4810 2023-12-02T01:29:45.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.665+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31e0067420 con 0x7f31e00b4810 2023-12-02T01:29:45.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.666+0000 7f31c7fff640 1 -- 172.21.15.1:0/2550400060 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f31d0018020 con 0x7f31e00b4810 2023-12-02T01:29:45.668 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:45.668 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:44.703772+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:45.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f31cc06ae70 msgr2=0x7f31cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f31cc06ae70 0x7f31cc06d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31e015cdf0 tx=0x7f31d4009190 comp rx=0 tx=0).stop 2023-12-02T01:29:45.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00b4810 msgr2=0x7f31e01f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00b4810 0x7f31e01f4bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c4d0 tx=0x7f31d000c990 comp rx=0 tx=0).stop 2023-12-02T01:29:45.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 shutdown_connections 2023-12-02T01:29:45.670 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31e015bd90 0x7f31e0158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f31cc06ae70 0x7f31cc06d330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31e013e2d0 0x7f31e0154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 --2- 172.21.15.1:0/2550400060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31e00b4810 0x7f31e01f4bd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 >> 172.21.15.1:0/2550400060 conn(0x7f31e00b0af0 msgr2=0x7f31e00afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:45.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.668+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 shutdown_connections 2023-12-02T01:29:45.671 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.669+0000 7f31e5d6e640 1 -- 172.21.15.1:0/2550400060 wait complete. 2023-12-02T01:29:45.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:45.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.785+0000 7f8d79ccf640 1 Processor -- start 2023-12-02T01:29:45.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.785+0000 7f8d79ccf640 1 -- start start 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d79ccf640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d7415a100 0x7f8d740cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d79ccf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740cb2b0 0x7f8d74071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d79ccf640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d740cc3f0 con 0x7f8d740ceef0 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d79ccf640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d740cb7e0 con 0x7f8d7415a100 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d79ccf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740cbac0 con 0x7f8d740cb2b0 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d737fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d7415a100 0x7f8d740cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d73fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8d740ceef0 0x7f8d7415dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45030/0 (socket says 172.21.15.1:45030) 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d737fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d7415a100 0x7f8d740cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58244/0 (socket says 172.21.15.1:58244) 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.786+0000 7f8d73fff640 1 -- 172.21.15.1:0/131811451 learned_addr learned my addr 172.21.15.1:0/131811451 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d72ffd640 1 --2- 172.21.15.1:0/131811451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740cb2b0 0x7f8d74071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d737fe640 1 -- 172.21.15.1:0/131811451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740cb2b0 msgr2=0x7f8d74071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d737fe640 1 --2- 172.21.15.1:0/131811451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740cb2b0 0x7f8d74071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d737fe640 1 -- 172.21.15.1:0/131811451 >> v1:172.21.15.1:6789/0 conn(0x7f8d740ceef0 legacy=0x7f8d7415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d727fc640 1 -- 172.21.15.1:0/131811451 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6675054 0 0) 0x7f8d740cc3f0 con 0x7f8d740ceef0 2023-12-02T01:29:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d737fe640 1 -- 172.21.15.1:0/131811451 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d740cbda0 con 0x7f8d7415a100 2023-12-02T01:29:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d72ffd640 1 --2- 172.21.15.1:0/131811451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740cb2b0 0x7f8d74071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:45.790 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.787+0000 7f8d737fe640 1 --2- 172.21.15.1:0/131811451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740cad70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400ba70 tx=0x7f8d6402dff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b48b19f15e8543f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d727fc640 1 -- 172.21.15.1:0/131811451 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6402eda0 con 0x7f8d7415a100 2023-12-02T01:29:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d727fc640 1 -- 172.21.15.1:0/131811451 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64036440 con 0x7f8d7415a100 2023-12-02T01:29:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d727fc640 1 -- 172.21.15.1:0/131811451 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d640367d0 con 0x7f8d7415a100 2023-12-02T01:29:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 -- 172.21.15.1:0/131811451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 msgr2=0x7f8d740cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/131811451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740cad70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400ba70 tx=0x7f8d6402dff0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 -- 172.21.15.1:0/131811451 shutdown_connections 2023-12-02T01:29:45.791 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/131811451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740cb2b0 0x7f8d74071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/131811451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740cad70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 -- 172.21.15.1:0/131811451 >> 172.21.15.1:0/131811451 conn(0x7f8d740cfe80 msgr2=0x7f8d740d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:45.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 -- 172.21.15.1:0/131811451 shutdown_connections 2023-12-02T01:29:45.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.788+0000 7f8d79ccf640 1 -- 172.21.15.1:0/131811451 wait complete. 2023-12-02T01:29:45.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.789+0000 7f8d79ccf640 1 Processor -- start 2023-12-02T01:29:45.792 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d79ccf640 1 -- start start 2023-12-02T01:29:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d79ccf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d740cb2b0 0x7f8d741560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.793 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d79ccf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740ceef0 0x7f8d740c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d79ccf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d79ccf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741565e0 con 0x7f8d7415a100 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d79ccf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415a660 con 0x7f8d740cb2b0 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d79ccf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741f1860 con 0x7f8d740ceef0 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.790+0000 7f8d73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58252/0 (socket says 172.21.15.1:58252) 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 -- 172.21.15.1:0/169609647 learned_addr learned my addr 172.21.15.1:0/169609647 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d72ffd640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740ceef0 0x7f8d740c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d737fe640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d740cb2b0 0x7f8d741560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 -- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740ceef0 msgr2=0x7f8d740c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740ceef0 0x7f8d740c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 -- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d740cb2b0 msgr2=0x7f8d741560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.794 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d740cb2b0 0x7f8d741560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 -- 172.21.15.1:0/169609647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6400b6a0 con 0x7f8d7415a100 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d73fff640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740c3b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c7a0 tx=0x7f8d6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d5bfff640 1 -- 172.21.15.1:0/169609647 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00a640 con 0x7f8d7415a100 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d5bfff640 1 -- 172.21.15.1:0/169609647 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00a7a0 con 0x7f8d7415a100 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d741f1b40 con 0x7f8d7415a100 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d5bfff640 1 -- 172.21.15.1:0/169609647 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00abd0 con 0x7f8d7415a100 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.791+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d741f2100 con 0x7f8d7415a100 2023-12-02T01:29:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.792+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7409dea0 con 0x7f8d7415a100 2023-12-02T01:29:45.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.793+0000 7f8d5bfff640 1 -- 172.21.15.1:0/169609647 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d6c00ad30 con 0x7f8d7415a100 2023-12-02T01:29:45.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.793+0000 7f8d5bfff640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d6006ae40 0x7f8d6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:45.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.793+0000 7f8d5bfff640 1 -- 172.21.15.1:0/169609647 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d6c088d90 con 0x7f8d7415a100 2023-12-02T01:29:45.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.793+0000 7f8d737fe640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d6006ae40 0x7f8d6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:45.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.793+0000 7f8d737fe640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d6006ae40 0x7f8d6006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d64038000 tx=0x7f8d64032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:45.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.797+0000 7f8d5bfff640 1 -- 172.21.15.1:0/169609647 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d6c053ed0 con 0x7f8d7415a100 2023-12-02T01:29:45.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:29:45.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:29:45.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.974+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d74068470 con 0x7f8d7415a100 2023-12-02T01:29:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.976+0000 7f8d5bfff640 1 -- 172.21.15.1:0/169609647 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f8d6c018020 con 0x7f8d7415a100 2023-12-02T01:29:45.977 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:45.978 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:44.703772+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:45.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.977+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d6006ae40 msgr2=0x7f8d6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.977+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d6006ae40 0x7f8d6006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d64038000 tx=0x7f8d64032000 comp rx=0 tx=0).stop 2023-12-02T01:29:45.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.977+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 msgr2=0x7f8d740c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.977+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740c3b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c7a0 tx=0x7f8d6c00cc60 comp rx=0 tx=0).stop 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.977+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 shutdown_connections 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.977+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d7415a100 0x7f8d740c3b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.978+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d740ceef0 0x7f8d740c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.978+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d6006ae40 0x7f8d6006d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.978+0000 7f8d79ccf640 1 --2- 172.21.15.1:0/169609647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d740cb2b0 0x7f8d741560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.978+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 >> 172.21.15.1:0/169609647 conn(0x7f8d740cfe80 msgr2=0x7f8d740ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.978+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 shutdown_connections 2023-12-02T01:29:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:45.978+0000 7f8d79ccf640 1 -- 172.21.15.1:0/169609647 wait complete. 2023-12-02T01:29:45.990 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-02T01:29:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.098+0000 7f864a9d7640 1 Processor -- start 2023-12-02T01:29:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.098+0000 7f864a9d7640 1 -- start start 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.098+0000 7f864a9d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8644160b70 0x7f86440d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.098+0000 7f864a9d7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f86440cef00 0x7f8644161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.098+0000 7f864a9d7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440ce360 con 0x7f86440b2aa0 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.098+0000 7f864a9d7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86440b2f20 con 0x7f86440cef00 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.098+0000 7f864a9d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86440cdd50 con 0x7f8644160b70 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f86437fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f86440b2aa0 0x7f86440ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45042/0 (socket says 172.21.15.1:45042) 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f86437fe640 1 -- 172.21.15.1:0/2267707262 learned_addr learned my addr 172.21.15.1:0/2267707262 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8643fff640 1 --2- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8644160b70 0x7f86440d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8648f74640 1 --2- 172.21.15.1:0/2267707262 >> v2:172.21.15.167:3300/0 conn(0x7f86440cef00 0x7f8644161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8642ffd640 1 -- 172.21.15.1:0/2267707262 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291832227 0 0) 0x7f86440ce360 con 0x7f86440b2aa0 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8642ffd640 1 -- 172.21.15.1:0/2267707262 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f862c003520 con 0x7f86440b2aa0 2023-12-02T01:29:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8648f74640 1 -- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8644160b70 msgr2=0x7f86440d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:46.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8648f74640 1 --2- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8644160b70 0x7f86440d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8648f74640 1 -- 172.21.15.1:0/2267707262 >> v1:172.21.15.1:6789/0 conn(0x7f86440b2aa0 legacy=0x7f86440ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8648f74640 1 -- 172.21.15.1:0/2267707262 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440d1c70 con 0x7f86440cef00 2023-12-02T01:29:46.102 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.099+0000 7f8643fff640 1 --2- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8644160b70 0x7f86440d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.100+0000 7f8648f74640 1 --2- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440cef00 0x7f8644161230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f863c009d90 tx=0x7f863c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de0c781e91160a38 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.100+0000 7f8642ffd640 1 -- 172.21.15.1:0/2267707262 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c02cc50 con 0x7f86440cef00 2023-12-02T01:29:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.100+0000 7f8642ffd640 1 -- 172.21.15.1:0/2267707262 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c02cdb0 con 0x7f86440cef00 2023-12-02T01:29:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.100+0000 7f8642ffd640 1 -- 172.21.15.1:0/2267707262 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c034640 con 0x7f86440cef00 2023-12-02T01:29:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 -- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440cef00 msgr2=0x7f8644161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440cef00 0x7f8644161230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f863c009d90 tx=0x7f863c02bea0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 -- 172.21.15.1:0/2267707262 shutdown_connections 2023-12-02T01:29:46.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440cef00 0x7f8644161230 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2267707262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8644160b70 0x7f86440d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 -- 172.21.15.1:0/2267707262 >> 172.21.15.1:0/2267707262 conn(0x7f864409c470 msgr2=0x7f86440d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:46.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 -- 172.21.15.1:0/2267707262 shutdown_connections 2023-12-02T01:29:46.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.101+0000 7f864a9d7640 1 -- 172.21.15.1:0/2267707262 wait complete. 2023-12-02T01:29:46.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.102+0000 7f864a9d7640 1 Processor -- start 2023-12-02T01:29:46.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.102+0000 7f864a9d7640 1 -- start start 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440b2aa0 0x7f86441f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86440cef00 0x7f8644150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8644160b70 0x7f86440cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86440b6960 con 0x7f8644160b70 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441f3970 con 0x7f86440b2aa0 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86440b5d90 con 0x7f86440cef00 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8644160b70 0x7f86440cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8644160b70 0x7f86440cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58264/0 (socket says 172.21.15.1:58264) 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 -- 172.21.15.1:0/2224509788 learned_addr learned my addr 172.21.15.1:0/2224509788 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8643fff640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440b2aa0 0x7f86441f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f86437fe640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86440cef00 0x7f8644150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 -- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86440cef00 msgr2=0x7f8644150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86440cef00 0x7f8644150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 -- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440b2aa0 msgr2=0x7f86441f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440b2aa0 0x7f86441f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 -- 172.21.15.1:0/2224509788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009400 con 0x7f8644160b70 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8648f74640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8644160b70 0x7f86440cc4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f863c009eb0 tx=0x7f863c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8640ff9640 1 -- 172.21.15.1:0/2224509788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c03e610 con 0x7f8644160b70 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8640ff9640 1 -- 172.21.15.1:0/2224509788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c03e770 con 0x7f8644160b70 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c009a70 con 0x7f8644160b70 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f8640ff9640 1 -- 172.21.15.1:0/2224509788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c03eb60 con 0x7f8644160b70 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.103+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86440b6310 con 0x7f8644160b70 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.105+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86440b6b10 con 0x7f8644160b70 2023-12-02T01:29:46.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.105+0000 7f8640ff9640 1 -- 172.21.15.1:0/2224509788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f863c03b050 con 0x7f8644160b70 2023-12-02T01:29:46.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.105+0000 7f8640ff9640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f863006ae40 0x7f863006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.105+0000 7f8640ff9640 1 -- 172.21.15.1:0/2224509788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f863c0ab7f0 con 0x7f8644160b70 2023-12-02T01:29:46.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.105+0000 7f8643fff640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f863006ae40 0x7f863006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.106+0000 7f8643fff640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f863006ae40 0x7f863006d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8634009bc0 tx=0x7f8634008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:46.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.109+0000 7f8640ff9640 1 -- 172.21.15.1:0/2224509788 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86440b6b10 con 0x7f8644160b70 2023-12-02T01:29:46.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.324+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f86440a1150 con 0x7f8644160b70 2023-12-02T01:29:46.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.344+0000 7f8640ff9640 1 -- 172.21.15.1:0/2224509788 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f863c076820 con 0x7f8644160b70 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f863006ae40 msgr2=0x7f863006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f863006ae40 0x7f863006d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8634009bc0 tx=0x7f8634008040 comp rx=0 tx=0).stop 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8644160b70 msgr2=0x7f86440cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8644160b70 0x7f86440cc4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f863c009eb0 tx=0x7f863c004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 shutdown_connections 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8644160b70 0x7f86440cc4c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86440cef00 0x7f8644150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f863006ae40 0x7f863006d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 --2- 172.21.15.1:0/2224509788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86440b2aa0 0x7f86441f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 >> 172.21.15.1:0/2224509788 conn(0x7f864409c470 msgr2=0x7f86440b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 shutdown_connections 2023-12-02T01:29:46.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.346+0000 7f864a9d7640 1 -- 172.21.15.1:0/2224509788 wait complete. 2023-12-02T01:29:46.358 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-02T01:29:46.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-02T01:29:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.466+0000 7f482bbb6640 1 Processor -- start 2023-12-02T01:29:46.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.466+0000 7f482bbb6640 1 -- start start 2023-12-02T01:29:46.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f482bbb6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1980 0x7f48240cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f482bbb6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f482415d6c0 0x7f48240d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f482bbb6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48240d11d0 con 0x7f48240d1d60 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f482bbb6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48240ce2b0 con 0x7f482415d6c0 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f482bbb6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240ce590 con 0x7f48240d1980 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f4829952640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1980 0x7f48240cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f482a153640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f482415d6c0 0x7f48240d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f4829952640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1980 0x7f48240cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42000/0 (socket says 172.21.15.1:42000) 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f4829952640 1 -- 172.21.15.1:0/3638889418 learned_addr learned my addr 172.21.15.1:0/3638889418 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f4829952640 1 -- 172.21.15.1:0/3638889418 >> v2:172.21.15.167:3300/0 conn(0x7f482415d6c0 msgr2=0x7f48240d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f4829952640 1 --2- 172.21.15.1:0/3638889418 >> v2:172.21.15.167:3300/0 conn(0x7f482415d6c0 0x7f48240d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f4829952640 1 -- 172.21.15.1:0/3638889418 >> v1:172.21.15.167:6789/0 conn(0x7f48240d1d60 legacy=0x7f482415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f4829952640 1 -- 172.21.15.1:0/3638889418 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48240ce870 con 0x7f48240d1980 2023-12-02T01:29:46.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.467+0000 7f482a153640 1 --2- 172.21.15.1:0/3638889418 >> v2:172.21.15.167:3300/0 conn(0x7f482415d6c0 0x7f48240d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:46.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.468+0000 7f4829952640 1 --2- 172.21.15.1:0/3638889418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1980 0x7f48240cdc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4820009870 tx=0x7f482002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44853467f87db95 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:46.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.468+0000 7f4828950640 1 -- 172.21.15.1:0/3638889418 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820031640 con 0x7f48240d1980 2023-12-02T01:29:46.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.468+0000 7f4828950640 1 -- 172.21.15.1:0/3638889418 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48200317a0 con 0x7f48240d1980 2023-12-02T01:29:46.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.468+0000 7f4828950640 1 -- 172.21.15.1:0/3638889418 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820031b30 con 0x7f48240d1980 2023-12-02T01:29:46.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 -- 172.21.15.1:0/3638889418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1980 msgr2=0x7f48240cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 --2- 172.21.15.1:0/3638889418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1980 0x7f48240cdc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4820009870 tx=0x7f482002b8f0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 -- 172.21.15.1:0/3638889418 shutdown_connections 2023-12-02T01:29:46.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 --2- 172.21.15.1:0/3638889418 >> v2:172.21.15.167:3300/0 conn(0x7f482415d6c0 0x7f48240d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 --2- 172.21.15.1:0/3638889418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1980 0x7f48240cdc40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 -- 172.21.15.1:0/3638889418 >> 172.21.15.1:0/3638889418 conn(0x7f482409c470 msgr2=0x7f48240d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:46.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 -- 172.21.15.1:0/3638889418 shutdown_connections 2023-12-02T01:29:46.472 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.469+0000 7f482bbb6640 1 -- 172.21.15.1:0/3638889418 wait complete. 2023-12-02T01:29:46.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.470+0000 7f482bbb6640 1 Processor -- start 2023-12-02T01:29:46.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.470+0000 7f482bbb6640 1 -- start start 2023-12-02T01:29:46.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482bbb6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48240d1980 0x7f48240c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482bbb6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1d60 0x7f48241540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482bbb6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f482415d6c0 0x7f48241545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482bbb6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241f3240 con 0x7f48240d1980 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482bbb6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c8450 con 0x7f482415d6c0 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482bbb6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240c86f0 con 0x7f48240d1d60 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48240d1980 0x7f48240c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48240d1980 0x7f48240c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58278/0 (socket says 172.21.15.1:58278) 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 -- 172.21.15.1:0/209520651 learned_addr learned my addr 172.21.15.1:0/209520651 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 -- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1d60 msgr2=0x7f48241540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829151640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1d60 0x7f48241540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482a153640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f482415d6c0 0x7f48241545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1d60 0x7f48241540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 -- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f482415d6c0 msgr2=0x7f48241545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f482415d6c0 0x7f48241545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 -- 172.21.15.1:0/209520651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c009a70 con 0x7f48240d1980 2023-12-02T01:29:46.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829151640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1d60 0x7f48241540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f482a153640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f482415d6c0 0x7f48241545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f4829952640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48240d1980 0x7f48240c7f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4820000c00 tx=0x7f48200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f481a7fc640 1 -- 172.21.15.1:0/209520651 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482003a930 con 0x7f48240d1980 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.471+0000 7f481a7fc640 1 -- 172.21.15.1:0/209520651 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482003aa90 con 0x7f48240d1980 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.472+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48200094d0 con 0x7f48240d1980 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.472+0000 7f481a7fc640 1 -- 172.21.15.1:0/209520651 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482003ae40 con 0x7f48240d1980 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.472+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48240c8cb0 con 0x7f48240d1980 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.473+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48240d4070 con 0x7f48240d1980 2023-12-02T01:29:46.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.473+0000 7f481a7fc640 1 -- 172.21.15.1:0/209520651 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f482002f050 con 0x7f48240d1980 2023-12-02T01:29:46.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.473+0000 7f481a7fc640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:46.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.474+0000 7f4829151640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:46.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.474+0000 7f481a7fc640 1 -- 172.21.15.1:0/209520651 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48200ab3c0 con 0x7f48240d1980 2023-12-02T01:29:46.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.474+0000 7f4829151640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48240b9120 tx=0x7f4814009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:46.479 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.478+0000 7f481a7fc640 1 -- 172.21.15.1:0/209520651 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4820076470 con 0x7f48240d1980 2023-12-02T01:29:46.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:46.692+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f48240a10e0 con 0x7f48240d1980 2023-12-02T01:29:47.353 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.352+0000 7f481a7fc640 1 -- 172.21.15.1:0/209520651 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4820079a90 con 0x7f48240d1980 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 msgr2=0x7f480806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48240b9120 tx=0x7f4814009040 comp rx=0 tx=0).stop 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48240d1980 msgr2=0x7f48240c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48240d1980 0x7f48240c7f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4820000c00 tx=0x7f48200046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 shutdown_connections 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f482415d6c0 0x7f48241545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48240d1d60 0x7f48241540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 --2- 172.21.15.1:0/209520651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48240d1980 0x7f48240c7f10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 >> 172.21.15.1:0/209520651 conn(0x7f482409c470 msgr2=0x7f482406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 shutdown_connections 2023-12-02T01:29:47.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.356+0000 7f482bbb6640 1 -- 172.21.15.1:0/209520651 wait complete. 2023-12-02T01:29:47.371 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-02T01:29:47.372 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:29:47.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.484+0000 7fe9cc6d0640 1 Processor -- start 2023-12-02T01:29:47.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.485+0000 7fe9cc6d0640 1 -- start start 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.485+0000 7fe9cc6d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe9c40b0cb0 0x7fe9c40b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.485+0000 7fe9cc6d0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c40b3250 con 0x7fe9c415b270 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.485+0000 7fe9cc6d0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c40b1270 con 0x7fe9c40b2e50 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.485+0000 7fe9cc6d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40cbb50 con 0x7fe9c40b0cb0 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9ca46c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe9c415b270 0x7fe9c40ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45050/0 (socket says 172.21.15.1:45050) 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9ca46c640 1 -- 172.21.15.1:0/1669671361 learned_addr learned my addr 172.21.15.1:0/1669671361 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372333160 0 0) 0x7fe9c40b3250 con 0x7fe9c415b270 2023-12-02T01:29:47.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9ac003520 con 0x7fe9c415b270 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c9c6b640 1 --2- 172.21.15.1:0/1669671361 >> v2:172.21.15.167:3300/0 conn(0x7fe9c40b0cb0 0x7fe9c40b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2345375969 0 0) 0x7fe9ac003520 con 0x7fe9c415b270 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 >> v2:172.21.15.167:3300/0 conn(0x7fe9c40b0cb0 msgr2=0x7fe9c40b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 --2- 172.21.15.1:0/1669671361 >> v2:172.21.15.167:3300/0 conn(0x7fe9c40b0cb0 0x7fe9c40b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 >> v1:172.21.15.167:6789/0 conn(0x7fe9c40b2e50 legacy=0x7fe9c40cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40b1550 con 0x7fe9c415b270 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fe9bc001670 con 0x7fe9c415b270 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 >> v1:172.21.15.1:6789/0 conn(0x7fe9c415b270 legacy=0x7fe9c40ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ac003970 0x7fe9ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0047c0 0x7fe9ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40cbb50 con 0x7fe9ac0052a0 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac00c170 con 0x7fe9ac003970 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac00c330 con 0x7fe9ac0047c0 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9cac6d640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9ca46c640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ac003970 0x7fe9ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.486+0000 7fe9c9c6b640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0047c0 0x7fe9ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.487+0000 7fe9cac6d640 1 -- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0047c0 msgr2=0x7fe9ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.487+0000 7fe9cac6d640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0047c0 0x7fe9ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.487+0000 7fe9cac6d640 1 -- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ac003970 msgr2=0x7fe9ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.487+0000 7fe9cac6d640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9ac003970 0x7fe9ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.487+0000 7fe9cac6d640 1 -- 172.21.15.1:0/1669671361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac003520 con 0x7fe9ac0052a0 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.487+0000 7fe9cac6d640 1 -- 172.21.15.1:0/1669671361 reap_dead start 2023-12-02T01:29:47.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.487+0000 7fe9cac6d640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4001e20 tx=0x7fe9ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6f2ccffc13bfb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:47.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4003b70 con 0x7fe9ac0052a0 2023-12-02T01:29:47.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4003cd0 con 0x7fe9ac0052a0 2023-12-02T01:29:47.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9c946a640 1 -- 172.21.15.1:0/1669671361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4005310 con 0x7fe9ac0052a0 2023-12-02T01:29:47.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/1669671361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ac0052a0 msgr2=0x7fe9ac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4001e20 tx=0x7fe9ac0057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/1669671361 shutdown_connections 2023-12-02T01:29:47.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/1669671361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/1669671361 >> 172.21.15.1:0/1669671361 conn(0x7fe9c40d0f60 msgr2=0x7fe9c40d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:47.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/1669671361 shutdown_connections 2023-12-02T01:29:47.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.488+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/1669671361 wait complete. 2023-12-02T01:29:47.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.489+0000 7fe9cc6d0640 1 Processor -- start 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9cc6d0640 1 -- start start 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9cc6d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0052a0 0x7fe9c41f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9cc6d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c40c69c0 0x7fe9c40b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9cc6d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c40c5ae0 0x7fe9c40b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9cc6d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c4157da0 con 0x7fe9c40c69c0 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9cc6d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c41f2e80 con 0x7fe9c40c5ae0 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9cc6d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40c6f00 con 0x7fe9ac0052a0 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9c9c6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c40c69c0 0x7fe9c40b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9c9c6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c40c69c0 0x7fe9c40b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58294/0 (socket says 172.21.15.1:58294) 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.490+0000 7fe9c9c6b640 1 -- 172.21.15.1:0/3052451889 learned_addr learned my addr 172.21.15.1:0/3052451889 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9ca46c640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0052a0 0x7fe9c41f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9cac6d640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c40c5ae0 0x7fe9c40b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c9c6b640 1 -- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0052a0 msgr2=0x7fe9c41f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c9c6b640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0052a0 0x7fe9c41f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c9c6b640 1 -- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c40c5ae0 msgr2=0x7fe9c40b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c9c6b640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c40c5ae0 0x7fe9c40b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c9c6b640 1 -- 172.21.15.1:0/3052451889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40c71e0 con 0x7fe9c40c69c0 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c9c6b640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c40c69c0 0x7fe9c40b4a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800b7c0 tx=0x7fe9b800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c2ffd640 1 -- 172.21.15.1:0/3052451889 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80107d0 con 0x7fe9c40c69c0 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c2ffd640 1 -- 172.21.15.1:0/3052451889 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8010930 con 0x7fe9c40c69c0 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c40c74c0 con 0x7fe9c40c69c0 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9c2ffd640 1 -- 172.21.15.1:0/3052451889 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8010cc0 con 0x7fe9c40c69c0 2023-12-02T01:29:47.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.491+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c40b3eb0 con 0x7fe9c40c69c0 2023-12-02T01:29:47.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.492+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c40c7700 con 0x7fe9c40c69c0 2023-12-02T01:29:47.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.493+0000 7fe9c2ffd640 1 -- 172.21.15.1:0/3052451889 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9b8014430 con 0x7fe9c40c69c0 2023-12-02T01:29:47.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.493+0000 7fe9c2ffd640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe9b006ae70 0x7fe9b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.493+0000 7fe9c2ffd640 1 -- 172.21.15.1:0/3052451889 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9b8089a90 con 0x7fe9c40c69c0 2023-12-02T01:29:47.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.493+0000 7fe9ca46c640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe9b006ae70 0x7fe9b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.494+0000 7fe9ca46c640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe9b006ae70 0x7fe9b006d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000f60 tx=0x7fe9bc000ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:47.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.497+0000 7fe9c2ffd640 1 -- 172.21.15.1:0/3052451889 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9b8054bf0 con 0x7fe9c40c69c0 2023-12-02T01:29:47.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.708+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9c4068470 con 0x7fe9c40c69c0 2023-12-02T01:29:47.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.709+0000 7fe9c2ffd640 1 -- 172.21.15.1:0/3052451889 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fe9b8022020 con 0x7fe9c40c69c0 2023-12-02T01:29:47.710 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:47.710 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:29:47.711 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:29:47.712 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe9b006ae70 msgr2=0x7fe9b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe9b006ae70 0x7fe9b006d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000f60 tx=0x7fe9bc000ef0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c40c69c0 msgr2=0x7fe9c40b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c40c69c0 0x7fe9c40b4a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800b7c0 tx=0x7fe9b800bbc0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 shutdown_connections 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe9b006ae70 0x7fe9b006d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c40c5ae0 0x7fe9c40b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c40c69c0 0x7fe9c40b4a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 --2- 172.21.15.1:0/3052451889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9ac0052a0 0x7fe9c41f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 >> 172.21.15.1:0/3052451889 conn(0x7fe9c40d0f60 msgr2=0x7fe9c40afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 shutdown_connections 2023-12-02T01:29:47.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.711+0000 7fe9cc6d0640 1 -- 172.21.15.1:0/3052451889 wait complete. 2023-12-02T01:29:47.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:47.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.827+0000 7f841bc90640 1 Processor -- start 2023-12-02T01:29:47.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.827+0000 7f841bc90640 1 -- start start 2023-12-02T01:29:47.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f841bc90640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f84140d1720 0x7f84140d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f841bc90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f84140b3db0 0x7f84140b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f841bc90640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84140b5f90 con 0x7f841415d3e0 2023-12-02T01:29:47.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f841bc90640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84140d20a0 con 0x7f84140d1720 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f841bc90640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84140b61e0 con 0x7f84140b3db0 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f8419a2c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f841415d3e0 0x7f84140ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45066/0 (socket says 172.21.15.1:45066) 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f8419a2c640 1 -- 172.21.15.1:0/4121253293 learned_addr learned my addr 172.21.15.1:0/4121253293 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.828+0000 7f841922b640 1 --2- 172.21.15.1:0/4121253293 >> v2:172.21.15.1:3300/0 conn(0x7f84140d1720 0x7f84140d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f8418a2a640 1 -- 172.21.15.1:0/4121253293 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993880636 0 0) 0x7f84140b5f90 con 0x7f841415d3e0 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f8418a2a640 1 -- 172.21.15.1:0/4121253293 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83fc003520 con 0x7f841415d3e0 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f841a22d640 1 --2- 172.21.15.1:0/4121253293 >> v2:172.21.15.167:3300/0 conn(0x7f84140b3db0 0x7f84140b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f841922b640 1 -- 172.21.15.1:0/4121253293 >> v2:172.21.15.167:3300/0 conn(0x7f84140b3db0 msgr2=0x7f84140b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f841922b640 1 --2- 172.21.15.1:0/4121253293 >> v2:172.21.15.167:3300/0 conn(0x7f84140b3db0 0x7f84140b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f841922b640 1 -- 172.21.15.1:0/4121253293 >> v1:172.21.15.1:6789/0 conn(0x7f841415d3e0 legacy=0x7f84140ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f841922b640 1 -- 172.21.15.1:0/4121253293 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140b64c0 con 0x7f84140d1720 2023-12-02T01:29:47.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f841a22d640 1 --2- 172.21.15.1:0/4121253293 >> v2:172.21.15.167:3300/0 conn(0x7f84140b3db0 0x7f84140b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.829+0000 7f841922b640 1 --2- 172.21.15.1:0/4121253293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140d1720 0x7f84140d1b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f84140cdc30 tx=0x7f840802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff1a958c586e484 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f8418a2a640 1 -- 172.21.15.1:0/4121253293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408031830 con 0x7f84140d1720 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f8418a2a640 1 -- 172.21.15.1:0/4121253293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408031990 con 0x7f84140d1720 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f8418a2a640 1 -- 172.21.15.1:0/4121253293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408031d00 con 0x7f84140d1720 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 -- 172.21.15.1:0/4121253293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140d1720 msgr2=0x7f84140d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 --2- 172.21.15.1:0/4121253293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140d1720 0x7f84140d1b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f84140cdc30 tx=0x7f840802b8d0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 -- 172.21.15.1:0/4121253293 shutdown_connections 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 --2- 172.21.15.1:0/4121253293 >> v2:172.21.15.167:3300/0 conn(0x7f84140b3db0 0x7f84140b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 --2- 172.21.15.1:0/4121253293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140d1720 0x7f84140d1b60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 -- 172.21.15.1:0/4121253293 >> 172.21.15.1:0/4121253293 conn(0x7f841409c480 msgr2=0x7f84140d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 -- 172.21.15.1:0/4121253293 shutdown_connections 2023-12-02T01:29:47.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.830+0000 7f841bc90640 1 -- 172.21.15.1:0/4121253293 wait complete. 2023-12-02T01:29:47.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.831+0000 7f841bc90640 1 Processor -- start 2023-12-02T01:29:47.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.831+0000 7f841bc90640 1 -- start start 2023-12-02T01:29:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841bc90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140b3db0 0x7f8414159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841bc90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84140d1720 0x7f84141577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841bc90640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f841415d3e0 0x7f8414156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841bc90640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8414157ed0 con 0x7f84140b3db0 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841bc90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8414156e50 con 0x7f84140d1720 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841bc90640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84140cb590 con 0x7f841415d3e0 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f8419a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140b3db0 0x7f8414159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f8419a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140b3db0 0x7f8414159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58320/0 (socket says 172.21.15.1:58320) 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f8419a2c640 1 -- 172.21.15.1:0/4279823525 learned_addr learned my addr 172.21.15.1:0/4279823525 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841a22d640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f841415d3e0 0x7f8414156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.832+0000 7f841922b640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84140d1720 0x7f84141577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f8419a2c640 1 -- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f841415d3e0 msgr2=0x7f8414156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f8419a2c640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f841415d3e0 0x7f8414156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f8419a2c640 1 -- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84140d1720 msgr2=0x7f84141577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f8419a2c640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84140d1720 0x7f84141577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f8419a2c640 1 -- 172.21.15.1:0/4279823525 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408009400 con 0x7f84140b3db0 2023-12-02T01:29:47.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f841922b640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84140d1720 0x7f84141577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f8419a2c640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140b3db0 0x7f8414159df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f840400cb40 tx=0x7f840400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f84127fc640 1 -- 172.21.15.1:0/4279823525 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840400aca0 con 0x7f84140b3db0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f84127fc640 1 -- 172.21.15.1:0/4279823525 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840400ae00 con 0x7f84140b3db0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84141f2dd0 con 0x7f84140b3db0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f84127fc640 1 -- 172.21.15.1:0/4279823525 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404012620 con 0x7f84140b3db0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.833+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84141570a0 con 0x7f84140b3db0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.834+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8414067420 con 0x7f84140b3db0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.834+0000 7f84127fc640 1 -- 172.21.15.1:0/4279823525 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8404007070 con 0x7f84140b3db0 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.835+0000 7f84127fc640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f840006ae40 0x7f840006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:47.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.835+0000 7f84127fc640 1 -- 172.21.15.1:0/4279823525 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8404089660 con 0x7f84140b3db0 2023-12-02T01:29:47.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.835+0000 7f841922b640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f840006ae40 0x7f840006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:47.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.835+0000 7f841922b640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f840006ae40 0x7f840006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8408036000 tx=0x7f8408008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:47.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:47.839+0000 7f84127fc640 1 -- 172.21.15.1:0/4279823525 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8404054710 con 0x7f84140b3db0 2023-12-02T01:29:48.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.016+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84140d1500 con 0x7f84140b3db0 2023-12-02T01:29:48.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.017+0000 7f84127fc640 1 -- 172.21.15.1:0/4279823525 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f8404017090 con 0x7f84140b3db0 2023-12-02T01:29:48.019 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:48.019 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f840006ae40 msgr2=0x7f840006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f840006ae40 0x7f840006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8408036000 tx=0x7f8408008030 comp rx=0 tx=0).stop 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140b3db0 msgr2=0x7f8414159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140b3db0 0x7f8414159df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f840400cb40 tx=0x7f840400a060 comp rx=0 tx=0).stop 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 shutdown_connections 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f841415d3e0 0x7f8414156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f840006ae40 0x7f840006d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84140d1720 0x7f84141577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 --2- 172.21.15.1:0/4279823525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84140b3db0 0x7f8414159df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 >> 172.21.15.1:0/4279823525 conn(0x7f841409c480 msgr2=0x7f84140d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:48.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 shutdown_connections 2023-12-02T01:29:48.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.019+0000 7f841bc90640 1 -- 172.21.15.1:0/4279823525 wait complete. 2023-12-02T01:29:48.031 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-02T01:29:48.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-02T01:29:48.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.136+0000 7f9df5a7c640 1 Processor -- start 2023-12-02T01:29:48.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.136+0000 7f9df5a7c640 1 -- start start 2023-12-02T01:29:48.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9df5a7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df015d460 0x7f9df00d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9df5a7c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9df00d2010 0x7f9df00d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9df5a7c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9df00d3620 0x7f9df00cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9df5a7c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df00d3ab0 con 0x7f9df00d2010 2023-12-02T01:29:48.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9df5a7c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df00cf260 con 0x7f9df00d3620 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9df5a7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00ceca0 con 0x7f9df015d460 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9df00d2010 0x7f9df00d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9df00d2010 0x7f9df00d30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58326/0 (socket says 172.21.15.1:58326) 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 -- 172.21.15.1:0/340245311 learned_addr learned my addr 172.21.15.1:0/340245311 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9def7fe640 1 --2- 172.21.15.1:0/340245311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df015d460 0x7f9df00d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deffff640 1 --2- 172.21.15.1:0/340245311 >> v2:172.21.15.167:3300/0 conn(0x7f9df00d3620 0x7f9df00cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 -- 172.21.15.1:0/340245311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df015d460 msgr2=0x7f9df00d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 --2- 172.21.15.1:0/340245311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df015d460 0x7f9df00d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 -- 172.21.15.1:0/340245311 >> v2:172.21.15.167:3300/0 conn(0x7f9df00d3620 msgr2=0x7f9df00cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:48.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 --2- 172.21.15.1:0/340245311 >> v2:172.21.15.167:3300/0 conn(0x7f9df00d3620 0x7f9df00cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deeffd640 1 -- 172.21.15.1:0/340245311 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00cef80 con 0x7f9df00d2010 2023-12-02T01:29:48.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.137+0000 7f9deffff640 1 --2- 172.21.15.1:0/340245311 >> v2:172.21.15.167:3300/0 conn(0x7f9df00d3620 0x7f9df00cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:48.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.138+0000 7f9deeffd640 1 --2- 172.21.15.1:0/340245311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df00d30e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9df00b30a0 tx=0x7f9de402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3e89823e753d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.138+0000 7f9dee7fc640 1 -- 172.21.15.1:0/340245311 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4031870 con 0x7f9df00d2010 2023-12-02T01:29:48.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.138+0000 7f9dee7fc640 1 -- 172.21.15.1:0/340245311 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40319d0 con 0x7f9df00d2010 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.138+0000 7f9dee7fc640 1 -- 172.21.15.1:0/340245311 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4031d60 con 0x7f9df00d2010 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 -- 172.21.15.1:0/340245311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 msgr2=0x7f9df00d30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/340245311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df00d30e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9df00b30a0 tx=0x7f9de402b910 comp rx=0 tx=0).stop 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 -- 172.21.15.1:0/340245311 shutdown_connections 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/340245311 >> v2:172.21.15.167:3300/0 conn(0x7f9df00d3620 0x7f9df00cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/340245311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df00d30e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/340245311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df015d460 0x7f9df00d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 -- 172.21.15.1:0/340245311 >> 172.21.15.1:0/340245311 conn(0x7f9df008cb60 msgr2=0x7f9df009c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 -- 172.21.15.1:0/340245311 shutdown_connections 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.139+0000 7f9df5a7c640 1 -- 172.21.15.1:0/340245311 wait complete. 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.140+0000 7f9df5a7c640 1 Processor -- start 2023-12-02T01:29:48.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.140+0000 7f9df5a7c640 1 -- start start 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9df5a7c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df01f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9df5a7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df00d3620 0x7f9df0156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9df5a7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9df015d460 0x7f9df015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9df5a7c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df01f45b0 con 0x7f9df00d2010 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9df5a7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df01f3350 con 0x7f9df015d460 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9df5a7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0160460 con 0x7f9df00d3620 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df01f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df01f4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58334/0 (socket says 172.21.15.1:58334) 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 -- 172.21.15.1:0/665445817 learned_addr learned my addr 172.21.15.1:0/665445817 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9deffff640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9df015d460 0x7f9df015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 -- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df00d3620 msgr2=0x7f9df0156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9deeffd640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df00d3620 0x7f9df0156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df00d3620 0x7f9df0156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 -- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9df015d460 msgr2=0x7f9df015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9df015d460 0x7f9df015aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 -- 172.21.15.1:0/665445817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40094d0 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9deffff640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9df015d460 0x7f9df015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.141+0000 7f9def7fe640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df01f4070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e9e0 tx=0x7f9de000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.142+0000 7f9dd7fff640 1 -- 172.21.15.1:0/665445817 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0009670 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.142+0000 7f9dd7fff640 1 -- 172.21.15.1:0/665445817 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de000c970 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.142+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df01f3be0 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.142+0000 7f9dd7fff640 1 -- 172.21.15.1:0/665445817 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000cd20 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.142+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df01f3590 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.143+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df00cd360 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.143+0000 7f9dd7fff640 1 -- 172.21.15.1:0/665445817 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9de0013470 con 0x7f9df00d2010 2023-12-02T01:29:48.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.143+0000 7f9dd7fff640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9ddc06ae40 0x7f9ddc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.144+0000 7f9deeffd640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9ddc06ae40 0x7f9ddc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.144+0000 7f9dd7fff640 1 -- 172.21.15.1:0/665445817 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9de0089790 con 0x7f9df00d2010 2023-12-02T01:29:48.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.144+0000 7f9deeffd640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9ddc06ae40 0x7f9ddc06d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9de4036000 tx=0x7f9de403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.148+0000 7f9dd7fff640 1 -- 172.21.15.1:0/665445817 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9de00548d0 con 0x7f9df00d2010 2023-12-02T01:29:48.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.321+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 --> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9df00afde0 con 0x7f9ddc06ae40 2023-12-02T01:29:48.329 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.328+0000 7f9dd7fff640 1 -- 172.21.15.1:0/665445817 <== mgr.4110 v2:172.21.15.1:6832/1281506213 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249779 (secure 0 0 0) 0x7f9de403a420 con 0x7f9ddc06ae40 2023-12-02T01:29:48.332 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:48.333 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9ddc06ae40 msgr2=0x7f9ddc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9ddc06ae40 0x7f9ddc06d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9de4036000 tx=0x7f9de403c040 comp rx=0 tx=0).stop 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 msgr2=0x7f9df01f4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df01f4070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e9e0 tx=0x7f9de000eea0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 shutdown_connections 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9ddc06ae40 0x7f9ddc06d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9df015d460 0x7f9df015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9df00d3620 0x7f9df0156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 --2- 172.21.15.1:0/665445817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df00d2010 0x7f9df01f4070 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 >> 172.21.15.1:0/665445817 conn(0x7f9df008cb60 msgr2=0x7f9df006c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:48.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 shutdown_connections 2023-12-02T01:29:48.336 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.331+0000 7f9df5a7c640 1 -- 172.21.15.1:0/665445817 wait complete. 2023-12-02T01:29:48.343 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-02T01:29:46.632762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235884,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738836,"statfs":{"total":773094113280,"available":772852568064,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000708"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-02T01:29:35.479145+0000","last_change":"2023-12-02T01:29:33.915833+0000","last_active":"2023-12-02T01:29:35.479145+0000","last_peered":"2023-12-02T01:29:35.479145+0000","last_clean":"2023-12-02T01:29:35.479145+0000","last_became_active":"2023-12-02T01:29:33.915012+0000","last_became_peered":"2023-12-02T01:29:33.915012+0000","last_unstale":"2023-12-02T01:29:35.479145+0000","last_undegraded":"2023-12-02T01:29:35.479145+0000","last_fullsized":"2023-12-02T01:29:35.479145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_clean_scrub_stamp":"2023-12-02T01:29:32.688531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:25:40.082821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:44.328813+0000","last_change":"2023-12-02T01:29:44.328813+0000","last_active":"2023-12-02T01:29:44.328813+0000","last_peered":"2023-12-02T01:29:44.328813+0000","last_clean":"2023-12-02T01:29:44.328813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:44.328813+0000","last_undegraded":"2023-12-02T01:29:44.328813+0000","last_fullsized":"2023-12-02T01:29:44.328813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-02T01:29:43.322043+0000","last_change":"2023-12-02T01:29:43.322043+0000","last_active":"2023-12-02T01:29:43.322043+0000","last_peered":"2023-12-02T01:29:43.322043+0000","last_clean":"2023-12-02T01:29:43.322043+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-02T01:29:43.322043+0000","last_undegraded":"2023-12-02T01:29:43.322043+0000","last_fullsized":"2023-12-02T01:29:43.322043+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31332,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31332,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-02T01:29:48.348 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-02T01:29:48.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.489+0000 7f61ef9c9640 1 Processor -- start 2023-12-02T01:29:48.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.489+0000 7f61ef9c9640 1 -- start start 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ef9c9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f61e8160ab0 0x7f61e80afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ef9c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e80cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ef9c9640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e80cdd30 con 0x7f61e80d0030 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ef9c9640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e80ce2d0 con 0x7f61e8160ab0 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ef9c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80d0a90 con 0x7f61e80b2450 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ed765640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f61e8160ab0 0x7f61e80afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ed765640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f61e8160ab0 0x7f61e80afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58342/0 (socket says 172.21.15.1:58342) 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ed765640 1 -- 172.21.15.1:0/187354484 learned_addr learned my addr 172.21.15.1:0/187354484 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61edf66640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f61e80d0030 0x7f61e80d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45076/0 (socket says 172.21.15.1:45076) 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ed765640 1 -- 172.21.15.1:0/187354484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 msgr2=0x7f61e80cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ecf64640 1 --2- 172.21.15.1:0/187354484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e80cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ed765640 1 --2- 172.21.15.1:0/187354484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e80cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61dffff640 1 -- 172.21.15.1:0/187354484 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112755247 0 0) 0x7f61e80cdd30 con 0x7f61e80d0030 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ed765640 1 -- 172.21.15.1:0/187354484 >> v1:172.21.15.1:6789/0 conn(0x7f61e80d0030 legacy=0x7f61e80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ed765640 1 -- 172.21.15.1:0/187354484 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80b02f0 con 0x7f61e8160ab0 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.490+0000 7f61ecf64640 1 --2- 172.21.15.1:0/187354484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e80cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61ed765640 1 --2- 172.21.15.1:0/187354484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e80afdb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009870 tx=0x7f61e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42212bd397053011 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61dffff640 1 -- 172.21.15.1:0/187354484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4031640 con 0x7f61e8160ab0 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61dffff640 1 -- 172.21.15.1:0/187354484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e40317a0 con 0x7f61e8160ab0 2023-12-02T01:29:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61dffff640 1 -- 172.21.15.1:0/187354484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4031b30 con 0x7f61e8160ab0 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61ef9c9640 1 -- 172.21.15.1:0/187354484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 msgr2=0x7f61e80afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/187354484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e80afdb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009870 tx=0x7f61e402b8f0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61ef9c9640 1 -- 172.21.15.1:0/187354484 shutdown_connections 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/187354484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e80cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.491+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/187354484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e80afdb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.492+0000 7f61ef9c9640 1 -- 172.21.15.1:0/187354484 >> 172.21.15.1:0/187354484 conn(0x7f61e809c450 msgr2=0x7f61e80d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.492+0000 7f61ef9c9640 1 -- 172.21.15.1:0/187354484 shutdown_connections 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.492+0000 7f61ef9c9640 1 -- 172.21.15.1:0/187354484 wait complete. 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.493+0000 7f61ef9c9640 1 Processor -- start 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.493+0000 7f61ef9c9640 1 -- start start 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ef9c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e8158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ef9c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e80d0030 0x7f61e81613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ef9c9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e81618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ef9c9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8158bc0 con 0x7f61e8160ab0 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ef9c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80b5c20 con 0x7f61e80d0030 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ef9c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80b5ec0 con 0x7f61e80b2450 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e81618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e81618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58350/0 (socket says 172.21.15.1:58350) 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 -- 172.21.15.1:0/911896748 learned_addr learned my addr 172.21.15.1:0/911896748 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ed765640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e8158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ecf64640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e80d0030 0x7f61e81613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 -- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 msgr2=0x7f61e8158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e8158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 -- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e80d0030 msgr2=0x7f61e81613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e80d0030 0x7f61e81613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 -- 172.21.15.1:0/911896748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40094d0 con 0x7f61e8160ab0 2023-12-02T01:29:48.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61edf66640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e81618e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61e0001560 tx=0x7f61e000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ddffb640 1 -- 172.21.15.1:0/911896748 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000a640 con 0x7f61e8160ab0 2023-12-02T01:29:48.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ddffb640 1 -- 172.21.15.1:0/911896748 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000a7a0 con 0x7f61e8160ab0 2023-12-02T01:29:48.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e80b61a0 con 0x7f61e8160ab0 2023-12-02T01:29:48.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.494+0000 7f61ddffb640 1 -- 172.21.15.1:0/911896748 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000ab30 con 0x7f61e8160ab0 2023-12-02T01:29:48.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.495+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e80b6760 con 0x7f61e8160ab0 2023-12-02T01:29:48.501 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.496+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e8067420 con 0x7f61e8160ab0 2023-12-02T01:29:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.496+0000 7f61ddffb640 1 -- 172.21.15.1:0/911896748 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61e000ac90 con 0x7f61e8160ab0 2023-12-02T01:29:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.496+0000 7f61ddffb640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61cc06ae40 0x7f61cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.496+0000 7f61ddffb640 1 -- 172.21.15.1:0/911896748 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61e0088da0 con 0x7f61e8160ab0 2023-12-02T01:29:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.496+0000 7f61ed765640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61cc06ae40 0x7f61cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.497+0000 7f61ed765640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61cc06ae40 0x7f61cc06d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61e4036000 tx=0x7f61e403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.500+0000 7f61ddffb640 1 -- 172.21.15.1:0/911896748 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61e0053f00 con 0x7f61e8160ab0 2023-12-02T01:29:48.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.672+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 --> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61e80cdf60 con 0x7f61cc06ae40 2023-12-02T01:29:48.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.679+0000 7f61ddffb640 1 -- 172.21.15.1:0/911896748 <== mgr.4110 v2:172.21.15.1:6832/1281506213 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264625 (secure 0 0 0) 0x7f61e4031ae0 con 0x7f61cc06ae40 2023-12-02T01:29:48.683 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:48.684 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61cc06ae40 msgr2=0x7f61cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61cc06ae40 0x7f61cc06d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61e4036000 tx=0x7f61e403c040 comp rx=0 tx=0).stop 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 msgr2=0x7f61e81618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e81618e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61e0001560 tx=0x7f61e000cc70 comp rx=0 tx=0).stop 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 shutdown_connections 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61e8160ab0 0x7f61e81618e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61cc06ae40 0x7f61cc06d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61e80d0030 0x7f61e81613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 --2- 172.21.15.1:0/911896748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61e80b2450 0x7f61e8158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 >> 172.21.15.1:0/911896748 conn(0x7f61e809c450 msgr2=0x7f61e806b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:48.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 shutdown_connections 2023-12-02T01:29:48.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.682+0000 7f61ef9c9640 1 -- 172.21.15.1:0/911896748 wait complete. 2023-12-02T01:29:48.694 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-02T01:29:48.633163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235556,"kb_used_data":2740,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739164,"statfs":{"total":773094113280,"available":772852903936,"internally_reserved":0,"allocated":2805760,"data_stored":1708736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.303847"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.292927+0000","last_change":"2023-12-02T01:29:45.289065+0000","last_active":"2023-12-02T01:29:45.292927+0000","last_peered":"2023-12-02T01:29:45.292927+0000","last_clean":"2023-12-02T01:29:45.292927+0000","last_became_active":"2023-12-02T01:29:45.288799+0000","last_became_peered":"2023-12-02T01:29:45.288799+0000","last_unstale":"2023-12-02T01:29:45.292927+0000","last_undegraded":"2023-12-02T01:29:45.292927+0000","last_fullsized":"2023-12-02T01:29:45.292927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278772+0000","last_change":"2023-12-02T01:29:45.287280+0000","last_active":"2023-12-02T01:29:46.278772+0000","last_peered":"2023-12-02T01:29:46.278772+0000","last_clean":"2023-12-02T01:29:46.278772+0000","last_became_active":"2023-12-02T01:29:45.286996+0000","last_became_peered":"2023-12-02T01:29:45.286996+0000","last_unstale":"2023-12-02T01:29:46.278772+0000","last_undegraded":"2023-12-02T01:29:46.278772+0000","last_fullsized":"2023-12-02T01:29:46.278772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504640+0000","last_change":"2023-12-02T01:29:45.281765+0000","last_active":"2023-12-02T01:29:46.504640+0000","last_peered":"2023-12-02T01:29:46.504640+0000","last_clean":"2023-12-02T01:29:46.504640+0000","last_became_active":"2023-12-02T01:29:45.281451+0000","last_became_peered":"2023-12-02T01:29:45.281451+0000","last_unstale":"2023-12-02T01:29:46.504640+0000","last_undegraded":"2023-12-02T01:29:46.504640+0000","last_fullsized":"2023-12-02T01:29:46.504640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301831+0000","last_change":"2023-12-02T01:29:45.297982+0000","last_active":"2023-12-02T01:29:45.301831+0000","last_peered":"2023-12-02T01:29:45.301831+0000","last_clean":"2023-12-02T01:29:45.301831+0000","last_became_active":"2023-12-02T01:29:45.297711+0000","last_became_peered":"2023-12-02T01:29:45.297711+0000","last_unstale":"2023-12-02T01:29:45.301831+0000","last_undegraded":"2023-12-02T01:29:45.301831+0000","last_fullsized":"2023-12-02T01:29:45.301831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297259+0000","last_change":"2023-12-02T01:29:45.293266+0000","last_active":"2023-12-02T01:29:45.297259+0000","last_peered":"2023-12-02T01:29:45.297259+0000","last_clean":"2023-12-02T01:29:45.297259+0000","last_became_active":"2023-12-02T01:29:45.292952+0000","last_became_peered":"2023-12-02T01:29:45.292952+0000","last_unstale":"2023-12-02T01:29:45.297259+0000","last_undegraded":"2023-12-02T01:29:45.297259+0000","last_fullsized":"2023-12-02T01:29:45.297259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:28.529390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301279+0000","last_change":"2023-12-02T01:29:45.296193+0000","last_active":"2023-12-02T01:29:45.301279+0000","last_peered":"2023-12-02T01:29:45.301279+0000","last_clean":"2023-12-02T01:29:45.301279+0000","last_became_active":"2023-12-02T01:29:45.295761+0000","last_became_peered":"2023-12-02T01:29:45.295761+0000","last_unstale":"2023-12-02T01:29:45.301279+0000","last_undegraded":"2023-12-02T01:29:45.301279+0000","last_fullsized":"2023-12-02T01:29:45.301279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.293685+0000","last_change":"2023-12-02T01:29:45.291904+0000","last_active":"2023-12-02T01:29:45.293685+0000","last_peered":"2023-12-02T01:29:45.293685+0000","last_clean":"2023-12-02T01:29:45.293685+0000","last_became_active":"2023-12-02T01:29:45.291616+0000","last_became_peered":"2023-12-02T01:29:45.291616+0000","last_unstale":"2023-12-02T01:29:45.293685+0000","last_undegraded":"2023-12-02T01:29:45.293685+0000","last_fullsized":"2023-12-02T01:29:45.293685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297741+0000","last_change":"2023-12-02T01:29:45.296142+0000","last_active":"2023-12-02T01:29:45.297741+0000","last_peered":"2023-12-02T01:29:45.297741+0000","last_clean":"2023-12-02T01:29:45.297741+0000","last_became_active":"2023-12-02T01:29:45.295778+0000","last_became_peered":"2023-12-02T01:29:45.295778+0000","last_unstale":"2023-12-02T01:29:45.297741+0000","last_undegraded":"2023-12-02T01:29:45.297741+0000","last_fullsized":"2023-12-02T01:29:45.297741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:21.086467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.306721+0000","last_change":"2023-12-02T01:29:45.299688+0000","last_active":"2023-12-02T01:29:45.306721+0000","last_peered":"2023-12-02T01:29:45.306721+0000","last_clean":"2023-12-02T01:29:45.306721+0000","last_became_active":"2023-12-02T01:29:45.299362+0000","last_became_peered":"2023-12-02T01:29:45.299362+0000","last_unstale":"2023-12-02T01:29:45.306721+0000","last_undegraded":"2023-12-02T01:29:45.306721+0000","last_fullsized":"2023-12-02T01:29:45.306721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.295552+0000","last_change":"2023-12-02T01:29:45.294653+0000","last_active":"2023-12-02T01:29:45.295552+0000","last_peered":"2023-12-02T01:29:45.295552+0000","last_clean":"2023-12-02T01:29:45.295552+0000","last_became_active":"2023-12-02T01:29:45.294403+0000","last_became_peered":"2023-12-02T01:29:45.294403+0000","last_unstale":"2023-12-02T01:29:45.295552+0000","last_undegraded":"2023-12-02T01:29:45.295552+0000","last_fullsized":"2023-12-02T01:29:45.295552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:28.529390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.298698+0000","last_change":"2023-12-02T01:29:45.296336+0000","last_active":"2023-12-02T01:29:45.298698+0000","last_peered":"2023-12-02T01:29:45.298698+0000","last_clean":"2023-12-02T01:29:45.298698+0000","last_became_active":"2023-12-02T01:29:45.296065+0000","last_became_peered":"2023-12-02T01:29:45.296065+0000","last_unstale":"2023-12-02T01:29:45.298698+0000","last_undegraded":"2023-12-02T01:29:45.298698+0000","last_fullsized":"2023-12-02T01:29:45.298698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:14.502767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279488+0000","last_change":"2023-12-02T01:29:45.289558+0000","last_active":"2023-12-02T01:29:46.279488+0000","last_peered":"2023-12-02T01:29:46.279488+0000","last_clean":"2023-12-02T01:29:46.279488+0000","last_became_active":"2023-12-02T01:29:45.289116+0000","last_became_peered":"2023-12-02T01:29:45.289116+0000","last_unstale":"2023-12-02T01:29:46.279488+0000","last_undegraded":"2023-12-02T01:29:46.279488+0000","last_fullsized":"2023-12-02T01:29:46.279488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:28.529390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.291805+0000","last_change":"2023-12-02T01:29:45.288300+0000","last_active":"2023-12-02T01:29:45.291805+0000","last_peered":"2023-12-02T01:29:45.291805+0000","last_clean":"2023-12-02T01:29:45.291805+0000","last_became_active":"2023-12-02T01:29:45.288019+0000","last_became_peered":"2023-12-02T01:29:45.288019+0000","last_unstale":"2023-12-02T01:29:45.291805+0000","last_undegraded":"2023-12-02T01:29:45.291805+0000","last_fullsized":"2023-12-02T01:29:45.291805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504355+0000","last_change":"2023-12-02T01:29:45.288371+0000","last_active":"2023-12-02T01:29:46.504355+0000","last_peered":"2023-12-02T01:29:46.504355+0000","last_clean":"2023-12-02T01:29:46.504355+0000","last_became_active":"2023-12-02T01:29:45.288048+0000","last_became_peered":"2023-12-02T01:29:45.288048+0000","last_unstale":"2023-12-02T01:29:46.504355+0000","last_undegraded":"2023-12-02T01:29:46.504355+0000","last_fullsized":"2023-12-02T01:29:46.504355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278590+0000","last_change":"2023-12-02T01:29:45.297919+0000","last_active":"2023-12-02T01:29:46.278590+0000","last_peered":"2023-12-02T01:29:46.278590+0000","last_clean":"2023-12-02T01:29:46.278590+0000","last_became_active":"2023-12-02T01:29:45.297629+0000","last_became_peered":"2023-12-02T01:29:45.297629+0000","last_unstale":"2023-12-02T01:29:46.278590+0000","last_undegraded":"2023-12-02T01:29:46.278590+0000","last_fullsized":"2023-12-02T01:29:46.278590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.296443+0000","last_change":"2023-12-02T01:29:45.291354+0000","last_active":"2023-12-02T01:29:45.296443+0000","last_peered":"2023-12-02T01:29:45.296443+0000","last_clean":"2023-12-02T01:29:45.296443+0000","last_became_active":"2023-12-02T01:29:45.290958+0000","last_became_peered":"2023-12-02T01:29:45.290958+0000","last_unstale":"2023-12-02T01:29:45.296443+0000","last_undegraded":"2023-12-02T01:29:45.296443+0000","last_fullsized":"2023-12-02T01:29:45.296443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:25:32.660539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301849+0000","last_change":"2023-12-02T01:29:45.299054+0000","last_active":"2023-12-02T01:29:45.301849+0000","last_peered":"2023-12-02T01:29:45.301849+0000","last_clean":"2023-12-02T01:29:45.301849+0000","last_became_active":"2023-12-02T01:29:45.298788+0000","last_became_peered":"2023-12-02T01:29:45.298788+0000","last_unstale":"2023-12-02T01:29:45.301849+0000","last_undegraded":"2023-12-02T01:29:45.301849+0000","last_fullsized":"2023-12-02T01:29:45.301849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:57.885160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277543+0000","last_change":"2023-12-02T01:29:45.285978+0000","last_active":"2023-12-02T01:29:46.277543+0000","last_peered":"2023-12-02T01:29:46.277543+0000","last_clean":"2023-12-02T01:29:46.277543+0000","last_became_active":"2023-12-02T01:29:45.285621+0000","last_became_peered":"2023-12-02T01:29:45.285621+0000","last_unstale":"2023-12-02T01:29:46.277543+0000","last_undegraded":"2023-12-02T01:29:46.277543+0000","last_fullsized":"2023-12-02T01:29:46.277543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:15.348786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.298057+0000","last_change":"2023-12-02T01:29:45.293553+0000","last_active":"2023-12-02T01:29:45.298057+0000","last_peered":"2023-12-02T01:29:45.298057+0000","last_clean":"2023-12-02T01:29:45.298057+0000","last_became_active":"2023-12-02T01:29:45.292966+0000","last_became_peered":"2023-12-02T01:29:45.292966+0000","last_unstale":"2023-12-02T01:29:45.298057+0000","last_undegraded":"2023-12-02T01:29:45.298057+0000","last_fullsized":"2023-12-02T01:29:45.298057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:07.658204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.293697+0000","last_change":"2023-12-02T01:29:45.291596+0000","last_active":"2023-12-02T01:29:45.293697+0000","last_peered":"2023-12-02T01:29:45.293697+0000","last_clean":"2023-12-02T01:29:45.293697+0000","last_became_active":"2023-12-02T01:29:45.291340+0000","last_became_peered":"2023-12-02T01:29:45.291340+0000","last_unstale":"2023-12-02T01:29:45.293697+0000","last_undegraded":"2023-12-02T01:29:45.293697+0000","last_fullsized":"2023-12-02T01:29:45.293697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:36.271732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504467+0000","last_change":"2023-12-02T01:29:45.289467+0000","last_active":"2023-12-02T01:29:46.504467+0000","last_peered":"2023-12-02T01:29:46.504467+0000","last_clean":"2023-12-02T01:29:46.504467+0000","last_became_active":"2023-12-02T01:29:45.289182+0000","last_became_peered":"2023-12-02T01:29:45.289182+0000","last_unstale":"2023-12-02T01:29:46.504467+0000","last_undegraded":"2023-12-02T01:29:46.504467+0000","last_fullsized":"2023-12-02T01:29:46.504467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301935+0000","last_change":"2023-12-02T01:29:45.300021+0000","last_active":"2023-12-02T01:29:45.301935+0000","last_peered":"2023-12-02T01:29:45.301935+0000","last_clean":"2023-12-02T01:29:45.301935+0000","last_became_active":"2023-12-02T01:29:45.299751+0000","last_became_peered":"2023-12-02T01:29:45.299751+0000","last_unstale":"2023-12-02T01:29:45.301935+0000","last_undegraded":"2023-12-02T01:29:45.301935+0000","last_fullsized":"2023-12-02T01:29:45.301935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:55.160149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.296804+0000","last_change":"2023-12-02T01:29:45.292603+0000","last_active":"2023-12-02T01:29:45.296804+0000","last_peered":"2023-12-02T01:29:45.296804+0000","last_clean":"2023-12-02T01:29:45.296804+0000","last_became_active":"2023-12-02T01:29:45.292325+0000","last_became_peered":"2023-12-02T01:29:45.292325+0000","last_unstale":"2023-12-02T01:29:45.296804+0000","last_undegraded":"2023-12-02T01:29:45.296804+0000","last_fullsized":"2023-12-02T01:29:45.296804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:25:32.660539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297646+0000","last_change":"2023-12-02T01:29:45.294653+0000","last_active":"2023-12-02T01:29:45.297646+0000","last_peered":"2023-12-02T01:29:45.297646+0000","last_clean":"2023-12-02T01:29:45.297646+0000","last_became_active":"2023-12-02T01:29:45.294371+0000","last_became_peered":"2023-12-02T01:29:45.294371+0000","last_unstale":"2023-12-02T01:29:45.297646+0000","last_undegraded":"2023-12-02T01:29:45.297646+0000","last_fullsized":"2023-12-02T01:29:45.297646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:56:21.607912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.296820+0000","last_change":"2023-12-02T01:29:45.292542+0000","last_active":"2023-12-02T01:29:45.296820+0000","last_peered":"2023-12-02T01:29:45.296820+0000","last_clean":"2023-12-02T01:29:45.296820+0000","last_became_active":"2023-12-02T01:29:45.292250+0000","last_became_peered":"2023-12-02T01:29:45.292250+0000","last_unstale":"2023-12-02T01:29:45.296820+0000","last_undegraded":"2023-12-02T01:29:45.296820+0000","last_fullsized":"2023-12-02T01:29:45.296820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:28.529390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.293729+0000","last_change":"2023-12-02T01:29:45.290121+0000","last_active":"2023-12-02T01:29:45.293729+0000","last_peered":"2023-12-02T01:29:45.293729+0000","last_clean":"2023-12-02T01:29:45.293729+0000","last_became_active":"2023-12-02T01:29:45.289862+0000","last_became_peered":"2023-12-02T01:29:45.289862+0000","last_unstale":"2023-12-02T01:29:45.293729+0000","last_undegraded":"2023-12-02T01:29:45.293729+0000","last_fullsized":"2023-12-02T01:29:45.293729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:21.086467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278875+0000","last_change":"2023-12-02T01:29:45.295312+0000","last_active":"2023-12-02T01:29:46.278875+0000","last_peered":"2023-12-02T01:29:46.278875+0000","last_clean":"2023-12-02T01:29:46.278875+0000","last_became_active":"2023-12-02T01:29:45.295007+0000","last_became_peered":"2023-12-02T01:29:45.295007+0000","last_unstale":"2023-12-02T01:29:46.278875+0000","last_undegraded":"2023-12-02T01:29:46.278875+0000","last_fullsized":"2023-12-02T01:29:46.278875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297352+0000","last_change":"2023-12-02T01:29:45.294208+0000","last_active":"2023-12-02T01:29:45.297352+0000","last_peered":"2023-12-02T01:29:45.297352+0000","last_clean":"2023-12-02T01:29:45.297352+0000","last_became_active":"2023-12-02T01:29:45.293819+0000","last_became_peered":"2023-12-02T01:29:45.293819+0000","last_unstale":"2023-12-02T01:29:45.297352+0000","last_undegraded":"2023-12-02T01:29:45.297352+0000","last_fullsized":"2023-12-02T01:29:45.297352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:56:21.607912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504519+0000","last_change":"2023-12-02T01:29:45.293594+0000","last_active":"2023-12-02T01:29:46.504519+0000","last_peered":"2023-12-02T01:29:46.504519+0000","last_clean":"2023-12-02T01:29:46.504519+0000","last_became_active":"2023-12-02T01:29:45.293292+0000","last_became_peered":"2023-12-02T01:29:45.293292+0000","last_unstale":"2023-12-02T01:29:46.504519+0000","last_undegraded":"2023-12-02T01:29:46.504519+0000","last_fullsized":"2023-12-02T01:29:46.504519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297566+0000","last_change":"2023-12-02T01:29:45.293967+0000","last_active":"2023-12-02T01:29:45.297566+0000","last_peered":"2023-12-02T01:29:45.297566+0000","last_clean":"2023-12-02T01:29:45.297566+0000","last_became_active":"2023-12-02T01:29:45.293685+0000","last_became_peered":"2023-12-02T01:29:45.293685+0000","last_unstale":"2023-12-02T01:29:45.297566+0000","last_undegraded":"2023-12-02T01:29:45.297566+0000","last_fullsized":"2023-12-02T01:29:45.297566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:59:59.489824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277375+0000","last_change":"2023-12-02T01:29:45.286671+0000","last_active":"2023-12-02T01:29:46.277375+0000","last_peered":"2023-12-02T01:29:46.277375+0000","last_clean":"2023-12-02T01:29:46.277375+0000","last_became_active":"2023-12-02T01:29:45.286387+0000","last_became_peered":"2023-12-02T01:29:45.286387+0000","last_unstale":"2023-12-02T01:29:46.277375+0000","last_undegraded":"2023-12-02T01:29:46.277375+0000","last_fullsized":"2023-12-02T01:29:46.277375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.293029+0000","last_change":"2023-12-02T01:29:45.287262+0000","last_active":"2023-12-02T01:29:45.293029+0000","last_peered":"2023-12-02T01:29:45.293029+0000","last_clean":"2023-12-02T01:29:45.293029+0000","last_became_active":"2023-12-02T01:29:45.286609+0000","last_became_peered":"2023-12-02T01:29:45.286609+0000","last_unstale":"2023-12-02T01:29:45.293029+0000","last_undegraded":"2023-12-02T01:29:45.293029+0000","last_fullsized":"2023-12-02T01:29:45.293029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:55.160149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279008+0000","last_change":"2023-12-02T01:29:45.290257+0000","last_active":"2023-12-02T01:29:46.279008+0000","last_peered":"2023-12-02T01:29:46.279008+0000","last_clean":"2023-12-02T01:29:46.279008+0000","last_became_active":"2023-12-02T01:29:45.289574+0000","last_became_peered":"2023-12-02T01:29:45.289574+0000","last_unstale":"2023-12-02T01:29:46.279008+0000","last_undegraded":"2023-12-02T01:29:46.279008+0000","last_fullsized":"2023-12-02T01:29:46.279008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:55.160149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.358425+0000","last_change":"2023-12-02T01:29:44.349543+0000","last_active":"2023-12-02T01:29:45.358425+0000","last_peered":"2023-12-02T01:29:45.358425+0000","last_clean":"2023-12-02T01:29:45.358425+0000","last_became_active":"2023-12-02T01:29:44.349239+0000","last_became_peered":"2023-12-02T01:29:44.349239+0000","last_unstale":"2023-12-02T01:29:45.358425+0000","last_undegraded":"2023-12-02T01:29:45.358425+0000","last_fullsized":"2023-12-02T01:29:45.358425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504676+0000","last_change":"2023-12-02T01:29:45.290443+0000","last_active":"2023-12-02T01:29:46.504676+0000","last_peered":"2023-12-02T01:29:46.504676+0000","last_clean":"2023-12-02T01:29:46.504676+0000","last_became_active":"2023-12-02T01:29:45.290132+0000","last_became_peered":"2023-12-02T01:29:45.290132+0000","last_unstale":"2023-12-02T01:29:46.504676+0000","last_undegraded":"2023-12-02T01:29:46.504676+0000","last_fullsized":"2023-12-02T01:29:46.504676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.353398+0000","last_change":"2023-12-02T01:29:44.347904+0000","last_active":"2023-12-02T01:29:45.353398+0000","last_peered":"2023-12-02T01:29:45.353398+0000","last_clean":"2023-12-02T01:29:45.353398+0000","last_became_active":"2023-12-02T01:29:44.347621+0000","last_became_peered":"2023-12-02T01:29:44.347621+0000","last_unstale":"2023-12-02T01:29:45.353398+0000","last_undegraded":"2023-12-02T01:29:45.353398+0000","last_fullsized":"2023-12-02T01:29:45.353398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:28.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.281424+0000","last_change":"2023-12-02T01:29:44.347813+0000","last_active":"2023-12-02T01:29:45.281424+0000","last_peered":"2023-12-02T01:29:45.281424+0000","last_clean":"2023-12-02T01:29:45.281424+0000","last_became_active":"2023-12-02T01:29:44.347529+0000","last_became_peered":"2023-12-02T01:29:44.347529+0000","last_unstale":"2023-12-02T01:29:45.281424+0000","last_undegraded":"2023-12-02T01:29:45.281424+0000","last_fullsized":"2023-12-02T01:29:45.281424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.293967+0000","last_change":"2023-12-02T01:29:45.291020+0000","last_active":"2023-12-02T01:29:45.293967+0000","last_peered":"2023-12-02T01:29:45.293967+0000","last_clean":"2023-12-02T01:29:45.293967+0000","last_became_active":"2023-12-02T01:29:45.290736+0000","last_became_peered":"2023-12-02T01:29:45.290736+0000","last_unstale":"2023-12-02T01:29:45.293967+0000","last_undegraded":"2023-12-02T01:29:45.293967+0000","last_fullsized":"2023-12-02T01:29:45.293967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:59:59.489824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.283694+0000","last_change":"2023-12-02T01:29:44.345129+0000","last_active":"2023-12-02T01:29:45.283694+0000","last_peered":"2023-12-02T01:29:45.283694+0000","last_clean":"2023-12-02T01:29:45.283694+0000","last_became_active":"2023-12-02T01:29:44.344808+0000","last_became_peered":"2023-12-02T01:29:44.344808+0000","last_unstale":"2023-12-02T01:29:45.283694+0000","last_undegraded":"2023-12-02T01:29:45.283694+0000","last_fullsized":"2023-12-02T01:29:45.283694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278811+0000","last_change":"2023-12-02T01:29:45.294374+0000","last_active":"2023-12-02T01:29:46.278811+0000","last_peered":"2023-12-02T01:29:46.278811+0000","last_clean":"2023-12-02T01:29:46.278811+0000","last_became_active":"2023-12-02T01:29:45.294104+0000","last_became_peered":"2023-12-02T01:29:45.294104+0000","last_unstale":"2023-12-02T01:29:46.278811+0000","last_undegraded":"2023-12-02T01:29:46.278811+0000","last_fullsized":"2023-12-02T01:29:46.278811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.280964+0000","last_change":"2023-12-02T01:29:44.350703+0000","last_active":"2023-12-02T01:29:45.280964+0000","last_peered":"2023-12-02T01:29:45.280964+0000","last_clean":"2023-12-02T01:29:45.280964+0000","last_became_active":"2023-12-02T01:29:44.350399+0000","last_became_peered":"2023-12-02T01:29:44.350399+0000","last_unstale":"2023-12-02T01:29:45.280964+0000","last_undegraded":"2023-12-02T01:29:45.280964+0000","last_fullsized":"2023-12-02T01:29:45.280964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:01.723991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297160+0000","last_change":"2023-12-02T01:29:45.294483+0000","last_active":"2023-12-02T01:29:45.297160+0000","last_peered":"2023-12-02T01:29:45.297160+0000","last_clean":"2023-12-02T01:29:45.297160+0000","last_became_active":"2023-12-02T01:29:45.294221+0000","last_became_peered":"2023-12-02T01:29:45.294221+0000","last_unstale":"2023-12-02T01:29:45.297160+0000","last_undegraded":"2023-12-02T01:29:45.297160+0000","last_fullsized":"2023-12-02T01:29:45.297160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:21.086467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.283116+0000","last_change":"2023-12-02T01:29:44.348206+0000","last_active":"2023-12-02T01:29:45.283116+0000","last_peered":"2023-12-02T01:29:45.283116+0000","last_clean":"2023-12-02T01:29:45.283116+0000","last_became_active":"2023-12-02T01:29:44.347824+0000","last_became_peered":"2023-12-02T01:29:44.347824+0000","last_unstale":"2023-12-02T01:29:45.283116+0000","last_undegraded":"2023-12-02T01:29:45.283116+0000","last_fullsized":"2023-12-02T01:29:45.283116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504691+0000","last_change":"2023-12-02T01:29:45.290778+0000","last_active":"2023-12-02T01:29:46.504691+0000","last_peered":"2023-12-02T01:29:46.504691+0000","last_clean":"2023-12-02T01:29:46.504691+0000","last_became_active":"2023-12-02T01:29:45.290465+0000","last_became_peered":"2023-12-02T01:29:45.290465+0000","last_unstale":"2023-12-02T01:29:46.504691+0000","last_undegraded":"2023-12-02T01:29:46.504691+0000","last_fullsized":"2023-12-02T01:29:46.504691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278661+0000","last_change":"2023-12-02T01:29:44.354772+0000","last_active":"2023-12-02T01:29:46.278661+0000","last_peered":"2023-12-02T01:29:46.278661+0000","last_clean":"2023-12-02T01:29:46.278661+0000","last_became_active":"2023-12-02T01:29:44.354324+0000","last_became_peered":"2023-12-02T01:29:44.354324+0000","last_unstale":"2023-12-02T01:29:46.278661+0000","last_undegraded":"2023-12-02T01:29:46.278661+0000","last_fullsized":"2023-12-02T01:29:46.278661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:13.495997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279468+0000","last_change":"2023-12-02T01:29:45.290328+0000","last_active":"2023-12-02T01:29:46.279468+0000","last_peered":"2023-12-02T01:29:46.279468+0000","last_clean":"2023-12-02T01:29:46.279468+0000","last_became_active":"2023-12-02T01:29:45.290057+0000","last_became_peered":"2023-12-02T01:29:45.290057+0000","last_unstale":"2023-12-02T01:29:46.279468+0000","last_undegraded":"2023-12-02T01:29:46.279468+0000","last_fullsized":"2023-12-02T01:29:46.279468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:21.086467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.360019+0000","last_change":"2023-12-02T01:29:44.349532+0000","last_active":"2023-12-02T01:29:45.360019+0000","last_peered":"2023-12-02T01:29:45.360019+0000","last_clean":"2023-12-02T01:29:45.360019+0000","last_became_active":"2023-12-02T01:29:44.349218+0000","last_became_peered":"2023-12-02T01:29:44.349218+0000","last_unstale":"2023-12-02T01:29:45.360019+0000","last_undegraded":"2023-12-02T01:29:45.360019+0000","last_fullsized":"2023-12-02T01:29:45.360019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:06.651434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.298075+0000","last_change":"2023-12-02T01:29:45.293735+0000","last_active":"2023-12-02T01:29:45.298075+0000","last_peered":"2023-12-02T01:29:45.298075+0000","last_clean":"2023-12-02T01:29:45.298075+0000","last_became_active":"2023-12-02T01:29:45.293291+0000","last_became_peered":"2023-12-02T01:29:45.293291+0000","last_unstale":"2023-12-02T01:29:45.298075+0000","last_undegraded":"2023-12-02T01:29:45.298075+0000","last_fullsized":"2023-12-02T01:29:45.298075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504662+0000","last_change":"2023-12-02T01:29:44.354982+0000","last_active":"2023-12-02T01:29:46.504662+0000","last_peered":"2023-12-02T01:29:46.504662+0000","last_clean":"2023-12-02T01:29:46.504662+0000","last_became_active":"2023-12-02T01:29:44.354668+0000","last_became_peered":"2023-12-02T01:29:44.354668+0000","last_unstale":"2023-12-02T01:29:46.504662+0000","last_undegraded":"2023-12-02T01:29:46.504662+0000","last_fullsized":"2023-12-02T01:29:46.504662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504397+0000","last_change":"2023-12-02T01:29:45.288825+0000","last_active":"2023-12-02T01:29:46.504397+0000","last_peered":"2023-12-02T01:29:46.504397+0000","last_clean":"2023-12-02T01:29:46.504397+0000","last_became_active":"2023-12-02T01:29:45.288301+0000","last_became_peered":"2023-12-02T01:29:45.288301+0000","last_unstale":"2023-12-02T01:29:46.504397+0000","last_undegraded":"2023-12-02T01:29:46.504397+0000","last_fullsized":"2023-12-02T01:29:46.504397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.282791+0000","last_change":"2023-12-02T01:29:44.351474+0000","last_active":"2023-12-02T01:29:45.282791+0000","last_peered":"2023-12-02T01:29:45.282791+0000","last_clean":"2023-12-02T01:29:45.282791+0000","last_became_active":"2023-12-02T01:29:44.351168+0000","last_became_peered":"2023-12-02T01:29:44.351168+0000","last_unstale":"2023-12-02T01:29:45.282791+0000","last_undegraded":"2023-12-02T01:29:45.282791+0000","last_fullsized":"2023-12-02T01:29:45.282791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:27.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301601+0000","last_change":"2023-12-02T01:29:45.297986+0000","last_active":"2023-12-02T01:29:45.301601+0000","last_peered":"2023-12-02T01:29:45.301601+0000","last_clean":"2023-12-02T01:29:45.301601+0000","last_became_active":"2023-12-02T01:29:45.297733+0000","last_became_peered":"2023-12-02T01:29:45.297733+0000","last_unstale":"2023-12-02T01:29:45.301601+0000","last_undegraded":"2023-12-02T01:29:45.301601+0000","last_fullsized":"2023-12-02T01:29:45.301601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:29.267506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.280794+0000","last_change":"2023-12-02T01:29:44.347247+0000","last_active":"2023-12-02T01:29:45.280794+0000","last_peered":"2023-12-02T01:29:45.280794+0000","last_clean":"2023-12-02T01:29:45.280794+0000","last_became_active":"2023-12-02T01:29:44.346905+0000","last_became_peered":"2023-12-02T01:29:44.346905+0000","last_unstale":"2023-12-02T01:29:45.280794+0000","last_undegraded":"2023-12-02T01:29:45.280794+0000","last_fullsized":"2023-12-02T01:29:45.280794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.293048+0000","last_change":"2023-12-02T01:29:45.287422+0000","last_active":"2023-12-02T01:29:45.293048+0000","last_peered":"2023-12-02T01:29:45.293048+0000","last_clean":"2023-12-02T01:29:45.293048+0000","last_became_active":"2023-12-02T01:29:45.286995+0000","last_became_peered":"2023-12-02T01:29:45.286995+0000","last_unstale":"2023-12-02T01:29:45.293048+0000","last_undegraded":"2023-12-02T01:29:45.293048+0000","last_fullsized":"2023-12-02T01:29:45.293048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:59:59.489824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277352+0000","last_change":"2023-12-02T01:29:44.348128+0000","last_active":"2023-12-02T01:29:46.277352+0000","last_peered":"2023-12-02T01:29:46.277352+0000","last_clean":"2023-12-02T01:29:46.277352+0000","last_became_active":"2023-12-02T01:29:44.347814+0000","last_became_peered":"2023-12-02T01:29:44.347814+0000","last_unstale":"2023-12-02T01:29:46.277352+0000","last_undegraded":"2023-12-02T01:29:46.277352+0000","last_fullsized":"2023-12-02T01:29:46.277352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301596+0000","last_change":"2023-12-02T01:29:45.297889+0000","last_active":"2023-12-02T01:29:45.301596+0000","last_peered":"2023-12-02T01:29:45.301596+0000","last_clean":"2023-12-02T01:29:45.301596+0000","last_became_active":"2023-12-02T01:29:45.297639+0000","last_became_peered":"2023-12-02T01:29:45.297639+0000","last_unstale":"2023-12-02T01:29:45.301596+0000","last_undegraded":"2023-12-02T01:29:45.301596+0000","last_fullsized":"2023-12-02T01:29:45.301596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:15.348786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279286+0000","last_change":"2023-12-02T01:29:44.348659+0000","last_active":"2023-12-02T01:29:46.279286+0000","last_peered":"2023-12-02T01:29:46.279286+0000","last_clean":"2023-12-02T01:29:46.279286+0000","last_became_active":"2023-12-02T01:29:44.348107+0000","last_became_peered":"2023-12-02T01:29:44.348107+0000","last_unstale":"2023-12-02T01:29:46.279286+0000","last_undegraded":"2023-12-02T01:29:46.279286+0000","last_fullsized":"2023-12-02T01:29:46.279286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.299701+0000","last_change":"2023-12-02T01:29:45.296461+0000","last_active":"2023-12-02T01:29:45.299701+0000","last_peered":"2023-12-02T01:29:45.299701+0000","last_clean":"2023-12-02T01:29:45.299701+0000","last_became_active":"2023-12-02T01:29:45.296220+0000","last_became_peered":"2023-12-02T01:29:45.296220+0000","last_unstale":"2023-12-02T01:29:45.299701+0000","last_undegraded":"2023-12-02T01:29:45.299701+0000","last_fullsized":"2023-12-02T01:29:45.299701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277634+0000","last_change":"2023-12-02T01:29:44.349307+0000","last_active":"2023-12-02T01:29:46.277634+0000","last_peered":"2023-12-02T01:29:46.277634+0000","last_clean":"2023-12-02T01:29:46.277634+0000","last_became_active":"2023-12-02T01:29:44.349025+0000","last_became_peered":"2023-12-02T01:29:44.349025+0000","last_unstale":"2023-12-02T01:29:46.277634+0000","last_undegraded":"2023-12-02T01:29:46.277634+0000","last_fullsized":"2023-12-02T01:29:46.277634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:54.153379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301540+0000","last_change":"2023-12-02T01:29:45.297278+0000","last_active":"2023-12-02T01:29:45.301540+0000","last_peered":"2023-12-02T01:29:45.301540+0000","last_clean":"2023-12-02T01:29:45.301540+0000","last_became_active":"2023-12-02T01:29:45.297012+0000","last_became_peered":"2023-12-02T01:29:45.297012+0000","last_unstale":"2023-12-02T01:29:45.301540+0000","last_undegraded":"2023-12-02T01:29:45.301540+0000","last_fullsized":"2023-12-02T01:29:45.301540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278766+0000","last_change":"2023-12-02T01:29:44.350480+0000","last_active":"2023-12-02T01:29:46.278766+0000","last_peered":"2023-12-02T01:29:46.278766+0000","last_clean":"2023-12-02T01:29:46.278766+0000","last_became_active":"2023-12-02T01:29:44.350151+0000","last_became_peered":"2023-12-02T01:29:44.350151+0000","last_unstale":"2023-12-02T01:29:46.278766+0000","last_undegraded":"2023-12-02T01:29:46.278766+0000","last_fullsized":"2023-12-02T01:29:46.278766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301278+0000","last_change":"2023-12-02T01:29:45.295690+0000","last_active":"2023-12-02T01:29:45.301278+0000","last_peered":"2023-12-02T01:29:45.301278+0000","last_clean":"2023-12-02T01:29:45.301278+0000","last_became_active":"2023-12-02T01:29:45.295369+0000","last_became_peered":"2023-12-02T01:29:45.295369+0000","last_unstale":"2023-12-02T01:29:45.301278+0000","last_undegraded":"2023-12-02T01:29:45.301278+0000","last_fullsized":"2023-12-02T01:29:45.301278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277571+0000","last_change":"2023-12-02T01:29:44.345332+0000","last_active":"2023-12-02T01:29:46.277571+0000","last_peered":"2023-12-02T01:29:46.277571+0000","last_clean":"2023-12-02T01:29:46.277571+0000","last_became_active":"2023-12-02T01:29:44.344979+0000","last_became_peered":"2023-12-02T01:29:44.344979+0000","last_unstale":"2023-12-02T01:29:46.277571+0000","last_undegraded":"2023-12-02T01:29:46.277571+0000","last_fullsized":"2023-12-02T01:29:46.277571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:56:20.601142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301608+0000","last_change":"2023-12-02T01:29:45.298734+0000","last_active":"2023-12-02T01:29:45.301608+0000","last_peered":"2023-12-02T01:29:45.301608+0000","last_clean":"2023-12-02T01:29:45.301608+0000","last_became_active":"2023-12-02T01:29:45.298413+0000","last_became_peered":"2023-12-02T01:29:45.298413+0000","last_unstale":"2023-12-02T01:29:45.301608+0000","last_undegraded":"2023-12-02T01:29:45.301608+0000","last_fullsized":"2023-12-02T01:29:45.301608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:14.502767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-02T01:29:44.344114+0000","last_change":"2023-12-02T01:29:33.915833+0000","last_active":"2023-12-02T01:29:44.344114+0000","last_peered":"2023-12-02T01:29:44.344114+0000","last_clean":"2023-12-02T01:29:44.344114+0000","last_became_active":"2023-12-02T01:29:33.915012+0000","last_became_peered":"2023-12-02T01:29:33.915012+0000","last_unstale":"2023-12-02T01:29:44.344114+0000","last_undegraded":"2023-12-02T01:29:44.344114+0000","last_fullsized":"2023-12-02T01:29:44.344114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_clean_scrub_stamp":"2023-12-02T01:29:32.688531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:25:40.082821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.282521+0000","last_change":"2023-12-02T01:29:44.348495+0000","last_active":"2023-12-02T01:29:45.282521+0000","last_peered":"2023-12-02T01:29:45.282521+0000","last_clean":"2023-12-02T01:29:45.282521+0000","last_became_active":"2023-12-02T01:29:44.347921+0000","last_became_peered":"2023-12-02T01:29:44.347921+0000","last_unstale":"2023-12-02T01:29:45.282521+0000","last_undegraded":"2023-12-02T01:29:45.282521+0000","last_fullsized":"2023-12-02T01:29:45.282521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.299170+0000","last_change":"2023-12-02T01:29:45.298682+0000","last_active":"2023-12-02T01:29:45.299170+0000","last_peered":"2023-12-02T01:29:45.299170+0000","last_clean":"2023-12-02T01:29:45.299170+0000","last_became_active":"2023-12-02T01:29:45.298430+0000","last_became_peered":"2023-12-02T01:29:45.298430+0000","last_unstale":"2023-12-02T01:29:45.299170+0000","last_undegraded":"2023-12-02T01:29:45.299170+0000","last_fullsized":"2023-12-02T01:29:45.299170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:00:05.020940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.281867+0000","last_change":"2023-12-02T01:29:44.356428+0000","last_active":"2023-12-02T01:29:45.281867+0000","last_peered":"2023-12-02T01:29:45.281867+0000","last_clean":"2023-12-02T01:29:45.281867+0000","last_became_active":"2023-12-02T01:29:44.356144+0000","last_became_peered":"2023-12-02T01:29:44.356144+0000","last_unstale":"2023-12-02T01:29:45.281867+0000","last_undegraded":"2023-12-02T01:29:45.281867+0000","last_fullsized":"2023-12-02T01:29:45.281867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:54.153379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504303+0000","last_change":"2023-12-02T01:29:45.291319+0000","last_active":"2023-12-02T01:29:46.504303+0000","last_peered":"2023-12-02T01:29:46.504303+0000","last_clean":"2023-12-02T01:29:46.504303+0000","last_became_active":"2023-12-02T01:29:45.291009+0000","last_became_peered":"2023-12-02T01:29:45.291009+0000","last_unstale":"2023-12-02T01:29:46.504303+0000","last_undegraded":"2023-12-02T01:29:46.504303+0000","last_fullsized":"2023-12-02T01:29:46.504303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:07.658204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277465+0000","last_change":"2023-12-02T01:29:44.344424+0000","last_active":"2023-12-02T01:29:46.277465+0000","last_peered":"2023-12-02T01:29:46.277465+0000","last_clean":"2023-12-02T01:29:46.277465+0000","last_became_active":"2023-12-02T01:29:44.344133+0000","last_became_peered":"2023-12-02T01:29:44.344133+0000","last_unstale":"2023-12-02T01:29:46.277465+0000","last_undegraded":"2023-12-02T01:29:46.277465+0000","last_fullsized":"2023-12-02T01:29:46.277465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:59:58.483054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278607+0000","last_change":"2023-12-02T01:29:45.287869+0000","last_active":"2023-12-02T01:29:46.278607+0000","last_peered":"2023-12-02T01:29:46.278607+0000","last_clean":"2023-12-02T01:29:46.278607+0000","last_became_active":"2023-12-02T01:29:45.287600+0000","last_became_peered":"2023-12-02T01:29:45.287600+0000","last_unstale":"2023-12-02T01:29:46.278607+0000","last_undegraded":"2023-12-02T01:29:46.278607+0000","last_fullsized":"2023-12-02T01:29:46.278607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.282929+0000","last_change":"2023-12-02T01:29:44.349176+0000","last_active":"2023-12-02T01:29:45.282929+0000","last_peered":"2023-12-02T01:29:45.282929+0000","last_clean":"2023-12-02T01:29:45.282929+0000","last_became_active":"2023-12-02T01:29:44.347726+0000","last_became_peered":"2023-12-02T01:29:44.347726+0000","last_unstale":"2023-12-02T01:29:45.282929+0000","last_undegraded":"2023-12-02T01:29:45.282929+0000","last_fullsized":"2023-12-02T01:29:45.282929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:13.495997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279304+0000","last_change":"2023-12-02T01:29:45.290437+0000","last_active":"2023-12-02T01:29:46.279304+0000","last_peered":"2023-12-02T01:29:46.279304+0000","last_clean":"2023-12-02T01:29:46.279304+0000","last_became_active":"2023-12-02T01:29:45.290093+0000","last_became_peered":"2023-12-02T01:29:45.290093+0000","last_unstale":"2023-12-02T01:29:46.279304+0000","last_undegraded":"2023-12-02T01:29:46.279304+0000","last_fullsized":"2023-12-02T01:29:46.279304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:15.348786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278769+0000","last_change":"2023-12-02T01:29:44.348440+0000","last_active":"2023-12-02T01:29:46.278769+0000","last_peered":"2023-12-02T01:29:46.278769+0000","last_clean":"2023-12-02T01:29:46.278769+0000","last_became_active":"2023-12-02T01:29:44.348165+0000","last_became_peered":"2023-12-02T01:29:44.348165+0000","last_unstale":"2023-12-02T01:29:46.278769+0000","last_undegraded":"2023-12-02T01:29:46.278769+0000","last_fullsized":"2023-12-02T01:29:46.278769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:20.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301241+0000","last_change":"2023-12-02T01:29:45.295551+0000","last_active":"2023-12-02T01:29:45.301241+0000","last_peered":"2023-12-02T01:29:45.301241+0000","last_clean":"2023-12-02T01:29:45.301241+0000","last_became_active":"2023-12-02T01:29:45.295164+0000","last_became_peered":"2023-12-02T01:29:45.295164+0000","last_unstale":"2023-12-02T01:29:45.301241+0000","last_undegraded":"2023-12-02T01:29:45.301241+0000","last_fullsized":"2023-12-02T01:29:45.301241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:07.658204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.286343+0000","last_change":"2023-12-02T01:29:44.354009+0000","last_active":"2023-12-02T01:29:45.286343+0000","last_peered":"2023-12-02T01:29:45.286343+0000","last_clean":"2023-12-02T01:29:45.286343+0000","last_became_active":"2023-12-02T01:29:44.353730+0000","last_became_peered":"2023-12-02T01:29:44.353730+0000","last_unstale":"2023-12-02T01:29:45.286343+0000","last_undegraded":"2023-12-02T01:29:45.286343+0000","last_fullsized":"2023-12-02T01:29:45.286343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:56.926421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278706+0000","last_change":"2023-12-02T01:29:45.288340+0000","last_active":"2023-12-02T01:29:46.278706+0000","last_peered":"2023-12-02T01:29:46.278706+0000","last_clean":"2023-12-02T01:29:46.278706+0000","last_became_active":"2023-12-02T01:29:45.288025+0000","last_became_peered":"2023-12-02T01:29:45.288025+0000","last_unstale":"2023-12-02T01:29:46.278706+0000","last_undegraded":"2023-12-02T01:29:46.278706+0000","last_fullsized":"2023-12-02T01:29:46.278706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278771+0000","last_change":"2023-12-02T01:29:44.356197+0000","last_active":"2023-12-02T01:29:46.278771+0000","last_peered":"2023-12-02T01:29:46.278771+0000","last_clean":"2023-12-02T01:29:46.278771+0000","last_became_active":"2023-12-02T01:29:44.355856+0000","last_became_peered":"2023-12-02T01:29:44.355856+0000","last_unstale":"2023-12-02T01:29:46.278771+0000","last_undegraded":"2023-12-02T01:29:46.278771+0000","last_fullsized":"2023-12-02T01:29:46.278771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297748+0000","last_change":"2023-12-02T01:29:45.295847+0000","last_active":"2023-12-02T01:29:45.297748+0000","last_peered":"2023-12-02T01:29:45.297748+0000","last_clean":"2023-12-02T01:29:45.297748+0000","last_became_active":"2023-12-02T01:29:45.293122+0000","last_became_peered":"2023-12-02T01:29:45.293122+0000","last_unstale":"2023-12-02T01:29:45.297748+0000","last_undegraded":"2023-12-02T01:29:45.297748+0000","last_fullsized":"2023-12-02T01:29:45.297748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:55.160149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.358520+0000","last_change":"2023-12-02T01:29:44.352578+0000","last_active":"2023-12-02T01:29:45.358520+0000","last_peered":"2023-12-02T01:29:45.358520+0000","last_clean":"2023-12-02T01:29:45.358520+0000","last_became_active":"2023-12-02T01:29:44.352301+0000","last_became_peered":"2023-12-02T01:29:44.352301+0000","last_unstale":"2023-12-02T01:29:45.358520+0000","last_undegraded":"2023-12-02T01:29:45.358520+0000","last_fullsized":"2023-12-02T01:29:45.358520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504710+0000","last_change":"2023-12-02T01:29:45.289358+0000","last_active":"2023-12-02T01:29:46.504710+0000","last_peered":"2023-12-02T01:29:46.504710+0000","last_clean":"2023-12-02T01:29:46.504710+0000","last_became_active":"2023-12-02T01:29:45.288764+0000","last_became_peered":"2023-12-02T01:29:45.288764+0000","last_unstale":"2023-12-02T01:29:46.504710+0000","last_undegraded":"2023-12-02T01:29:46.504710+0000","last_fullsized":"2023-12-02T01:29:46.504710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.281718+0000","last_change":"2023-12-02T01:29:44.353622+0000","last_active":"2023-12-02T01:29:45.281718+0000","last_peered":"2023-12-02T01:29:45.281718+0000","last_clean":"2023-12-02T01:29:45.281718+0000","last_became_active":"2023-12-02T01:29:44.353356+0000","last_became_peered":"2023-12-02T01:29:44.353356+0000","last_unstale":"2023-12-02T01:29:45.281718+0000","last_undegraded":"2023-12-02T01:29:45.281718+0000","last_fullsized":"2023-12-02T01:29:45.281718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279022+0000","last_change":"2023-12-02T01:29:45.289816+0000","last_active":"2023-12-02T01:29:46.279022+0000","last_peered":"2023-12-02T01:29:46.279022+0000","last_clean":"2023-12-02T01:29:46.279022+0000","last_became_active":"2023-12-02T01:29:45.289305+0000","last_became_peered":"2023-12-02T01:29:45.289305+0000","last_unstale":"2023-12-02T01:29:46.279022+0000","last_undegraded":"2023-12-02T01:29:46.279022+0000","last_fullsized":"2023-12-02T01:29:46.279022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278678+0000","last_change":"2023-12-02T01:29:44.356341+0000","last_active":"2023-12-02T01:29:46.278678+0000","last_peered":"2023-12-02T01:29:46.278678+0000","last_clean":"2023-12-02T01:29:46.278678+0000","last_became_active":"2023-12-02T01:29:44.355976+0000","last_became_peered":"2023-12-02T01:29:44.355976+0000","last_unstale":"2023-12-02T01:29:46.278678+0000","last_undegraded":"2023-12-02T01:29:46.278678+0000","last_fullsized":"2023-12-02T01:29:46.278678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:28.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.297188+0000","last_change":"2023-12-02T01:29:45.293848+0000","last_active":"2023-12-02T01:29:45.297188+0000","last_peered":"2023-12-02T01:29:45.297188+0000","last_clean":"2023-12-02T01:29:45.297188+0000","last_became_active":"2023-12-02T01:29:45.293579+0000","last_became_peered":"2023-12-02T01:29:45.293579+0000","last_unstale":"2023-12-02T01:29:45.297188+0000","last_undegraded":"2023-12-02T01:29:45.297188+0000","last_fullsized":"2023-12-02T01:29:45.297188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:03:36.609145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278841+0000","last_change":"2023-12-02T01:29:44.353369+0000","last_active":"2023-12-02T01:29:46.278841+0000","last_peered":"2023-12-02T01:29:46.278841+0000","last_clean":"2023-12-02T01:29:46.278841+0000","last_became_active":"2023-12-02T01:29:44.352947+0000","last_became_peered":"2023-12-02T01:29:44.352947+0000","last_unstale":"2023-12-02T01:29:46.278841+0000","last_undegraded":"2023-12-02T01:29:46.278841+0000","last_fullsized":"2023-12-02T01:29:46.278841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:27.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.291270+0000","last_change":"2023-12-02T01:29:45.285988+0000","last_active":"2023-12-02T01:29:45.291270+0000","last_peered":"2023-12-02T01:29:45.291270+0000","last_clean":"2023-12-02T01:29:45.291270+0000","last_became_active":"2023-12-02T01:29:45.285710+0000","last_became_peered":"2023-12-02T01:29:45.285710+0000","last_unstale":"2023-12-02T01:29:45.291270+0000","last_undegraded":"2023-12-02T01:29:45.291270+0000","last_fullsized":"2023-12-02T01:29:45.291270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:14.502767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.358378+0000","last_change":"2023-12-02T01:29:44.351734+0000","last_active":"2023-12-02T01:29:45.358378+0000","last_peered":"2023-12-02T01:29:45.358378+0000","last_clean":"2023-12-02T01:29:45.358378+0000","last_became_active":"2023-12-02T01:29:44.351459+0000","last_became_peered":"2023-12-02T01:29:44.351459+0000","last_unstale":"2023-12-02T01:29:45.358378+0000","last_undegraded":"2023-12-02T01:29:45.358378+0000","last_fullsized":"2023-12-02T01:29:45.358378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.293727+0000","last_change":"2023-12-02T01:29:45.292288+0000","last_active":"2023-12-02T01:29:45.293727+0000","last_peered":"2023-12-02T01:29:45.293727+0000","last_clean":"2023-12-02T01:29:45.293727+0000","last_became_active":"2023-12-02T01:29:45.291969+0000","last_became_peered":"2023-12-02T01:29:45.291969+0000","last_unstale":"2023-12-02T01:29:45.293727+0000","last_undegraded":"2023-12-02T01:29:45.293727+0000","last_fullsized":"2023-12-02T01:29:45.293727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:59.373605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301808+0000","last_change":"2023-12-02T01:29:45.297737+0000","last_active":"2023-12-02T01:29:45.301808+0000","last_peered":"2023-12-02T01:29:45.301808+0000","last_clean":"2023-12-02T01:29:45.301808+0000","last_became_active":"2023-12-02T01:29:45.297288+0000","last_became_peered":"2023-12-02T01:29:45.297288+0000","last_unstale":"2023-12-02T01:29:45.301808+0000","last_undegraded":"2023-12-02T01:29:45.301808+0000","last_fullsized":"2023-12-02T01:29:45.301808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.358383+0000","last_change":"2023-12-02T01:29:44.351702+0000","last_active":"2023-12-02T01:29:45.358383+0000","last_peered":"2023-12-02T01:29:45.358383+0000","last_clean":"2023-12-02T01:29:45.358383+0000","last_became_active":"2023-12-02T01:29:44.351340+0000","last_became_peered":"2023-12-02T01:29:44.351340+0000","last_unstale":"2023-12-02T01:29:45.358383+0000","last_undegraded":"2023-12-02T01:29:45.358383+0000","last_fullsized":"2023-12-02T01:29:45.358383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:20.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.301438+0000","last_change":"2023-12-02T01:29:45.296949+0000","last_active":"2023-12-02T01:29:45.301438+0000","last_peered":"2023-12-02T01:29:45.301438+0000","last_clean":"2023-12-02T01:29:45.301438+0000","last_became_active":"2023-12-02T01:29:45.296653+0000","last_became_peered":"2023-12-02T01:29:45.296653+0000","last_unstale":"2023-12-02T01:29:45.301438+0000","last_undegraded":"2023-12-02T01:29:45.301438+0000","last_fullsized":"2023-12-02T01:29:45.301438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:29.267506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.358316+0000","last_change":"2023-12-02T01:29:44.354118+0000","last_active":"2023-12-02T01:29:45.358316+0000","last_peered":"2023-12-02T01:29:45.358316+0000","last_clean":"2023-12-02T01:29:45.358316+0000","last_became_active":"2023-12-02T01:29:44.353835+0000","last_became_peered":"2023-12-02T01:29:44.353835+0000","last_unstale":"2023-12-02T01:29:45.358316+0000","last_undegraded":"2023-12-02T01:29:45.358316+0000","last_fullsized":"2023-12-02T01:29:45.358316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504573+0000","last_change":"2023-12-02T01:29:45.295870+0000","last_active":"2023-12-02T01:29:46.504573+0000","last_peered":"2023-12-02T01:29:46.504573+0000","last_clean":"2023-12-02T01:29:46.504573+0000","last_became_active":"2023-12-02T01:29:45.295589+0000","last_became_peered":"2023-12-02T01:29:45.295589+0000","last_unstale":"2023-12-02T01:29:46.504573+0000","last_undegraded":"2023-12-02T01:29:46.504573+0000","last_fullsized":"2023-12-02T01:29:46.504573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.355047+0000","last_change":"2023-12-02T01:29:44.352609+0000","last_active":"2023-12-02T01:29:45.355047+0000","last_peered":"2023-12-02T01:29:45.355047+0000","last_clean":"2023-12-02T01:29:45.355047+0000","last_became_active":"2023-12-02T01:29:44.352295+0000","last_became_peered":"2023-12-02T01:29:44.352295+0000","last_unstale":"2023-12-02T01:29:45.355047+0000","last_undegraded":"2023-12-02T01:29:45.355047+0000","last_fullsized":"2023-12-02T01:29:45.355047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.291417+0000","last_change":"2023-12-02T01:29:45.287684+0000","last_active":"2023-12-02T01:29:45.291417+0000","last_peered":"2023-12-02T01:29:45.291417+0000","last_clean":"2023-12-02T01:29:45.291417+0000","last_became_active":"2023-12-02T01:29:45.287406+0000","last_became_peered":"2023-12-02T01:29:45.287406+0000","last_unstale":"2023-12-02T01:29:45.291417+0000","last_undegraded":"2023-12-02T01:29:45.291417+0000","last_fullsized":"2023-12-02T01:29:45.291417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:57.885160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504719+0000","last_change":"2023-12-02T01:29:44.354342+0000","last_active":"2023-12-02T01:29:46.504719+0000","last_peered":"2023-12-02T01:29:46.504719+0000","last_clean":"2023-12-02T01:29:46.504719+0000","last_became_active":"2023-12-02T01:29:44.353999+0000","last_became_peered":"2023-12-02T01:29:44.353999+0000","last_unstale":"2023-12-02T01:29:46.504719+0000","last_undegraded":"2023-12-02T01:29:46.504719+0000","last_fullsized":"2023-12-02T01:29:46.504719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-02T01:29:48.698 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-02T01:29:48.698 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-02T01:29:48.698 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-02T01:29:48.698 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-02T01:29:48.699 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-02T01:29:48.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 Processor -- start 2023-12-02T01:29:48.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 -- start start 2023-12-02T01:29:48.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c806bff0 0x7f92c806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92c8161100 0x7f92c8161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f92c80b2700 0x7f92c80b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c8161eb0 con 0x7f92c8161100 2023-12-02T01:29:48.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c806c910 con 0x7f92c80b2700 2023-12-02T01:29:48.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.840+0000 7f92cee10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80cd8f0 con 0x7f92c806bff0 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92c8161100 0x7f92c8161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f92c8161100 0x7f92c8161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58360/0 (socket says 172.21.15.1:58360) 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 -- 172.21.15.1:0/1508601864 learned_addr learned my addr 172.21.15.1:0/1508601864 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92cd3ad640 1 --2- 172.21.15.1:0/1508601864 >> v2:172.21.15.167:3300/0 conn(0x7f92c80b2700 0x7f92c80b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92ccbac640 1 --2- 172.21.15.1:0/1508601864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c806bff0 0x7f92c806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 -- 172.21.15.1:0/1508601864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c806bff0 msgr2=0x7f92c806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 --2- 172.21.15.1:0/1508601864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c806bff0 0x7f92c806c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 -- 172.21.15.1:0/1508601864 >> v2:172.21.15.167:3300/0 conn(0x7f92c80b2700 msgr2=0x7f92c80b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 --2- 172.21.15.1:0/1508601864 >> v2:172.21.15.167:3300/0 conn(0x7f92c80b2700 0x7f92c80b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92c7fff640 1 -- 172.21.15.1:0/1508601864 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80cdbd0 con 0x7f92c8161100 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92ccbac640 1 --2- 172.21.15.1:0/1508601864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c806bff0 0x7f92c806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.841+0000 7f92cd3ad640 1 --2- 172.21.15.1:0/1508601864 >> v2:172.21.15.167:3300/0 conn(0x7f92c80b2700 0x7f92c80b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92c7fff640 1 --2- 172.21.15.1:0/1508601864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c8161100 0x7f92c8161540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f92c809eea0 tx=0x7f92b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338c6146bc5c2bb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92c77fe640 1 -- 172.21.15.1:0/1508601864 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4031870 con 0x7f92c8161100 2023-12-02T01:29:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92c77fe640 1 -- 172.21.15.1:0/1508601864 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b40319d0 con 0x7f92c8161100 2023-12-02T01:29:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92c77fe640 1 -- 172.21.15.1:0/1508601864 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4031d60 con 0x7f92c8161100 2023-12-02T01:29:48.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 -- 172.21.15.1:0/1508601864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c8161100 msgr2=0x7f92c8161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 --2- 172.21.15.1:0/1508601864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c8161100 0x7f92c8161540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f92c809eea0 tx=0x7f92b402b910 comp rx=0 tx=0).stop 2023-12-02T01:29:48.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 -- 172.21.15.1:0/1508601864 shutdown_connections 2023-12-02T01:29:48.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 --2- 172.21.15.1:0/1508601864 >> v2:172.21.15.167:3300/0 conn(0x7f92c80b2700 0x7f92c80b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 --2- 172.21.15.1:0/1508601864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c8161100 0x7f92c8161540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 --2- 172.21.15.1:0/1508601864 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c806bff0 0x7f92c806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 -- 172.21.15.1:0/1508601864 >> 172.21.15.1:0/1508601864 conn(0x7f92c80d0f60 msgr2=0x7f92c80d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 -- 172.21.15.1:0/1508601864 shutdown_connections 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.842+0000 7f92cee10640 1 -- 172.21.15.1:0/1508601864 wait complete. 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 Processor -- start 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 -- start start 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c806bff0 0x7f92c81578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c80b2700 0x7f92c80b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c8161100 0x7f92c80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80c6ae0 con 0x7f92c806bff0 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80c4bc0 con 0x7f92c80b2700 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.844+0000 7f92cee10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80c6cd0 con 0x7f92c8161100 2023-12-02T01:29:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c806bff0 0x7f92c81578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c806bff0 0x7f92c81578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58366/0 (socket says 172.21.15.1:58366) 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 -- 172.21.15.1:0/237203853 learned_addr learned my addr 172.21.15.1:0/237203853 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92c7fff640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c80b2700 0x7f92c80b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92cd3ad640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c8161100 0x7f92c80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 -- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c8161100 msgr2=0x7f92c80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c8161100 0x7f92c80c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 -- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c80b2700 msgr2=0x7f92c80b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c80b2700 0x7f92c80b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 -- 172.21.15.1:0/237203853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b40094d0 con 0x7f92c806bff0 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92c7fff640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c80b2700 0x7f92c80b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92ccbac640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c806bff0 0x7f92c81578c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00d800 tx=0x7f92bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92c57fa640 1 -- 172.21.15.1:0/237203853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc004030 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92c57fa640 1 -- 172.21.15.1:0/237203853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc004190 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c80ce830 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92c57fa640 1 -- 172.21.15.1:0/237203853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc004520 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.845+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c80c7290 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.846+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c8068470 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.847+0000 7f92c57fa640 1 -- 172.21.15.1:0/237203853 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92bc0096a0 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.847+0000 7f92c57fa640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f92ac06ae40 0x7f92ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.847+0000 7f92c57fa640 1 -- 172.21.15.1:0/237203853 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92bc089900 con 0x7f92c806bff0 2023-12-02T01:29:48.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.847+0000 7f92c7fff640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f92ac06ae40 0x7f92ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:48.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.847+0000 7f92c7fff640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f92ac06ae40 0x7f92ac06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92b4036000 tx=0x7f92b403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:48.852 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:48.851+0000 7f92c57fa640 1 -- 172.21.15.1:0/237203853 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92bc0549b0 con 0x7f92c806bff0 2023-12-02T01:29:49.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.073+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f92c806bdd0 con 0x7f92c806bff0 2023-12-02T01:29:49.078 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.076+0000 7f92c57fa640 1 -- 172.21.15.1:0/237203853 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171024 (secure 0 0 0) 0x7f92bc018090 con 0x7f92c806bff0 2023-12-02T01:29:49.080 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:49.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f92ac06ae40 msgr2=0x7f92ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f92ac06ae40 0x7f92ac06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92b4036000 tx=0x7f92b403c040 comp rx=0 tx=0).stop 2023-12-02T01:29:49.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c806bff0 msgr2=0x7f92c81578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c806bff0 0x7f92c81578c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00d800 tx=0x7f92bc00dcc0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 shutdown_connections 2023-12-02T01:29:49.081 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c8161100 0x7f92c80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f92ac06ae40 0x7f92ac06d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c80b2700 0x7f92c80b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 --2- 172.21.15.1:0/237203853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92c806bff0 0x7f92c81578c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 >> 172.21.15.1:0/237203853 conn(0x7f92c80d0f60 msgr2=0x7f92c806f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 shutdown_connections 2023-12-02T01:29:49.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.079+0000 7f92cee10640 1 -- 172.21.15.1:0/237203853 wait complete. 2023-12-02T01:29:49.092 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1281506213},{"type":"v1","addr":"172.21.15.1:6833","nonce":1281506213}]},"active_addr":"172.21.15.1:6833/1281506213","active_change":"2023-12-02T01:29:24.624761+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2312891627}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3810434694}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":865204927}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3444597328}]}]} 2023-12-02T01:29:49.095 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-02T01:29:49.095 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-02T01:29:49.095 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:49.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.200+0000 7faa55aee640 1 Processor -- start 2023-12-02T01:29:49.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.200+0000 7faa55aee640 1 -- start start 2023-12-02T01:29:49.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa55aee640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7faa50160ab0 0x7faa500afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa55aee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa500d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa55aee640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500cdd30 con 0x7faa500b2450 2023-12-02T01:29:49.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa55aee640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa500d1e00 con 0x7faa50160ab0 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa55aee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500ce2d0 con 0x7faa500d1450 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4f7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7faa50160ab0 0x7faa500afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4effd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7faa500b2450 0x7faa500cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45086/0 (socket says 172.21.15.1:45086) 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4effd640 1 -- 172.21.15.1:0/1190845432 learned_addr learned my addr 172.21.15.1:0/1190845432 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4f7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7faa50160ab0 0x7faa500afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58380/0 (socket says 172.21.15.1:58380) 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4ffff640 1 --2- 172.21.15.1:0/1190845432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa500d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4f7fe640 1 -- 172.21.15.1:0/1190845432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 msgr2=0x7faa500d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4f7fe640 1 --2- 172.21.15.1:0/1190845432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa500d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4f7fe640 1 -- 172.21.15.1:0/1190845432 >> v1:172.21.15.1:6789/0 conn(0x7faa500b2450 legacy=0x7faa500cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4f7fe640 1 -- 172.21.15.1:0/1190845432 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500d0a90 con 0x7faa50160ab0 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.201+0000 7faa4e7fc640 1 -- 172.21.15.1:0/1190845432 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544089033 0 0) 0x7faa500cdd30 con 0x7faa500b2450 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa4f7fe640 1 --2- 172.21.15.1:0/1190845432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa500afdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa400097a0 tx=0x7faa4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba401907a359208d server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa4e7fc640 1 -- 172.21.15.1:0/1190845432 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4002e070 con 0x7faa50160ab0 2023-12-02T01:29:49.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa4e7fc640 1 -- 172.21.15.1:0/1190845432 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa400315a0 con 0x7faa50160ab0 2023-12-02T01:29:49.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa4e7fc640 1 -- 172.21.15.1:0/1190845432 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40031930 con 0x7faa50160ab0 2023-12-02T01:29:49.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa55aee640 1 -- 172.21.15.1:0/1190845432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 msgr2=0x7faa500afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa55aee640 1 --2- 172.21.15.1:0/1190845432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa500afdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa400097a0 tx=0x7faa4002b840 comp rx=0 tx=0).stop 2023-12-02T01:29:49.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa55aee640 1 -- 172.21.15.1:0/1190845432 shutdown_connections 2023-12-02T01:29:49.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa55aee640 1 --2- 172.21.15.1:0/1190845432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa500d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa55aee640 1 --2- 172.21.15.1:0/1190845432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa500afdb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.202+0000 7faa55aee640 1 -- 172.21.15.1:0/1190845432 >> 172.21.15.1:0/1190845432 conn(0x7faa5009c450 msgr2=0x7faa500d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.203+0000 7faa55aee640 1 -- 172.21.15.1:0/1190845432 shutdown_connections 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.203+0000 7faa55aee640 1 -- 172.21.15.1:0/1190845432 wait complete. 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.204+0000 7faa55aee640 1 Processor -- start 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.204+0000 7faa55aee640 1 -- start start 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa500b2450 0x7faa5015e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa5015f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa50155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501569c0 con 0x7faa50160ab0 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5015efa0 con 0x7faa500b2450 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa50157930 con 0x7faa500d1450 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa50155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa50155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58396/0 (socket says 172.21.15.1:58396) 2023-12-02T01:29:49.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 -- 172.21.15.1:0/2284981803 learned_addr learned my addr 172.21.15.1:0/2284981803 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4effd640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa5015f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4f7fe640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa500b2450 0x7faa5015e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 -- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 msgr2=0x7faa5015f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa5015f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 -- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa500b2450 msgr2=0x7faa5015e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa500b2450 0x7faa5015e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 -- 172.21.15.1:0/2284981803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa40009400 con 0x7faa50160ab0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa4ffff640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa50155900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa4800efc0 tx=0x7faa4800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa37fff640 1 -- 172.21.15.1:0/2284981803 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48014480 con 0x7faa50160ab0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa37fff640 1 -- 172.21.15.1:0/2284981803 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4800f040 con 0x7faa50160ab0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa50157c10 con 0x7faa50160ab0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa37fff640 1 -- 172.21.15.1:0/2284981803 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48014820 con 0x7faa50160ab0 2023-12-02T01:29:49.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.205+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa50155e40 con 0x7faa50160ab0 2023-12-02T01:29:49.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.206+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50158130 con 0x7faa50160ab0 2023-12-02T01:29:49.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.207+0000 7faa37fff640 1 -- 172.21.15.1:0/2284981803 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa48014980 con 0x7faa50160ab0 2023-12-02T01:29:49.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.207+0000 7faa37fff640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faa3c06ae70 0x7faa3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.207+0000 7faa37fff640 1 -- 172.21.15.1:0/2284981803 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa4808a0e0 con 0x7faa50160ab0 2023-12-02T01:29:49.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.207+0000 7faa4f7fe640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faa3c06ae70 0x7faa3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.208+0000 7faa4f7fe640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faa3c06ae70 0x7faa3c06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa40036000 tx=0x7faa40008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.211+0000 7faa37fff640 1 -- 172.21.15.1:0/2284981803 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa50158130 con 0x7faa50160ab0 2023-12-02T01:29:49.324 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T01:29:49.322+0000 7f6c1fd03640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-02T01:29:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.390+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa50158130 con 0x7faa50160ab0 2023-12-02T01:29:49.393 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.391+0000 7faa37fff640 1 -- 172.21.15.1:0/2284981803 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7faa50158130 con 0x7faa50160ab0 2023-12-02T01:29:49.393 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:49.393 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faa3c06ae70 msgr2=0x7faa3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faa3c06ae70 0x7faa3c06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa40036000 tx=0x7faa40008030 comp rx=0 tx=0).stop 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 msgr2=0x7faa50155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa50155900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa4800efc0 tx=0x7faa4800c490 comp rx=0 tx=0).stop 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 shutdown_connections 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa50160ab0 0x7faa50155900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa500d1450 0x7faa5015f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faa3c06ae70 0x7faa3c06d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 --2- 172.21.15.1:0/2284981803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa500b2450 0x7faa5015e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 >> 172.21.15.1:0/2284981803 conn(0x7faa5009c450 msgr2=0x7faa500ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 shutdown_connections 2023-12-02T01:29:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.393+0000 7faa55aee640 1 -- 172.21.15.1:0/2284981803 wait complete. 2023-12-02T01:29:49.406 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-02T01:29:49.406 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:49.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.511+0000 7ff8ef7b6640 1 Processor -- start 2023-12-02T01:29:49.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.511+0000 7ff8ef7b6640 1 -- start start 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ef7b6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8e815e820 0x7ff8e8099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ef7b6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff8e8099eb0 0x7ff8e80cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ef7b6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80cb830 con 0x7ff8e80cf560 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ef7b6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80cc390 con 0x7ff8e815e820 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ef7b6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80cba60 con 0x7ff8e8099eb0 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ed552640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8e815e820 0x7ff8e8099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ed552640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8e815e820 0x7ff8e8099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58408/0 (socket says 172.21.15.1:58408) 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ed552640 1 -- 172.21.15.1:0/397093508 learned_addr learned my addr 172.21.15.1:0/397093508 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ed552640 1 -- 172.21.15.1:0/397093508 >> v2:172.21.15.167:3300/0 conn(0x7ff8e8099eb0 msgr2=0x7ff8e80cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ecd51640 1 --2- 172.21.15.1:0/397093508 >> v2:172.21.15.167:3300/0 conn(0x7ff8e8099eb0 0x7ff8e80cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ed552640 1 --2- 172.21.15.1:0/397093508 >> v2:172.21.15.167:3300/0 conn(0x7ff8e8099eb0 0x7ff8e80cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ed552640 1 -- 172.21.15.1:0/397093508 >> v1:172.21.15.167:6789/0 conn(0x7ff8e80cf560 legacy=0x7ff8e806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.512+0000 7ff8ed552640 1 -- 172.21.15.1:0/397093508 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e809a310 con 0x7ff8e815e820 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.513+0000 7ff8ed552640 1 --2- 172.21.15.1:0/397093508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e8099970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8071770 tx=0x7ff8e402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd2d4f1d7ea153b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.513+0000 7ff8dffff640 1 -- 172.21.15.1:0/397093508 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40317e0 con 0x7ff8e815e820 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.513+0000 7ff8dffff640 1 -- 172.21.15.1:0/397093508 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4031940 con 0x7ff8e815e820 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.513+0000 7ff8dffff640 1 -- 172.21.15.1:0/397093508 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4031cd0 con 0x7ff8e815e820 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/397093508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 msgr2=0x7ff8e8099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/397093508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e8099970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8071770 tx=0x7ff8e402b880 comp rx=0 tx=0).stop 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/397093508 shutdown_connections 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/397093508 >> v2:172.21.15.167:3300/0 conn(0x7ff8e8099eb0 0x7ff8e80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/397093508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e8099970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/397093508 >> 172.21.15.1:0/397093508 conn(0x7ff8e80d0f20 msgr2=0x7ff8e80d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/397093508 shutdown_connections 2023-12-02T01:29:49.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.514+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/397093508 wait complete. 2023-12-02T01:29:49.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.515+0000 7ff8ef7b6640 1 Processor -- start 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.515+0000 7ff8ef7b6640 1 -- start start 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ef7b6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e8099eb0 0x7ff8e81f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ef7b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e80cf560 0x7ff8e80ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ef7b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e80b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ef7b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b4b90 con 0x7ff8e815e820 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ef7b6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80ca910 con 0x7ff8e8099eb0 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ef7b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80cabc0 con 0x7ff8e80cf560 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e80b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e80b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58422/0 (socket says 172.21.15.1:58422) 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 -- 172.21.15.1:0/1069109239 learned_addr learned my addr 172.21.15.1:0/1069109239 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ed552640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e8099eb0 0x7ff8e81f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ecd51640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e80cf560 0x7ff8e80ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 -- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e80cf560 msgr2=0x7ff8e80ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e80cf560 0x7ff8e80ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 -- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e8099eb0 msgr2=0x7ff8e81f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e8099eb0 0x7ff8e81f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 -- 172.21.15.1:0/1069109239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e40094d0 con 0x7ff8e815e820 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ed552640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e8099eb0 0x7ff8e81f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ecd51640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e80cf560 0x7ff8e80ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8edd53640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e80b55e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c780 tx=0x7ff8e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ddffb640 1 -- 172.21.15.1:0/1069109239 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0004b60 con 0x7ff8e815e820 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ddffb640 1 -- 172.21.15.1:0/1069109239 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e000ce90 con 0x7ff8e815e820 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80caea0 con 0x7ff8e815e820 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.516+0000 7ff8ddffb640 1 -- 172.21.15.1:0/1069109239 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000a850 con 0x7ff8e815e820 2023-12-02T01:29:49.520 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.517+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e80b50c0 con 0x7ff8e815e820 2023-12-02T01:29:49.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.518+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e8067420 con 0x7ff8e815e820 2023-12-02T01:29:49.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.518+0000 7ff8ddffb640 1 -- 172.21.15.1:0/1069109239 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8e000a9b0 con 0x7ff8e815e820 2023-12-02T01:29:49.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.519+0000 7ff8ddffb640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8cc06ae40 0x7ff8cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.519+0000 7ff8ed552640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8cc06ae40 0x7ff8cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.519+0000 7ff8ddffb640 1 -- 172.21.15.1:0/1069109239 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8e0089820 con 0x7ff8e815e820 2023-12-02T01:29:49.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.519+0000 7ff8ed552640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8cc06ae40 0x7ff8cc06d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4036000 tx=0x7ff8e403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.523+0000 7ff8ddffb640 1 -- 172.21.15.1:0/1069109239 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8e0054830 con 0x7ff8e815e820 2023-12-02T01:29:49.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.699+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e80cb090 con 0x7ff8e815e820 2023-12-02T01:29:49.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.700+0000 7ff8ddffb640 1 -- 172.21.15.1:0/1069109239 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7ff8e0057e50 con 0x7ff8e815e820 2023-12-02T01:29:49.702 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:49.702 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:49.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8cc06ae40 msgr2=0x7ff8cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8cc06ae40 0x7ff8cc06d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4036000 tx=0x7ff8e403d040 comp rx=0 tx=0).stop 2023-12-02T01:29:49.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 msgr2=0x7ff8e80b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e80b55e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c780 tx=0x7ff8e000cc40 comp rx=0 tx=0).stop 2023-12-02T01:29:49.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 shutdown_connections 2023-12-02T01:29:49.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8e815e820 0x7ff8e80b55e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8e80cf560 0x7ff8e80ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8cc06ae40 0x7ff8cc06d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 --2- 172.21.15.1:0/1069109239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8e8099eb0 0x7ff8e81f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 >> 172.21.15.1:0/1069109239 conn(0x7ff8e80d0f20 msgr2=0x7ff8e806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 shutdown_connections 2023-12-02T01:29:49.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.702+0000 7ff8ef7b6640 1 -- 172.21.15.1:0/1069109239 wait complete. 2023-12-02T01:29:49.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-02T01:29:49.715 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-02T01:29:49.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-02T01:29:49.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-02T01:29:49.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-02T01:29:49.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-02T01:29:49.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-02T01:29:49.718 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-02T01:29:49.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.895+0000 7f3e2d6ad640 1 Processor -- start 2023-12-02T01:29:49.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.895+0000 7f3e2d6ad640 1 -- start start 2023-12-02T01:29:49.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.896+0000 7f3e2d6ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 0x7f3e280b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.896+0000 7f3e2d6ad640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3e280b2110 0x7f3e280cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.896+0000 7f3e2d6ad640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e280d16a0 con 0x7f3e280d0070 2023-12-02T01:29:49.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.896+0000 7f3e2d6ad640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e280d0520 con 0x7f3e280b2110 2023-12-02T01:29:49.898 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.896+0000 7f3e2d6ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280d1980 con 0x7f3e28160ad0 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e277fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3e280d0070 0x7f3e28161250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45088/0 (socket says 172.21.15.1:45088) 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e277fe640 1 -- 172.21.15.1:0/368000080 learned_addr learned my addr 172.21.15.1:0/368000080 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e267fc640 1 --2- 172.21.15.1:0/368000080 >> v2:172.21.15.1:3300/0 conn(0x7f3e280b2110 0x7f3e280cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e26ffd640 1 --2- 172.21.15.1:0/368000080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 0x7f3e280b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e267fc640 1 -- 172.21.15.1:0/368000080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 msgr2=0x7f3e280b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e267fc640 1 --2- 172.21.15.1:0/368000080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 0x7f3e280b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e267fc640 1 -- 172.21.15.1:0/368000080 >> v1:172.21.15.1:6789/0 conn(0x7f3e280d0070 legacy=0x7f3e28161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e25ffb640 1 -- 172.21.15.1:0/368000080 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170550861 0 0) 0x7f3e280d16a0 con 0x7f3e280d0070 2023-12-02T01:29:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.897+0000 7f3e267fc640 1 -- 172.21.15.1:0/368000080 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280d1c60 con 0x7f3e280b2110 2023-12-02T01:29:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.898+0000 7f0308fae640 1 Processor -- start 2023-12-02T01:29:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.899+0000 7f0308fae640 1 -- start start 2023-12-02T01:29:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.899+0000 7f3e267fc640 1 --2- 172.21.15.1:0/368000080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280b2110 0x7f3e280cfb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e180097a0 tx=0x7f3e1802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bf54b791abbedf server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.899+0000 7f3e25ffb640 1 -- 172.21.15.1:0/368000080 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18031780 con 0x7f3e280b2110 2023-12-02T01:29:49.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.899+0000 7f3e25ffb640 1 -- 172.21.15.1:0/368000080 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e180318e0 con 0x7f3e280b2110 2023-12-02T01:29:49.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0308fae640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f02fc04fcf0 0x7f02fc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0308fae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc047ce0 0x7f02fc048a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0308fae640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc0eb070 con 0x7f02fc0eac90 2023-12-02T01:29:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0308fae640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc048510 con 0x7f02fc04fcf0 2023-12-02T01:29:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f03037fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f02fc0eac90 0x7f02fc04f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45094/0 (socket says 172.21.15.1:45094) 2023-12-02T01:29:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7fa4e69d0640 1 Processor -- start 2023-12-02T01:29:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7fa4e69d0640 1 -- start start 2023-12-02T01:29:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f03037fe640 1 -- 172.21.15.1:0/3178932928 learned_addr learned my addr 172.21.15.1:0/3178932928 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0308fae640 1 -- 172.21.15.1:0/3178932928 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc054cd0 con 0x7f02fc047ce0 2023-12-02T01:29:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0539c02640 1 Processor -- start 2023-12-02T01:29:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0539c02640 1 -- start start 2023-12-02T01:29:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f0303fff640 1 --2- 172.21.15.1:0/3178932928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc047ce0 0x7f02fc048a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.900+0000 7f3e25ffb640 1 -- 172.21.15.1:0/368000080 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18031c70 con 0x7f3e280b2110 2023-12-02T01:29:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7fbaef361640 1 Processor -- start 2023-12-02T01:29:49.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7fbaef361640 1 -- start start 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7fa4e69d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa4e014a620 0x7fa4e006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7fa4e69d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e014ad80 0x7fa4e006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7fa4e69d0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e0072450 con 0x7fa4e00b38a0 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7fa4e69d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e00728e0 con 0x7fa4e014a620 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7fa4e69d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e014aa00 con 0x7fa4e014ad80 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7f0303fff640 1 -- 172.21.15.1:0/3178932928 >> v2:172.21.15.167:3300/0 conn(0x7f02fc04fcf0 msgr2=0x7f02fc055ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7f0303fff640 1 --2- 172.21.15.1:0/3178932928 >> v2:172.21.15.167:3300/0 conn(0x7f02fc04fcf0 0x7f02fc055ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7f0303fff640 1 -- 172.21.15.1:0/3178932928 >> v1:172.21.15.1:6789/0 conn(0x7f02fc0eac90 legacy=0x7f02fc04f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.901+0000 7f0303fff640 1 -- 172.21.15.1:0/3178932928 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0549f0 con 0x7f02fc047ce0 2023-12-02T01:29:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4e4f6d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa4e00b38a0 0x7fa4e0165200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:34986/0 (socket says 172.21.15.1:34986) 2023-12-02T01:29:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4e4f6d640 1 -- 172.21.15.1:0/529394401 learned_addr learned my addr 172.21.15.1:0/529394401 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4df7fe640 1 --2- 172.21.15.1:0/529394401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e014ad80 0x7fa4e006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f0539c02640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f052c050dd0 0x7f052c038630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4dffff640 1 --2- 172.21.15.1:0/529394401 >> v2:172.21.15.167:3300/0 conn(0x7fa4e014a620 0x7fa4e006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4df7fe640 1 -- 172.21.15.1:0/529394401 >> v2:172.21.15.167:3300/0 conn(0x7fa4e014a620 msgr2=0x7fa4e006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4df7fe640 1 --2- 172.21.15.1:0/529394401 >> v2:172.21.15.167:3300/0 conn(0x7fa4e014a620 0x7fa4e006a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4df7fe640 1 -- 172.21.15.1:0/529394401 >> v1:172.21.15.167:6789/0 conn(0x7fa4e00b38a0 legacy=0x7fa4e0165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f0532ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f052c050dd0 0x7f052c038630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fa4df7fe640 1 -- 172.21.15.1:0/529394401 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e0071840 con 0x7fa4e014ad80 2023-12-02T01:29:49.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/368000080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280b2110 msgr2=0x7f3e280cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f3e2d6ad640 1 --2- 172.21.15.1:0/368000080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280b2110 0x7f3e280cfb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e180097a0 tx=0x7f3e1802b820 comp rx=0 tx=0).stop 2023-12-02T01:29:49.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/368000080 shutdown_connections 2023-12-02T01:29:49.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f3e2d6ad640 1 --2- 172.21.15.1:0/368000080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280b2110 0x7f3e280cfb30 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e180097a0 tx=0x7f3e1802b820 comp rx=0 tx=0).stop 2023-12-02T01:29:49.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f3e2d6ad640 1 --2- 172.21.15.1:0/368000080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 0x7f3e280b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/368000080 >> 172.21.15.1:0/368000080 conn(0x7f3e2809c500 msgr2=0x7f3e280d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f0532ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f052c050dd0 0x7f052c038630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58448/0 (socket says 172.21.15.1:58448) 2023-12-02T01:29:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f0532ffd640 1 -- 172.21.15.1:0/152389071 learned_addr learned my addr 172.21.15.1:0/152389071 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7fbaef361640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80b34b0 0x7fbae80b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.909 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.902+0000 7f0539c02640 1 --2- 172.21.15.1:0/152389071 >> v2:172.21.15.167:3300/0 conn(0x7f052c03a5d0 0x7f052c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaef361640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbae80cc6a0 0x7fbae80ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c04f540 con 0x7f052c0e1090 2023-12-02T01:29:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c04f820 con 0x7f052c050dd0 2023-12-02T01:29:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c04fb00 con 0x7f052c03a5d0 2023-12-02T01:29:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaef361640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae80702e0 con 0x7fbae806c890 2023-12-02T01:29:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaef361640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae8070530 con 0x7fbae80cc6a0 2023-12-02T01:29:49.910 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaef361640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8070810 con 0x7fbae80b34b0 2023-12-02T01:29:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/368000080 shutdown_connections 2023-12-02T01:29:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f0303fff640 1 --2- 172.21.15.1:0/3178932928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc047ce0 0x7f02fc048a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0304064320 tx=0x7f03040a5c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=918593356af34ec7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f0533fff640 1 --2- 172.21.15.1:0/152389071 >> v2:172.21.15.167:3300/0 conn(0x7f052c03a5d0 0x7f052c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaed8fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbae80cc6a0 0x7fbae80ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaec8fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80b34b0 0x7fbae80b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaed8fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbae80cc6a0 0x7fbae80ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58462/0 (socket says 172.21.15.1:58462) 2023-12-02T01:29:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fbaed8fe640 1 -- 172.21.15.1:0/2831999988 learned_addr learned my addr 172.21.15.1:0/2831999988 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f03027fc640 1 -- 172.21.15.1:0/3178932928 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040a6af0 con 0x7f02fc047ce0 2023-12-02T01:29:49.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7fa4df7fe640 1 --2- 172.21.15.1:0/529394401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e014ad80 0x7fa4e006aa10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009d90 tx=0x7fa4d802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed726de031512872 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/368000080 wait complete. 2023-12-02T01:29:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f03027fc640 1 -- 172.21.15.1:0/3178932928 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040a6c50 con 0x7f02fc047ce0 2023-12-02T01:29:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.903+0000 7f03027fc640 1 -- 172.21.15.1:0/3178932928 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040ae640 con 0x7f02fc047ce0 2023-12-02T01:29:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fbaec8fc640 1 -- 172.21.15.1:0/2831999988 >> v2:172.21.15.1:3300/0 conn(0x7fbae80cc6a0 msgr2=0x7fbae80ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fbaec8fc640 1 --2- 172.21.15.1:0/2831999988 >> v2:172.21.15.1:3300/0 conn(0x7fbae80cc6a0 0x7fbae80ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fbaec8fc640 1 -- 172.21.15.1:0/2831999988 >> v1:172.21.15.167:6789/0 conn(0x7fbae806c890 legacy=0x7fbae806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fbaec8fc640 1 -- 172.21.15.1:0/2831999988 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8070af0 con 0x7fbae80b34b0 2023-12-02T01:29:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fa4deffd640 1 -- 172.21.15.1:0/529394401 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d802cbd0 con 0x7fa4e014ad80 2023-12-02T01:29:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fa4deffd640 1 -- 172.21.15.1:0/529394401 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d802cd30 con 0x7fa4e014ad80 2023-12-02T01:29:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fcd94b54640 1 Processor -- start 2023-12-02T01:29:49.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7fcd94b54640 1 -- start start 2023-12-02T01:29:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0308fae640 1 -- 172.21.15.1:0/3178932928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc047ce0 msgr2=0x7f02fc048a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7f0532ffd640 1 -- 172.21.15.1:0/152389071 >> v2:172.21.15.167:3300/0 conn(0x7f052c03a5d0 msgr2=0x7f052c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7f05327fc640 1 -- 172.21.15.1:0/152389071 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920269439 0 0) 0x7f052c04f540 con 0x7f052c0e1090 2023-12-02T01:29:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7f0532ffd640 1 --2- 172.21.15.1:0/152389071 >> v2:172.21.15.167:3300/0 conn(0x7f052c03a5d0 0x7f052c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7f0532ffd640 1 -- 172.21.15.1:0/152389071 >> v1:172.21.15.1:6789/0 conn(0x7f052c0e1090 legacy=0x7f052c039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7f0532ffd640 1 -- 172.21.15.1:0/152389071 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c04fde0 con 0x7f052c050dd0 2023-12-02T01:29:49.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.904+0000 7f0533fff640 1 --2- 172.21.15.1:0/152389071 >> v2:172.21.15.167:3300/0 conn(0x7f052c03a5d0 0x7f052c005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f2a7e4ad640 1 Processor -- start 2023-12-02T01:29:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0308fae640 1 --2- 172.21.15.1:0/3178932928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc047ce0 0x7f02fc048a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0304064320 tx=0x7f03040a5c80 comp rx=0 tx=0).stop 2023-12-02T01:29:49.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 -- 172.21.15.1:0/529394401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e014ad80 msgr2=0x7fa4e006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0308fae640 1 -- 172.21.15.1:0/3178932928 shutdown_connections 2023-12-02T01:29:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0308fae640 1 --2- 172.21.15.1:0/3178932928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc047ce0 0x7f02fc048a30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0308fae640 1 --2- 172.21.15.1:0/3178932928 >> v2:172.21.15.167:3300/0 conn(0x7f02fc04fcf0 0x7f02fc055ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0308fae640 1 -- 172.21.15.1:0/3178932928 >> 172.21.15.1:0/3178932928 conn(0x7f02fc054ee0 msgr2=0x7f02fc0552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fbaec8fc640 1 --2- 172.21.15.1:0/2831999988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80b34b0 0x7fbae80b3930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbad80097a0 tx=0x7fbad802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3c916731ebc720 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fbadffff640 1 -- 172.21.15.1:0/2831999988 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad802d040 con 0x7fbae80b34b0 2023-12-02T01:29:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fbadffff640 1 -- 172.21.15.1:0/2831999988 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad8031810 con 0x7fbae80b34b0 2023-12-02T01:29:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fbadffff640 1 -- 172.21.15.1:0/2831999988 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8031ba0 con 0x7fbae80b34b0 2023-12-02T01:29:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f3e2d6ad640 1 Processor -- start 2023-12-02T01:29:49.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0308fae640 1 -- 172.21.15.1:0/3178932928 shutdown_connections 2023-12-02T01:29:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7f3e2d6ad640 1 -- start start 2023-12-02T01:29:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f2a7e4ad640 1 -- start start 2023-12-02T01:29:49.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7f0532ffd640 1 --2- 172.21.15.1:0/152389071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c050dd0 0x7f052c038630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f052c0e5ad0 tx=0x7f052802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd4b049a9b1461b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 --2- 172.21.15.1:0/529394401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e014ad80 0x7fa4e006aa10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009d90 tx=0x7fa4d802be20 comp rx=0 tx=0).stop 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 -- 172.21.15.1:0/529394401 shutdown_connections 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 --2- 172.21.15.1:0/529394401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e014ad80 0x7fa4e006aa10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 --2- 172.21.15.1:0/529394401 >> v2:172.21.15.167:3300/0 conn(0x7fa4e014a620 0x7fa4e006a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 -- 172.21.15.1:0/529394401 >> 172.21.15.1:0/529394401 conn(0x7fa4e00b1be0 msgr2=0x7fa4e00b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 -- 172.21.15.1:0/529394401 shutdown_connections 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.905+0000 7fa4e69d0640 1 -- 172.21.15.1:0/529394401 wait complete. 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd94b54640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcd90154120 0x7fcd9006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd94b54640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd9015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.920 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd94b54640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9015d8b0 con 0x7fcd9015e280 2023-12-02T01:29:49.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd94b54640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900cfae0 con 0x7fcd90154120 2023-12-02T01:29:49.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd94b54640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9015d610 con 0x7fcd900ced40 2023-12-02T01:29:49.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7f0308fae640 1 -- 172.21.15.1:0/3178932928 wait complete. 2023-12-02T01:29:49.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fbaef361640 1 -- 172.21.15.1:0/2831999988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80b34b0 msgr2=0x7fbae80b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fbaef361640 1 --2- 172.21.15.1:0/2831999988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80b34b0 0x7fbae80b3930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbad80097a0 tx=0x7fbad802b8b0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7f2a7e4ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a700061d0 0x7f2a70006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7f2a7e4ad640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2a7003c0b0 0x7f2a7003c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7f2a7e4ad640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a70007860 con 0x7f2a70053770 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7f2a7e4ad640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a70006c50 con 0x7f2a7003c0b0 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7f2a7e4ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70006f30 con 0x7f2a700061d0 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd8f7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcd90154120 0x7fcd9006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd8f7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcd90154120 0x7fcd9006e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58464/0 (socket says 172.21.15.1:58464) 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd8f7fe640 1 -- 172.21.15.1:0/1785327415 learned_addr learned my addr 172.21.15.1:0/1785327415 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.906+0000 7fcd8effd640 1 --2- 172.21.15.1:0/1785327415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd9015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a7d4ab640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2a70053770 0x7f2a70053b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45122/0 (socket says 172.21.15.1:45122) 2023-12-02T01:29:49.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a7d4ab640 1 -- 172.21.15.1:0/740548429 learned_addr learned my addr 172.21.15.1:0/740548429 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:49.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7f0308fae640 1 Processor -- start 2023-12-02T01:29:49.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f05327fc640 1 -- 172.21.15.1:0/152389071 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528030860 con 0x7f052c050dd0 2023-12-02T01:29:49.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f05327fc640 1 -- 172.21.15.1:0/152389071 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05280309c0 con 0x7f052c050dd0 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f05327fc640 1 -- 172.21.15.1:0/152389071 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528030d50 con 0x7f052c050dd0 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fbaef361640 1 -- 172.21.15.1:0/2831999988 shutdown_connections 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fbaef361640 1 --2- 172.21.15.1:0/2831999988 >> v2:172.21.15.1:3300/0 conn(0x7fbae80cc6a0 0x7fbae80ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fbaef361640 1 --2- 172.21.15.1:0/2831999988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80b34b0 0x7fbae80b3930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fbaef361640 1 -- 172.21.15.1:0/2831999988 >> 172.21.15.1:0/2831999988 conn(0x7fbae806a8f0 msgr2=0x7fbae806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fbaef361640 1 -- 172.21.15.1:0/2831999988 shutdown_connections 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fbaef361640 1 -- 172.21.15.1:0/2831999988 wait complete. 2023-12-02T01:29:49.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fa4e69d0640 1 Processor -- start 2023-12-02T01:29:49.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fa4e69d0640 1 -- start start 2023-12-02T01:29:49.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fcd8effd640 1 -- 172.21.15.1:0/1785327415 >> v2:172.21.15.1:3300/0 conn(0x7fcd90154120 msgr2=0x7fcd9006e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fcd8effd640 1 --2- 172.21.15.1:0/1785327415 >> v2:172.21.15.1:3300/0 conn(0x7fcd90154120 0x7fcd9006e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fcd8effd640 1 -- 172.21.15.1:0/1785327415 >> v1:172.21.15.1:6789/0 conn(0x7fcd9015e280 legacy=0x7fcd90160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fcd8effd640 1 -- 172.21.15.1:0/1785327415 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd90154500 con 0x7fcd900ced40 2023-12-02T01:29:49.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fcd8f7fe640 1 --2- 172.21.15.1:0/1785327415 >> v2:172.21.15.1:3300/0 conn(0x7fcd90154120 0x7fcd9006e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:49.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f3e2d6ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280d0070 0x7f3e2815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a7dcac640 1 --2- 172.21.15.1:0/740548429 >> v2:172.21.15.1:3300/0 conn(0x7f2a7003c0b0 0x7f2a7003c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a6ffff640 1 -- 172.21.15.1:0/740548429 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964442298 0 0) 0x7f2a70007860 con 0x7f2a70053770 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a6ffff640 1 -- 172.21.15.1:0/740548429 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a64003520 con 0x7f2a70053770 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a7dcac640 1 -- 172.21.15.1:0/740548429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a700061d0 msgr2=0x7f2a70006630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a7dcac640 1 --2- 172.21.15.1:0/740548429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a700061d0 0x7f2a70006630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a7dcac640 1 -- 172.21.15.1:0/740548429 >> v1:172.21.15.1:6789/0 conn(0x7f2a70053770 legacy=0x7f2a70053b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7f2a7dcac640 1 -- 172.21.15.1:0/740548429 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70007210 con 0x7f2a7003c0b0 2023-12-02T01:29:49.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fb6a01b6640 1 Processor -- start 2023-12-02T01:29:49.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7f0308fae640 1 -- start start 2023-12-02T01:29:49.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c050dd0 msgr2=0x7f052c038630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7f0539c02640 1 --2- 172.21.15.1:0/152389071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c050dd0 0x7f052c038630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f052c0e5ad0 tx=0x7f052802b9a0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.907+0000 7fb6a01b6640 1 -- start start 2023-12-02T01:29:49.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fcd8effd640 1 --2- 172.21.15.1:0/1785327415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd9015dd40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd840097a0 tx=0x7fcd8402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc623f02bac3c3a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fa4e69d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e00b38a0 0x7fa4e0149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fa4e69d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4e014a620 0x7fa4e01f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fb6a01b6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb6980b34b0 0x7fb6980b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fb6a01b6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb6980cc6a0 0x7fb6980ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fb6a01b6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6980702e0 con 0x7fb69806c890 2023-12-02T01:29:49.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fb6a01b6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb698070530 con 0x7fb6980b34b0 2023-12-02T01:29:49.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.908+0000 7fb6a01b6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb698070810 con 0x7fb6980cc6a0 2023-12-02T01:29:49.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 shutdown_connections 2023-12-02T01:29:49.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f0539c02640 1 --2- 172.21.15.1:0/152389071 >> v2:172.21.15.167:3300/0 conn(0x7f052c03a5d0 0x7f052c005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f0539c02640 1 --2- 172.21.15.1:0/152389071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c050dd0 0x7f052c038630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 >> 172.21.15.1:0/152389071 conn(0x7f052c009fb0 msgr2=0x7f052c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fcd8e7fc640 1 -- 172.21.15.1:0/1785327415 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84031780 con 0x7fcd900ced40 2023-12-02T01:29:49.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fcd8e7fc640 1 -- 172.21.15.1:0/1785327415 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd840318e0 con 0x7fcd900ced40 2023-12-02T01:29:49.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280d0070 0x7f3e2815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280d0070 0x7f3e2815a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58484/0 (socket says 172.21.15.1:58484) 2023-12-02T01:29:49.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e26ffd640 1 -- 172.21.15.1:0/3135637056 learned_addr learned my addr 172.21.15.1:0/3135637056 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e2d6ad640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 0x7f3e280b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4e69d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e0147100 0x7fa4e01faca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f2a7dcac640 1 --2- 172.21.15.1:0/740548429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7003c0b0 0x7f2a7003c540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a740097a0 tx=0x7f2a7402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a145c65752c08d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4e69d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0148280 con 0x7fa4e014a620 2023-12-02T01:29:49.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4e69d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0147600 con 0x7fa4e00b38a0 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4e69d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e01478e0 con 0x7fa4e0147100 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4dffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e00b38a0 0x7fa4e0149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4e014a620 0x7fa4e01f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4e014a620 0x7fa4e01f7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58504/0 (socket says 172.21.15.1:58504) 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4df7fe640 1 -- 172.21.15.1:0/2438260926 learned_addr learned my addr 172.21.15.1:0/2438260926 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69e753640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb6980cc6a0 0x7fb6980ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69e753640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb6980cc6a0 0x7fb6980ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:59020/0 (socket says 172.21.15.1:59020) 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69e753640 1 -- 172.21.15.1:0/3666576871 learned_addr learned my addr 172.21.15.1:0/3666576871 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69df52640 1 --1- 172.21.15.1:0/3666576871 >> v1:172.21.15.167:6789/0 conn(0x7fb69806c890 0x7fb69806cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:34992/0 (socket says 172.21.15.1:34992) 2023-12-02T01:29:49.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e2d6ad640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e280b5dc0 0x7f3e281515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fcd8e7fc640 1 -- 172.21.15.1:0/1785327415 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84031c70 con 0x7fcd900ced40 2023-12-02T01:29:49.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cc7e0 con 0x7f3e280d0070 2023-12-02T01:29:49.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e267fc640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 0x7f3e280b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280ca5d0 con 0x7f3e280b5dc0 2023-12-02T01:29:49.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280ca2a0 con 0x7f3e28160ad0 2023-12-02T01:29:49.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fa4e4f6d640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e0147100 0x7fa4e01faca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69d751640 1 --2- 172.21.15.1:0/3666576871 >> v2:172.21.15.1:3300/0 conn(0x7fb6980b34b0 0x7fb6980b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69e753640 1 -- 172.21.15.1:0/3666576871 >> v2:172.21.15.1:3300/0 conn(0x7fb6980b34b0 msgr2=0x7fb6980b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 shutdown_connections 2023-12-02T01:29:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7f2a6ffff640 1 -- 172.21.15.1:0/740548429 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74031640 con 0x7f2a7003c0b0 2023-12-02T01:29:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f0539c02640 1 -- 172.21.15.1:0/152389071 wait complete. 2023-12-02T01:29:49.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f2a6ffff640 1 -- 172.21.15.1:0/740548429 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740317a0 con 0x7f2a7003c0b0 2023-12-02T01:29:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f0308fae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02fc04fcf0 0x7f02fc0390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fa4df7fe640 1 -- 172.21.15.1:0/2438260926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e0147100 msgr2=0x7fa4e01faca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fa4df7fe640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4e0147100 0x7fa4e01faca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fa4df7fe640 1 -- 172.21.15.1:0/2438260926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e00b38a0 msgr2=0x7fa4e0149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fa4df7fe640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4e00b38a0 0x7fa4e0149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f0308fae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc0eac90 0x7f02fc03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fa4df7fe640 1 -- 172.21.15.1:0/2438260926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009a70 con 0x7fa4e014a620 2023-12-02T01:29:49.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f0308fae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02fc180d90 0x7f02fc0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f03037fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02fc04fcf0 0x7f02fc0390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fbaef361640 1 Processor -- start 2023-12-02T01:29:49.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fcd94b54640 1 -- 172.21.15.1:0/1785327415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 msgr2=0x7fcd9015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fcd94b54640 1 --2- 172.21.15.1:0/1785327415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd9015dd40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd840097a0 tx=0x7fcd8402b820 comp rx=0 tx=0).stop 2023-12-02T01:29:49.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69e753640 1 --2- 172.21.15.1:0/3666576871 >> v2:172.21.15.1:3300/0 conn(0x7fb6980b34b0 0x7fb6980b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.909+0000 7fb69e753640 1 -- 172.21.15.1:0/3666576871 >> v1:172.21.15.167:6789/0 conn(0x7fb69806c890 legacy=0x7fb69806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fbaef361640 1 -- start start 2023-12-02T01:29:49.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f2a6ffff640 1 -- 172.21.15.1:0/740548429 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74031b70 con 0x7f2a7003c0b0 2023-12-02T01:29:49.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fb69e753640 1 -- 172.21.15.1:0/3666576871 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb698070af0 con 0x7fb6980cc6a0 2023-12-02T01:29:49.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fb69d751640 1 --2- 172.21.15.1:0/3666576871 >> v2:172.21.15.1:3300/0 conn(0x7fb6980b34b0 0x7fb6980b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f03037fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02fc04fcf0 0x7f02fc0390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:59038/0 (socket says 172.21.15.1:59038) 2023-12-02T01:29:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f3e26ffd640 1 -- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 msgr2=0x7f3e280b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f3e26ffd640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e28160ad0 0x7f3e280b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f3e26ffd640 1 -- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e280b5dc0 msgr2=0x7f3e281515c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-02T01:29:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f3e26ffd640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e280b5dc0 0x7f3e281515c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f3e26ffd640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18009400 con 0x7f3e280d0070 2023-12-02T01:29:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fcd94b54640 1 -- 172.21.15.1:0/1785327415 shutdown_connections 2023-12-02T01:29:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fcd94b54640 1 --2- 172.21.15.1:0/1785327415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd9015dd40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fcd94b54640 1 --2- 172.21.15.1:0/1785327415 >> v2:172.21.15.1:3300/0 conn(0x7fcd90154120 0x7fcd9006e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fcd94b54640 1 -- 172.21.15.1:0/1785327415 >> 172.21.15.1:0/1785327415 conn(0x7fcd90070ad0 msgr2=0x7fcd900b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f0302ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc0eac90 0x7f02fc03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7f3e26ffd640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280d0070 0x7f3e2815a610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d5f0 tx=0x7f3e1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.910+0000 7fa4df7fe640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4e014a620 0x7fa4e01f7670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009d90 tx=0x7fa4d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0302ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc0eac90 0x7f02fc03a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42210/0 (socket says 172.21.15.1:42210) 2023-12-02T01:29:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0125f0 con 0x7f3e280d0070 2023-12-02T01:29:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c012750 con 0x7f3e280d0070 2023-12-02T01:29:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f2a7e4ad640 1 -- 172.21.15.1:0/740548429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7003c0b0 msgr2=0x7f2a7003c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f2a7e4ad640 1 --2- 172.21.15.1:0/740548429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7003c0b0 0x7f2a7003c540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a740097a0 tx=0x7f2a7402b8f0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7fcd94b54640 1 -- 172.21.15.1:0/1785327415 shutdown_connections 2023-12-02T01:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7fb69e753640 1 --2- 172.21.15.1:0/3666576871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 0x7fb6980ccb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb69814b5b0 tx=0x7fb69002bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f1024f1dd943e1f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8034e50 con 0x7fa4e014a620 2023-12-02T01:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d803f630 con 0x7fa4e014a620 2023-12-02T01:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0308fae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0d31a0 con 0x7f02fc180d90 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0308fae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0396f0 con 0x7f02fc04fcf0 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0308fae640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0399d0 con 0x7f02fc0eac90 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f03037fe640 1 -- 172.21.15.1:0/591457970 learned_addr learned my addr 172.21.15.1:0/591457970 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0303fff640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02fc180d90 0x7f02fc0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0303fff640 1 -- 172.21.15.1:0/591457970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc0eac90 msgr2=0x7f02fc03a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0303fff640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02fc0eac90 0x7f02fc03a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e280b65d0 con 0x7f3e280d0070 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f3e2d6ad640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e280b6b90 con 0x7f3e280d0070 2023-12-02T01:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c012ac0 con 0x7f3e280d0070 2023-12-02T01:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0303fff640 1 -- 172.21.15.1:0/591457970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02fc04fcf0 msgr2=0x7f02fc0390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0303fff640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02fc04fcf0 0x7f02fc0390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7f0303fff640 1 -- 172.21.15.1:0/591457970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030404f730 con 0x7f02fc180d90 2023-12-02T01:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.911+0000 7fb69cf50640 1 -- 172.21.15.1:0/3666576871 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69002c8e0 con 0x7fb6980cc6a0 2023-12-02T01:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fb69cf50640 1 -- 172.21.15.1:0/3666576871 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69002ca40 con 0x7fb6980cc6a0 2023-12-02T01:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fb69cf50640 1 -- 172.21.15.1:0/3666576871 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69002cdd0 con 0x7fb6980cc6a0 2023-12-02T01:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaef361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbae806c890 0x7fbae815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f0303fff640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02fc180d90 0x7f02fc0cee60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0304050020 tx=0x7f03040695d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaef361640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbae80b34b0 0x7fbae8140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaef361640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80cc6a0 0x7fbae80afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaef361640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8162a30 con 0x7fbae806c890 2023-12-02T01:29:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaef361640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae815e420 con 0x7fbae80b34b0 2023-12-02T01:29:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaef361640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8161e20 con 0x7fbae80cc6a0 2023-12-02T01:29:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fa4e69d0640 1 -- 172.21.15.1:0/2438260926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e0147bc0 con 0x7fa4e014a620 2023-12-02T01:29:49.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fa4e69d0640 1 -- 172.21.15.1:0/2438260926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e0149d60 con 0x7fa4e014a620 2023-12-02T01:29:49.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f2a7e4ad640 1 -- 172.21.15.1:0/740548429 shutdown_connections 2023-12-02T01:29:49.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f2a7e4ad640 1 --2- 172.21.15.1:0/740548429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a700061d0 0x7f2a70006630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f2a7e4ad640 1 --2- 172.21.15.1:0/740548429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7003c0b0 0x7f2a7003c540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f2a7e4ad640 1 -- 172.21.15.1:0/740548429 >> 172.21.15.1:0/740548429 conn(0x7f2a7003aa00 msgr2=0x7f2a7003ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e00000fc0 con 0x7f3e280d0070 2023-12-02T01:29:49.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fcd94b54640 1 -- 172.21.15.1:0/1785327415 wait complete. 2023-12-02T01:29:49.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f02effff640 1 -- 172.21.15.1:0/591457970 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040ba650 con 0x7f02fc180d90 2023-12-02T01:29:49.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f02effff640 1 -- 172.21.15.1:0/591457970 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040ba7b0 con 0x7f02fc180d90 2023-12-02T01:29:49.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f02effff640 1 -- 172.21.15.1:0/591457970 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040bab20 con 0x7f02fc180d90 2023-12-02T01:29:49.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc039cb0 con 0x7f02fc180d90 2023-12-02T01:29:49.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc03a270 con 0x7f02fc180d90 2023-12-02T01:29:49.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f0539c02640 1 Processor -- start 2023-12-02T01:29:49.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7f0539c02640 1 -- start start 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaed0fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbae806c890 0x7fbae815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaed0fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbae806c890 0x7fbae815dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58516/0 (socket says 172.21.15.1:58516) 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fbaed0fd640 1 -- 172.21.15.1:0/2357114076 learned_addr learned my addr 172.21.15.1:0/2357114076 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fbaed0fd640 1 -- 172.21.15.1:0/2357114076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80cc6a0 msgr2=0x7fbae80afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fbaed0fd640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbae80cc6a0 0x7fbae80afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fbaed0fd640 1 -- 172.21.15.1:0/2357114076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbae80b34b0 msgr2=0x7fbae8140ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fbaed0fd640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbae80b34b0 0x7fbae8140ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fbaed0fd640 1 -- 172.21.15.1:0/2357114076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8009400 con 0x7fbae806c890 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7fbaed0fd640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbae806c890 0x7fbae815dee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbae400c400 tx=0x7fbae400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f2a7e4ad640 1 -- 172.21.15.1:0/740548429 shutdown_connections 2023-12-02T01:29:49.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7f2a7e4ad640 1 -- 172.21.15.1:0/740548429 wait complete. 2023-12-02T01:29:49.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f2a7e4ad640 1 Processor -- start 2023-12-02T01:29:49.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fb6a01b6640 1 -- 172.21.15.1:0/3666576871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 msgr2=0x7fb6980ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fb6a01b6640 1 --2- 172.21.15.1:0/3666576871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 0x7fb6980ccb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb69814b5b0 tx=0x7fb69002bdc0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.912+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d803f9a0 con 0x7fa4e014a620 2023-12-02T01:29:49.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.913+0000 7fa4e69d0640 1 -- 172.21.15.1:0/2438260926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4e00720e0 con 0x7fa4e014a620 2023-12-02T01:29:49.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4d803fb00 con 0x7fa4e014a620 2023-12-02T01:29:49.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae40052d0 con 0x7fbae806c890 2023-12-02T01:29:49.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f0539c02640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f052c03a5d0 0x7f052c04d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f2a7e4ad640 1 -- start start 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f0539c02640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f052c050dd0 0x7f052c0e2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f0539c02640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c0e1090 0x7f052c0e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f0539c02640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c177750 con 0x7f052c0e1090 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f0539c02640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c054610 con 0x7f052c050dd0 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f0539c02640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c176e20 con 0x7f052c03a5d0 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4005450 con 0x7fbae806c890 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae8162100 con 0x7fbae806c890 2023-12-02T01:29:49.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4007260 con 0x7fbae806c890 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fb6a01b6640 1 -- 172.21.15.1:0/3666576871 shutdown_connections 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fb6a01b6640 1 --2- 172.21.15.1:0/3666576871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 0x7fb6980ccb30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fb6a01b6640 1 --2- 172.21.15.1:0/3666576871 >> v2:172.21.15.1:3300/0 conn(0x7fb6980b34b0 0x7fb6980b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fb6a01b6640 1 -- 172.21.15.1:0/3666576871 >> 172.21.15.1:0/3666576871 conn(0x7fb69806a8f0 msgr2=0x7fb69806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fb6a01b6640 1 -- 172.21.15.1:0/3666576871 shutdown_connections 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fa4dcff9640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa4cc06af10 0x7fa4cc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4d80ac510 con 0x7fa4e014a620 2023-12-02T01:29:49.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fa4dcff9640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6816/1775472868,v1:172.21.15.1:6817/1775472868] conn(0x7fa4cc072fc0 0x7fa4cc0753e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fcd94b54640 1 Processor -- start 2023-12-02T01:29:49.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7f0533fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c0e1090 0x7f052c0e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7f0533fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c0e1090 0x7f052c0e26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58524/0 (socket says 172.21.15.1:58524) 2023-12-02T01:29:49.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7f0533fff640 1 -- 172.21.15.1:0/2725344882 learned_addr learned my addr 172.21.15.1:0/2725344882 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae81626c0 con 0x7fbae806c890 2023-12-02T01:29:49.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 --> [v2:172.21.15.1:6816/1775472868,v1:172.21.15.1:6817/1775472868] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4cc075a90 con 0x7fa4cc072fc0 2023-12-02T01:29:49.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d80ac8c0 con 0x7fa4e014a620 2023-12-02T01:29:49.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fa4dffff640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa4cc06af10 0x7fa4cc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fb6a01b6640 1 -- 172.21.15.1:0/3666576871 wait complete. 2023-12-02T01:29:49.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7fa4e4f6d640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6816/1775472868,v1:172.21.15.1:6817/1775472868] conn(0x7fa4cc072fc0 0x7fa4cc0753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e1c012c20 con 0x7f3e280d0070 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.914+0000 7f3e0f7fe640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3e1406ae90 0x7f3e1406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e1c089af0 con 0x7f3e280d0070 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7f3e0f7fe640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:6816/1330589342,v1:172.21.15.167:6817/1330589342] conn(0x7f3e14073030 0x7f3e14075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.167:6816/1330589342,v1:172.21.15.167:6817/1330589342] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e14075b00 con 0x7f3e14073030 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7f0533fff640 1 -- 172.21.15.1:0/2725344882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f052c03a5d0 msgr2=0x7f052c04d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7f0533fff640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f052c03a5d0 0x7f052c04d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7f0533fff640 1 -- 172.21.15.1:0/2725344882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f052c050dd0 msgr2=0x7f052c0e2180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7f0533fff640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f052c050dd0 0x7f052c0e2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7f0533fff640 1 -- 172.21.15.1:0/2725344882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053404f730 con 0x7f052c0e1090 2023-12-02T01:29:49.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7fa4dffff640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa4cc06af10 0x7fa4cc06d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0003610 tx=0x7fa4d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7fa4e4f6d640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6816/1775472868,v1:172.21.15.1:6817/1775472868] conn(0x7fa4cc072fc0 0x7fa4cc0753e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.915+0000 7fcd94b54640 1 -- start start 2023-12-02T01:29:49.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7f3e267fc640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3e1406ae90 0x7f3e1406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f0533fff640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c0e1090 0x7f052c0e26c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f053404fab0 tx=0x7f0534067f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.916+0000 7f02effff640 1 -- 172.21.15.1:0/591457970 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03040bac80 con 0x7f02fc180d90 2023-12-02T01:29:49.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f02effff640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02e806af10 0x7f02e806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f02effff640 1 -- 172.21.15.1:0/591457970 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0304125c80 con 0x7f02fc180d90 2023-12-02T01:29:49.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f03037fe640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02e806af10 0x7f02e806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbae8148aa0 con 0x7fbae806c890 2023-12-02T01:29:49.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fb6a01b6640 1 Processor -- start 2023-12-02T01:29:49.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fb6a01b6640 1 -- start start 2023-12-02T01:29:49.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f3e267fc640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3e1406ae90 0x7f3e1406d350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e18036000 tx=0x7f3e1803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0549c0 con 0x7f3e280d0070 2023-12-02T01:29:49.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053406be80 con 0x7f052c0e1090 2023-12-02T01:29:49.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05340721c0 con 0x7f052c0e1090 2023-12-02T01:29:49.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== osd.3 v2:172.21.15.1:6816/1775472868 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa4cc075a90 con 0x7fa4cc072fc0 2023-12-02T01:29:49.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534072530 con 0x7f052c0e1090 2023-12-02T01:29:49.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f3e277fe640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:6816/1330589342,v1:172.21.15.167:6817/1330589342] conn(0x7f3e14073030 0x7f3e14075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f0308fae640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6800/2189085040,v1:172.21.15.1:6801/2189085040] conn(0x7f02fc0cf3a0 0x7f02fc0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fcd94b54640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd901520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fcd94b54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd90154120 0x7fcd9009b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd901520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fcd94b54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd9009b590 0x7fcd9015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd901520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42232/0 (socket says 172.21.15.1:42232) 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8f7fe640 1 -- 172.21.15.1:0/2841211609 learned_addr learned my addr 172.21.15.1:0/2841211609 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05280094d0 con 0x7f052c0e1090 2023-12-02T01:29:49.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c1773e0 con 0x7f052c0e1090 2023-12-02T01:29:49.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7fcd94b54640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b0af0 con 0x7fcd90154120 2023-12-02T01:29:49.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b0660 con 0x7fcd9009b590 2023-12-02T01:29:49.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900afd30 con 0x7fcd900ced40 2023-12-02T01:29:49.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8effd640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd90154120 0x7fcd9009b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.917+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 --> [v2:172.21.15.1:6800/2189085040,v1:172.21.15.1:6801/2189085040] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02fc007120 con 0x7f02fc0cf3a0 2023-12-02T01:29:49.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f03037fe640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02e806af10 0x7f02e806d3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02f0001660 tx=0x7f02f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f0302ffd640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6800/2189085040,v1:172.21.15.1:6801/2189085040] conn(0x7f02fc0cf3a0 0x7f02fc0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbae40073c0 con 0x7fbae806c890 2023-12-02T01:29:49.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8effd640 1 -- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 msgr2=0x7fcd901520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8effd640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd900ced40 0x7fcd901520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8effd640 1 -- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd9009b590 msgr2=0x7fcd9015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8effd640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd9009b590 0x7fcd9015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7fcd8effd640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800094d0 con 0x7fcd90154120 2023-12-02T01:29:49.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb6a01b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb69806c890 0x7fb69815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb6a01b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6980b34b0 0x7fb6981646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7f0302ffd640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6800/2189085040,v1:172.21.15.1:6801/2189085040] conn(0x7f02fc0cf3a0 0x7f02fc0cf780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fcd8effd640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd90154120 0x7fcd9009b050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd9015d750 tx=0x7fcd840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fbaddffb640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbacc06af10 0x7fbacc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f052c00ac50 con 0x7f052c0e1090 2023-12-02T01:29:49.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb69df52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb69806c890 0x7fb69815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb69df52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb69806c890 0x7fb69815c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42236/0 (socket says 172.21.15.1:42236) 2023-12-02T01:29:49.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbae4088900 con 0x7fbae806c890 2023-12-02T01:29:49.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb69df52640 1 -- 172.21.15.1:0/4074953128 learned_addr learned my addr 172.21.15.1:0/4074953128 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb6a01b6640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 0x7fb6981449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fbaddffb640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6823/3438149164,v1:172.21.15.1:6825/3438149164] conn(0x7fbacc073130 0x7fbacc075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f2a7e4ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a700061d0 0x7f2a700ddb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f2a7e4ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7003c0b0 0x7f2a700d8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f2a7e4ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a70053770 0x7f2a700d3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f2a7e4ad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700d6e60 con 0x7f2a70053770 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f2a7e4ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700d9470 con 0x7f2a7003c0b0 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.918+0000 7f2a7e4ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700d9750 con 0x7f2a700061d0 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7f2a7ccaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7003c0b0 0x7f2a700d8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7f2a7ccaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7003c0b0 0x7f2a700d8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:59064/0 (socket says 172.21.15.1:59064) 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7f2a7ccaa640 1 -- 172.21.15.1:0/3925197104 learned_addr learned my addr 172.21.15.1:0/3925197104 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:49.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6981633c0 con 0x7fb6980b34b0 2023-12-02T01:29:49.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb698164220 con 0x7fb6980cc6a0 2023-12-02T01:29:49.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69815cc90 con 0x7fb69806c890 2023-12-02T01:29:49.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 --> [v2:172.21.15.1:6823/3438149164,v1:172.21.15.1:6825/3438149164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbacc075c00 con 0x7fbacc073130 2023-12-02T01:29:49.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84032820 con 0x7fcd90154120 2023-12-02T01:29:49.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbae408d2a0 con 0x7fbae806c890 2023-12-02T01:29:49.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.919+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84032980 con 0x7fcd90154120 2023-12-02T01:29:49.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fbaec8fc640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbacc06af10 0x7fbacc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f3e277fe640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:6816/1330589342,v1:172.21.15.167:6817/1330589342] conn(0x7f3e14073030 0x7f3e14075450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f02effff640 1 -- 172.21.15.1:0/591457970 <== osd.0 v2:172.21.15.1:6800/2189085040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f02f8009480 con 0x7f02fc0cf3a0 2023-12-02T01:29:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0534072690 con 0x7f052c0e1090 2023-12-02T01:29:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f2a7ccaa640 1 -- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a700061d0 msgr2=0x7f2a700ddb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-02T01:29:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f2a7ccaa640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a700061d0 0x7f2a700ddb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f2a7ccaa640 1 -- 172.21.15.1:0/3925197104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a70053770 msgr2=0x7f2a700d3930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-02T01:29:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f2a7ccaa640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a70053770 0x7f2a700d3930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f2a7ccaa640 1 -- 172.21.15.1:0/3925197104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74009400 con 0x7f2a7003c0b0 2023-12-02T01:29:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fb69d751640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6980b34b0 0x7fb6981646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f2a7ccaa640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7003c0b0 0x7f2a700d8c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800b450 tx=0x7f2a6800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fbaed8fe640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6823/3438149164,v1:172.21.15.1:6825/3438149164] conn(0x7fbacc073130 0x7fbacc075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fbaec8fc640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbacc06af10 0x7fbacc06d3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbad8036000 tx=0x7fbad8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fb69e753640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 0x7fb6981449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84032d10 con 0x7fcd90154120 2023-12-02T01:29:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7f051ffff640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f051806af10 0x7f051806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.920+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd84009400 con 0x7fcd90154120 2023-12-02T01:29:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900b02f0 con 0x7fcd90154120 2023-12-02T01:29:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7fb69d751640 1 -- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb69806c890 msgr2=0x7fb69815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7fb69d751640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb69806c890 0x7fb69815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7fb69d751640 1 -- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 msgr2=0x7fb6981449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7fb69d751640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6980cc6a0 0x7fb6981449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7fb69d751640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690009b30 con 0x7fb6980b34b0 2023-12-02T01:29:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7fbaed8fe640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6823/3438149164,v1:172.21.15.1:6825/3438149164] conn(0x7fbacc073130 0x7fbacc075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0534103470 con 0x7f052c0e1090 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f051ffff640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6808/211191071,v1:172.21.15.1:6809/211191071] conn(0x7f0518073130 0x7f0518075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 --> [v2:172.21.15.1:6808/211191071,v1:172.21.15.1:6809/211191071] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0518075c00 con 0x7f0518073130 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0534105a90 con 0x7f052c0e1090 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f0532ffd640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6808/211191071,v1:172.21.15.1:6809/211191071] conn(0x7f0518073130 0x7f0518075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f05337fe640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f051806af10 0x7f051806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68011890 con 0x7f2a7003c0b0 2023-12-02T01:29:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.921+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a680119f0 con 0x7f2a7003c0b0 2023-12-02T01:29:49.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.922+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== osd.5 v2:172.21.15.167:6816/1330589342 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3e14075b00 con 0x7f3e14073030 2023-12-02T01:29:49.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.922+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68011da0 con 0x7f2a7003c0b0 2023-12-02T01:29:49.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.922+0000 7fcd75ffb640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd900cf520 con 0x7fcd90154120 2023-12-02T01:29:49.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.922+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== osd.2 v2:172.21.15.1:6823/3438149164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbacc075c00 con 0x7fbacc073130 2023-12-02T01:29:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.922+0000 7f0532ffd640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6808/211191071,v1:172.21.15.1:6809/211191071] conn(0x7f0518073130 0x7f0518075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.922+0000 7f05337fe640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f051806af10 0x7f051806d3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0520001560 tx=0x7f0520007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.922+0000 7fb69d751640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6980b34b0 0x7fb6981646b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c610 tx=0x7fb68800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.923+0000 7f2a7e4ad640 1 -- 172.21.15.1:0/3925197104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a700d9a30 con 0x7f2a7003c0b0 2023-12-02T01:29:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.923+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== osd.1 v2:172.21.15.1:6808/211191071 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0518075c00 con 0x7f0518073130 2023-12-02T01:29:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.923+0000 7f2a7e4ad640 1 -- 172.21.15.1:0/3925197104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a700d9180 con 0x7f2a7003c0b0 2023-12-02T01:29:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.923+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011800 con 0x7fb6980b34b0 2023-12-02T01:29:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.923+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688011960 con 0x7fb6980b34b0 2023-12-02T01:29:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.923+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb698164bf0 con 0x7fb6980b34b0 2023-12-02T01:29:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.923+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6981638f0 con 0x7fb6980b34b0 2023-12-02T01:29:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.924+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011cf0 con 0x7fb6980b34b0 2023-12-02T01:29:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.924+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd8403b3f0 con 0x7fcd90154120 2023-12-02T01:29:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.925+0000 7fcd77fff640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcd7c06ae40 0x7fcd7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.925+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6980b3e70 con 0x7fb6980b34b0 2023-12-02T01:29:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.925+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd840ab280 con 0x7fcd90154120 2023-12-02T01:29:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.925+0000 7fcd77fff640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:6800/2232039287,v1:172.21.15.167:6801/2232039287] conn(0x7fcd7c072ef0 0x7fcd7c075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.925+0000 7fcd8f7fe640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcd7c06ae40 0x7fcd7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.925+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.167:6800/2232039287,v1:172.21.15.167:6801/2232039287] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd7c0759c0 con 0x7fcd7c072ef0 2023-12-02T01:29:49.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.925+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd840ab630 con 0x7fcd90154120 2023-12-02T01:29:49.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.926+0000 7fcd8f7fe640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcd7c06ae40 0x7fcd7c06d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009db0 tx=0x7fcd80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.926+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb688018360 con 0x7fb6980b34b0 2023-12-02T01:29:49.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.926+0000 7fb68e7fc640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb67c06ae40 0x7fb67c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.926+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a54000fc0 con 0x7f2a7003c0b0 2023-12-02T01:29:49.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.926+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb688089660 con 0x7fb6980b34b0 2023-12-02T01:29:49.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7fb68e7fc640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:6808/4092232180,v1:172.21.15.167:6809/4092232180] conn(0x7fb67c072fe0 0x7fb67c075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.167:6808/4092232180,v1:172.21.15.167:6809/4092232180] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb67c075ab0 con 0x7fb67c072fe0 2023-12-02T01:29:49.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7fb69df52640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb67c06ae40 0x7fb67c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb688054730 con 0x7fb6980b34b0 2023-12-02T01:29:49.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a6801a400 con 0x7f2a7003c0b0 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7f2a6dffb640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2a5c06af10 0x7f2a5c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a68089900 con 0x7f2a7003c0b0 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7f2a6dffb640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:6821/2996316137,v1:172.21.15.167:6823/2996316137] conn(0x7f2a5c0730b0 0x7f2a5c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 --> [v2:172.21.15.167:6821/2996316137,v1:172.21.15.167:6823/2996316137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a5c075b80 con 0x7f2a5c0730b0 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a68054a20 con 0x7f2a7003c0b0 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.927+0000 7f2a7d4ab640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2a5c06af10 0x7f2a5c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7fb69df52640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb67c06ae40 0x7fb67c06d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb694000f60 tx=0x7fb694007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7fcd8ffff640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:6800/2232039287,v1:172.21.15.167:6801/2232039287] conn(0x7fcd7c072ef0 0x7fcd7c075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7f2a7dcac640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:6821/2996316137,v1:172.21.15.167:6823/2996316137] conn(0x7f2a5c0730b0 0x7f2a5c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7fb69e753640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:6808/4092232180,v1:172.21.15.167:6809/4092232180] conn(0x7fb67c072fe0 0x7fb67c075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:49.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7f2a7d4ab640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2a5c06af10 0x7f2a5c06d3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2a78069ca0 tx=0x7f2a780661b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7fcd8ffff640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:6800/2232039287,v1:172.21.15.167:6801/2232039287] conn(0x7fcd7c072ef0 0x7fcd7c075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7f2a7dcac640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:6821/2996316137,v1:172.21.15.167:6823/2996316137] conn(0x7f2a5c0730b0 0x7f2a5c0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.928+0000 7fb69e753640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:6808/4092232180,v1:172.21.15.167:6809/4092232180] conn(0x7fb67c072fe0 0x7fb67c075400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.929+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== osd.4 v2:172.21.15.167:6800/2232039287 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcd7c0759c0 con 0x7fcd7c072ef0 2023-12-02T01:29:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.930+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== osd.6 v2:172.21.15.167:6821/2996316137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2a5c075b80 con 0x7f2a5c0730b0 2023-12-02T01:29:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.930+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== osd.7 v2:172.21.15.167:6808/4092232180 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb67c075ab0 con 0x7fb67c072fe0 2023-12-02T01:29:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.950+0000 7fa4e69d0640 1 -- 172.21.15.1:0/2438260926 --> [v2:172.21.15.1:6816/1775472868,v1:172.21.15.1:6817/1775472868] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4e0071e00 con 0x7fa4cc072fc0 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.950+0000 7fa4dcff9640 1 -- 172.21.15.1:0/2438260926 <== osd.3 v2:172.21.15.1:6816/1775472868 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa4d4004bb0 con 0x7fa4cc072fc0 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.951+0000 7fa4c67fc640 1 -- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6816/1775472868,v1:172.21.15.1:6817/1775472868] conn(0x7fa4cc072fc0 msgr2=0x7fa4cc0753e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.951+0000 7fa4c67fc640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6816/1775472868,v1:172.21.15.1:6817/1775472868] conn(0x7fa4cc072fc0 0x7fa4cc0753e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.951+0000 7fa4c67fc640 1 -- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa4cc06af10 msgr2=0x7fa4cc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.951+0000 7fa4c67fc640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa4cc06af10 0x7fa4cc06d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0003610 tx=0x7fa4d0008040 comp rx=0 tx=0).stop 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.951+0000 7fa4c67fc640 1 -- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4e014a620 msgr2=0x7fa4e01f7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.951+0000 7fa4c67fc640 1 --2- 172.21.15.1:0/2438260926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4e014a620 0x7fa4e01f7670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009d90 tx=0x7fa4d8004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.952+0000 7fa4e4f6d640 1 -- 172.21.15.1:0/2438260926 reap_dead start 2023-12-02T01:29:49.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.952+0000 7fa4c67fc640 1 -- 172.21.15.1:0/2438260926 shutdown_connections 2023-12-02T01:29:49.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.952+0000 7fa4c67fc640 1 -- 172.21.15.1:0/2438260926 >> 172.21.15.1:0/2438260926 conn(0x7fa4e00b1be0 msgr2=0x7fa4e015f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.952+0000 7fa4c67fc640 1 -- 172.21.15.1:0/2438260926 shutdown_connections 2023-12-02T01:29:49.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.952+0000 7fa4c67fc640 1 -- 172.21.15.1:0/2438260926 wait complete. 2023-12-02T01:29:49.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.955+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 --> [v2:172.21.15.167:6816/1330589342,v1:172.21.15.167:6817/1330589342] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e00002cb0 con 0x7f3e14073030 2023-12-02T01:29:49.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.955+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 --> [v2:172.21.15.1:6800/2189085040,v1:172.21.15.1:6801/2189085040] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f02fc007920 con 0x7f02fc0cf3a0 2023-12-02T01:29:49.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.955+0000 7f02effff640 1 -- 172.21.15.1:0/591457970 <== osd.0 v2:172.21.15.1:6800/2189085040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f02f80099e0 con 0x7f02fc0cf3a0 2023-12-02T01:29:49.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.955+0000 7f3e0f7fe640 1 -- 172.21.15.1:0/3135637056 <== osd.5 v2:172.21.15.167:6816/1330589342 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e00002cb0 con 0x7f3e14073030 2023-12-02T01:29:49.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.955+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 --> [v2:172.21.15.1:6823/3438149164,v1:172.21.15.1:6825/3438149164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbae814ab60 con 0x7fbacc073130 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:6816/1330589342,v1:172.21.15.167:6817/1330589342] conn(0x7f3e14073030 msgr2=0x7f3e14075450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.167:6816/1330589342,v1:172.21.15.167:6817/1330589342] conn(0x7f3e14073030 0x7f3e14075450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3e1406ae90 msgr2=0x7f3e1406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3e1406ae90 0x7f3e1406d350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e18036000 tx=0x7f3e1803d040 comp rx=0 tx=0).stop 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280d0070 msgr2=0x7f3e2815a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 --2- 172.21.15.1:0/3135637056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e280d0070 0x7f3e2815a610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d5f0 tx=0x7f3e1c00dab0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e277fe640 1 -- 172.21.15.1:0/3135637056 reap_dead start 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 shutdown_connections 2023-12-02T01:29:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 >> 172.21.15.1:0/3135637056 conn(0x7f3e2809c500 msgr2=0x7f3e280b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7fbaddffb640 1 -- 172.21.15.1:0/2357114076 <== osd.2 v2:172.21.15.1:6823/3438149164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbae814ab60 con 0x7fbacc073130 2023-12-02T01:29:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6800/2189085040,v1:172.21.15.1:6801/2189085040] conn(0x7f02fc0cf3a0 msgr2=0x7f02fc0cf780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f0308fae640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6800/2189085040,v1:172.21.15.1:6801/2189085040] conn(0x7f02fc0cf3a0 0x7f02fc0cf780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 shutdown_connections 2023-12-02T01:29:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.956+0000 7f3e0d7fa640 1 -- 172.21.15.1:0/3135637056 wait complete. 2023-12-02T01:29:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02e806af10 msgr2=0x7f02e806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02e806af10 0x7f02e806d3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02f0001660 tx=0x7f02f0009040 comp rx=0 tx=0).stop 2023-12-02T01:29:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02fc180d90 msgr2=0x7f02fc0cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 --2- 172.21.15.1:0/591457970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02fc180d90 0x7f02fc0cee60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0304050020 tx=0x7f03040695d0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0303fff640 1 -- 172.21.15.1:0/591457970 reap_dead start 2023-12-02T01:29:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 shutdown_connections 2023-12-02T01:29:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 >> 172.21.15.1:0/591457970 conn(0x7f02fc054ee0 msgr2=0x7f02fc0e7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6823/3438149164,v1:172.21.15.1:6825/3438149164] conn(0x7fbacc073130 msgr2=0x7fbacc075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7fbaef361640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6823/3438149164,v1:172.21.15.1:6825/3438149164] conn(0x7fbacc073130 0x7fbacc075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 shutdown_connections 2023-12-02T01:29:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.957+0000 7f0308fae640 1 -- 172.21.15.1:0/591457970 wait complete. 2023-12-02T01:29:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbacc06af10 msgr2=0x7fbacc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7fbaef361640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbacc06af10 0x7fbacc06d3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbad8036000 tx=0x7fbad8008030 comp rx=0 tx=0).stop 2023-12-02T01:29:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbae806c890 msgr2=0x7fbae815dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7fbaef361640 1 --2- 172.21.15.1:0/2357114076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbae806c890 0x7fbae815dee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbae400c400 tx=0x7fbae400c8c0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7fbaed8fe640 1 -- 172.21.15.1:0/2357114076 reap_dead start 2023-12-02T01:29:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 --> [v2:172.21.15.1:6808/211191071,v1:172.21.15.1:6809/211191071] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f052c0503a0 con 0x7f0518073130 2023-12-02T01:29:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 shutdown_connections 2023-12-02T01:29:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 >> 172.21.15.1:0/2357114076 conn(0x7fbae806a8f0 msgr2=0x7fbae806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.958+0000 7f051ffff640 1 -- 172.21.15.1:0/2725344882 <== osd.1 v2:172.21.15.1:6808/211191071 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0528030b30 con 0x7f0518073130 2023-12-02T01:29:49.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.959+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 shutdown_connections 2023-12-02T01:29:49.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.959+0000 7fbaef361640 1 -- 172.21.15.1:0/2357114076 wait complete. 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.959+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6808/211191071,v1:172.21.15.1:6809/211191071] conn(0x7f0518073130 msgr2=0x7f0518075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.959+0000 7f0539c02640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6808/211191071,v1:172.21.15.1:6809/211191071] conn(0x7f0518073130 0x7f0518075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.960+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f051806af10 msgr2=0x7f051806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.960+0000 7f0539c02640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f051806af10 0x7f051806d3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0520001560 tx=0x7f0520007930 comp rx=0 tx=0).stop 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.960+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c0e1090 msgr2=0x7f052c0e26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.960+0000 7f0539c02640 1 --2- 172.21.15.1:0/2725344882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f052c0e1090 0x7f052c0e26c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f053404fab0 tx=0x7f0534067f00 comp rx=0 tx=0).stop 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.960+0000 7f0533fff640 1 -- 172.21.15.1:0/2725344882 reap_dead start 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.960+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 shutdown_connections 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.960+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 >> 172.21.15.1:0/2725344882 conn(0x7f052c009fb0 msgr2=0x7f052c038740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.961+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 shutdown_connections 2023-12-02T01:29:49.999 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.961+0000 7f0539c02640 1 -- 172.21.15.1:0/2725344882 wait complete. 2023-12-02T01:29:50.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.962+0000 7fcd75ffb640 1 -- 172.21.15.1:0/2841211609 --> [v2:172.21.15.167:6800/2232039287,v1:172.21.15.167:6801/2232039287] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd900cf240 con 0x7fcd7c072ef0 2023-12-02T01:29:50.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.962+0000 7fcd77fff640 1 -- 172.21.15.1:0/2841211609 <== osd.4 v2:172.21.15.167:6800/2232039287 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd880017a0 con 0x7fcd7c072ef0 2023-12-02T01:29:50.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.963+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:6800/2232039287,v1:172.21.15.167:6801/2232039287] conn(0x7fcd7c072ef0 msgr2=0x7fcd7c075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.963+0000 7fcd94b54640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.167:6800/2232039287,v1:172.21.15.167:6801/2232039287] conn(0x7fcd7c072ef0 0x7fcd7c075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.963+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcd7c06ae40 msgr2=0x7fcd7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.963+0000 7fcd94b54640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcd7c06ae40 0x7fcd7c06d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009db0 tx=0x7fcd80008040 comp rx=0 tx=0).stop 2023-12-02T01:29:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.963+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 --> [v2:172.21.15.167:6808/4092232180,v1:172.21.15.167:6809/4092232180] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6980710b0 con 0x7fb67c072fe0 2023-12-02T01:29:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.964+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd90154120 msgr2=0x7fcd9009b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.964+0000 7fcd94b54640 1 --2- 172.21.15.1:0/2841211609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd90154120 0x7fcd9009b050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd9015d750 tx=0x7fcd840046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.964+0000 7fcd8ffff640 1 -- 172.21.15.1:0/2841211609 reap_dead start 2023-12-02T01:29:50.001 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.964+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 --> [v2:172.21.15.167:6821/2996316137,v1:172.21.15.167:6823/2996316137] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a54002cb0 con 0x7f2a5c0730b0 2023-12-02T01:29:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.964+0000 7fb68e7fc640 1 -- 172.21.15.1:0/4074953128 <== osd.7 v2:172.21.15.167:6808/4092232180 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb69002c7c0 con 0x7fb67c072fe0 2023-12-02T01:29:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.964+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 shutdown_connections 2023-12-02T01:29:50.002 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.964+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 >> 172.21.15.1:0/2841211609 conn(0x7fcd90070ad0 msgr2=0x7fcd901535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 shutdown_connections 2023-12-02T01:29:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fcd94b54640 1 -- 172.21.15.1:0/2841211609 wait complete. 2023-12-02T01:29:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7f2a6dffb640 1 -- 172.21.15.1:0/3925197104 <== osd.6 v2:172.21.15.167:6821/2996316137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a54002cb0 con 0x7f2a5c0730b0 2023-12-02T01:29:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:6808/4092232180,v1:172.21.15.167:6809/4092232180] conn(0x7fb67c072fe0 msgr2=0x7fb67c075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb6a01b6640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.167:6808/4092232180,v1:172.21.15.167:6809/4092232180] conn(0x7fb67c072fe0 0x7fb67c075400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb67c06ae40 msgr2=0x7fb67c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb6a01b6640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb67c06ae40 0x7fb67c06d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb694000f60 tx=0x7fb694007ec0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6980b34b0 msgr2=0x7fb6981646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb6a01b6640 1 --2- 172.21.15.1:0/4074953128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6980b34b0 0x7fb6981646b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c610 tx=0x7fb68800cad0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb69e753640 1 -- 172.21.15.1:0/4074953128 reap_dead start 2023-12-02T01:29:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.965+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 shutdown_connections 2023-12-02T01:29:50.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 >> 172.21.15.1:0/4074953128 conn(0x7fb69806a8f0 msgr2=0x7fb6980b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:6821/2996316137,v1:172.21.15.167:6823/2996316137] conn(0x7f2a5c0730b0 msgr2=0x7f2a5c0754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7f2a5b7fe640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:6821/2996316137,v1:172.21.15.167:6823/2996316137] conn(0x7f2a5c0730b0 0x7f2a5c0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2a5c06af10 msgr2=0x7f2a5c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7f2a5b7fe640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2a5c06af10 0x7f2a5c06d3d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2a78069ca0 tx=0x7f2a780661b0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7003c0b0 msgr2=0x7f2a700d8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7f2a5b7fe640 1 --2- 172.21.15.1:0/3925197104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a7003c0b0 0x7f2a700d8c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800b450 tx=0x7f2a6800b910 comp rx=0 tx=0).stop 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7f2a7dcac640 1 -- 172.21.15.1:0/3925197104 reap_dead start 2023-12-02T01:29:50.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 shutdown_connections 2023-12-02T01:29:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.966+0000 7fb6a01b6640 1 -- 172.21.15.1:0/4074953128 wait complete. 2023-12-02T01:29:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.967+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 shutdown_connections 2023-12-02T01:29:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.967+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 >> 172.21.15.1:0/3925197104 conn(0x7f2a7003aa00 msgr2=0x7f2a7003e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.967+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 shutdown_connections 2023-12-02T01:29:50.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:49.967+0000 7f2a5b7fe640 1 -- 172.21.15.1:0/3925197104 wait complete. 2023-12-02T01:29:50.007 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.007 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-02T01:29:50.008 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.008 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-02T01:29:50.009 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-02T01:29:50.010 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-02T01:29:50.011 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-02T01:29:50.012 INFO:teuthology.orchestra.run.smithi001.stdout:55834574855 2023-12-02T01:29:50.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-02T01:29:50.013 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-02T01:29:50.014 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.014 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-02T01:29:50.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.227+0000 7f4ede2bb640 1 Processor -- start 2023-12-02T01:29:50.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.227+0000 7f4ede2bb640 1 -- start start 2023-12-02T01:29:50.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.228+0000 7f7bdc92e640 1 Processor -- start 2023-12-02T01:29:50.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.228+0000 7f7bdc92e640 1 -- start start 2023-12-02T01:29:50.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ede2bb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4ed000aad0 0x7f4ed00df070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ede2bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed00530a0 0x7f4ed00e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ede2bb640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed00535f0 con 0x7f4ed004fa70 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ede2bb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed00df5b0 con 0x7f4ed000aad0 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ede2bb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed004f840 con 0x7f4ed00530a0 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ed77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed00530a0 0x7f4ed00e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ed77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed00530a0 0x7f4ed00e0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42240/0 (socket says 172.21.15.1:42240) 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f4ed77fe640 1 -- 172.21.15.1:0/1342627038 learned_addr learned my addr 172.21.15.1:0/1342627038 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.229+0000 7f5e710c3640 1 Processor -- start 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f5e710c3640 1 -- start start 2023-12-02T01:29:50.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f6206e7c640 1 Processor -- start 2023-12-02T01:29:50.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f7bdc92e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7bd004a2e0 0x7f7bd0039b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f7bdc92e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd003c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f7bdc92e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd003b300 con 0x7f7bd00529b0 2023-12-02T01:29:50.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f7bdc92e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd003b5a0 con 0x7f7bd004a2e0 2023-12-02T01:29:50.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f7bdc92e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd003b880 con 0x7f7bd0036170 2023-12-02T01:29:50.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f6206e7c640 1 -- start start 2023-12-02T01:29:50.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f4ed7fff640 1 --2- 172.21.15.1:0/1342627038 >> v2:172.21.15.167:3300/0 conn(0x7f4ed000aad0 0x7f4ed00df070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7fb3153f4640 1 Processor -- start 2023-12-02T01:29:50.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f4ed77fe640 1 -- 172.21.15.1:0/1342627038 >> v2:172.21.15.167:3300/0 conn(0x7f4ed000aad0 msgr2=0x7f4ed00df070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7fb3153f4640 1 -- start start 2023-12-02T01:29:50.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f4ed77fe640 1 --2- 172.21.15.1:0/1342627038 >> v2:172.21.15.167:3300/0 conn(0x7f4ed000aad0 0x7f4ed00df070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f5e710c3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cecd0 0x7f5e6c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f5e710c3640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c070090 con 0x7f5e6c0cd460 2023-12-02T01:29:50.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f5e710c3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0cf670 con 0x7f5e6c143ba0 2023-12-02T01:29:50.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f5e710c3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c143f80 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f5e708c2640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5e6c0cd460 0x7f5e6c0cd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45138/0 (socket says 172.21.15.1:45138) 2023-12-02T01:29:50.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f5e708c2640 1 -- 172.21.15.1:0/488968274 learned_addr learned my addr 172.21.15.1:0/488968274 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:50.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f4ed77fe640 1 -- 172.21.15.1:0/1342627038 >> v1:172.21.15.1:6789/0 conn(0x7f4ed004fa70 legacy=0x7f4ed00e2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f4ed77fe640 1 -- 172.21.15.1:0/1342627038 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00538d0 con 0x7f4ed00530a0 2023-12-02T01:29:50.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f5e6b7fe640 1 --2- 172.21.15.1:0/488968274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cecd0 0x7f5e6c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f7bd7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7bd00529b0 0x7f7bd0054830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:34998/0 (socket says 172.21.15.1:34998) 2023-12-02T01:29:50.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f6204c18640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f61f80e1220 0x7f61f8038710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45154/0 (socket says 172.21.15.1:45154) 2023-12-02T01:29:50.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.230+0000 7f7bd7fff640 1 -- 172.21.15.1:0/599588802 learned_addr learned my addr 172.21.15.1:0/599588802 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:50.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f4ed77fe640 1 --2- 172.21.15.1:0/1342627038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed00530a0 0x7f4ed00e0100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ed804fab0 tx=0x7f4ed80ae700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35fab43f64b55386 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.231+0000 7f7bd6ffd640 1 --2- 172.21.15.1:0/599588802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd003c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f6204c18640 1 -- 172.21.15.1:0/446674241 learned_addr learned my addr 172.21.15.1:0/446674241 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:50.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f6206e7c640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f80e1600 0x7f61f8054230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f7bd77fe640 1 --2- 172.21.15.1:0/599588802 >> v2:172.21.15.1:3300/0 conn(0x7f7bd004a2e0 0x7f7bd0039b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f4ed6ffd640 1 -- 172.21.15.1:0/1342627038 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80b37d0 con 0x7f4ed00530a0 2023-12-02T01:29:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f8055310 con 0x7f61f80e1220 2023-12-02T01:29:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f4ed6ffd640 1 -- 172.21.15.1:0/1342627038 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80b1050 con 0x7f4ed00530a0 2023-12-02T01:29:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f4ed6ffd640 1 -- 172.21.15.1:0/1342627038 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80b3c10 con 0x7f4ed00530a0 2023-12-02T01:29:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb3153f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3100b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb3153f4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb3100cff50 0x7fb3100b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb3153f4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100b5ef0 con 0x7fb310160720 2023-12-02T01:29:50.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb3153f4640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3100d1fa0 con 0x7fb3100cff50 2023-12-02T01:29:50.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb3153f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100d19e0 con 0x7fb3100ced00 2023-12-02T01:29:50.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80555f0 con 0x7f61f8038e20 2023-12-02T01:29:50.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8056a40 con 0x7f61f80e1600 2023-12-02T01:29:50.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f7bd6ffd640 1 -- 172.21.15.1:0/599588802 >> v2:172.21.15.1:3300/0 conn(0x7f7bd004a2e0 msgr2=0x7f7bd0039b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f5e6affd640 1 -- 172.21.15.1:0/488968274 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289307253 0 0) 0x7f5e6c070090 con 0x7f5e6c0cd460 2023-12-02T01:29:50.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f5e6affd640 1 -- 172.21.15.1:0/488968274 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e54003520 con 0x7f5e6c0cd460 2023-12-02T01:29:50.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb30ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb310160720 0x7fb3100cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:35044/0 (socket says 172.21.15.1:35044) 2023-12-02T01:29:50.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb30ffff640 1 -- 172.21.15.1:0/736999838 learned_addr learned my addr 172.21.15.1:0/736999838 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:50.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb314bf3640 1 --2- 172.21.15.1:0/736999838 >> v2:172.21.15.1:3300/0 conn(0x7fb3100cff50 0x7fb3100b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7fb30f7fe640 1 --2- 172.21.15.1:0/736999838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3100b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880054243 0 0) 0x7f61f80555f0 con 0x7f61f8038e20 2023-12-02T01:29:50.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f0003520 con 0x7f61f8038e20 2023-12-02T01:29:50.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129348805 0 0) 0x7f61f8055310 con 0x7f61f80e1220 2023-12-02T01:29:50.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f7bd67fc640 1 -- 172.21.15.1:0/599588802 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475070550 0 0) 0x7f7bd003b300 con 0x7f7bd00529b0 2023-12-02T01:29:50.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f9c8eb5a640 1 Processor -- start 2023-12-02T01:29:50.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f9c8eb5a640 1 -- start start 2023-12-02T01:29:50.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f4ede2bb640 1 -- 172.21.15.1:0/1342627038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed00530a0 msgr2=0x7f4ed00e0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/1342627038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed00530a0 0x7f4ed00e0100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ed804fab0 tx=0x7f4ed80ae700 comp rx=0 tx=0).stop 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f4ede2bb640 1 -- 172.21.15.1:0/1342627038 shutdown_connections 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/1342627038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed00530a0 0x7f4ed00e0100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/1342627038 >> v2:172.21.15.167:3300/0 conn(0x7f4ed000aad0 0x7f4ed00df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f4ede2bb640 1 -- 172.21.15.1:0/1342627038 >> 172.21.15.1:0/1342627038 conn(0x7f4ed0009fb0 msgr2=0x7f4ed000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7fb314bf3640 1 -- 172.21.15.1:0/736999838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 msgr2=0x7fb3100b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f80555f0 con 0x7f61f80e1220 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f6205419640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f80e1600 0x7f61f8054230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 438203979 0 0) 0x7f61f0003520 con 0x7f61f8038e20 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f80e1600 msgr2=0x7f61f8054230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f80e1600 0x7f61f8054230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 >> v1:172.21.15.1:6789/0 conn(0x7f61f80e1220 legacy=0x7f61f8038710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8056660 con 0x7f61f8038e20 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f61ec001670 con 0x7f61f8038e20 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 >> v1:172.21.15.167:6789/0 conn(0x7f61f8038e20 legacy=0x7f61f803a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f0004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0003760 0x7f61f0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f0004120 0x7f61f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4001230 con 0x7f61f0004b90 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8056a40 con 0x7f61f0003760 2023-12-02T01:29:50.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f000c130 con 0x7f61f0004120 2023-12-02T01:29:50.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f5e6b7fe640 1 -- 172.21.15.1:0/488968274 >> v1:172.21.15.167:6789/0 conn(0x7f5e6c143ba0 legacy=0x7f5e6c0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f5e6b7fe640 1 -- 172.21.15.1:0/488968274 >> v1:172.21.15.1:6789/0 conn(0x7f5e6c0cd460 legacy=0x7f5e6c0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f5e6affd640 1 -- 172.21.15.1:0/488968274 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583680861 0 0) 0x7f5e6c0cf670 con 0x7f5e6c143ba0 2023-12-02T01:29:50.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.232+0000 7f5e6b7fe640 1 -- 172.21.15.1:0/488968274 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c06cfa0 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f6204c18640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f0004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f7bd6ffd640 1 --2- 172.21.15.1:0/599588802 >> v2:172.21.15.1:3300/0 conn(0x7f7bd004a2e0 0x7f7bd0039b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f7bd6ffd640 1 -- 172.21.15.1:0/599588802 >> v1:172.21.15.167:6789/0 conn(0x7f7bd00529b0 legacy=0x7f7bd0054830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f7bd6ffd640 1 -- 172.21.15.1:0/599588802 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd003bb60 con 0x7f7bd0036170 2023-12-02T01:29:50.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7f5e6b7fe640 1 --2- 172.21.15.1:0/488968274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cecd0 0x7f5e6c0cf130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0097d0 tx=0x7f5e5c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7ecd113d97475a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f61fffff640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0003760 0x7f61f0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f5e6affd640 1 -- 172.21.15.1:0/488968274 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0317c0 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f7bd77fe640 1 --2- 172.21.15.1:0/599588802 >> v2:172.21.15.1:3300/0 conn(0x7f7bd004a2e0 0x7f7bd0039b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:50.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f5e6affd640 1 -- 172.21.15.1:0/488968274 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c031920 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8eb5a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c88161ac0 0x7f9c880c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8eb5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c880d1840 0x7f9c880c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8eb5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c880ae0e0 con 0x7f9c881616e0 2023-12-02T01:29:50.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8eb5a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c880cf300 con 0x7f9c88161ac0 2023-12-02T01:29:50.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8eb5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8806b9a0 con 0x7f9c880d1840 2023-12-02T01:29:50.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f4ede2bb640 1 -- 172.21.15.1:0/1342627038 shutdown_connections 2023-12-02T01:29:50.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7fb314bf3640 1 --2- 172.21.15.1:0/736999838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3100b66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7fb314bf3640 1 -- 172.21.15.1:0/736999838 >> v1:172.21.15.167:6789/0 conn(0x7fb310160720 legacy=0x7fb3100cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f6205419640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f0004120 0x7f61f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7fb314bf3640 1 -- 172.21.15.1:0/736999838 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100d1cc0 con 0x7fb3100cff50 2023-12-02T01:29:50.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.233+0000 7fb30f7fe640 1 --2- 172.21.15.1:0/736999838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3100b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:50.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f6204c18640 1 -- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f0004120 msgr2=0x7f61f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f6204c18640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f0004120 0x7f61f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f6204c18640 1 -- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0003760 msgr2=0x7f61f0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f6204c18640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0003760 0x7f61f0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f6204c18640 1 -- 172.21.15.1:0/446674241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8056660 con 0x7f61f0004b90 2023-12-02T01:29:50.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8c8f6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9c881616e0 0x7f9c880ad9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:35056/0 (socket says 172.21.15.1:35056) 2023-12-02T01:29:50.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8c8f6640 1 -- 172.21.15.1:0/3939930160 learned_addr learned my addr 172.21.15.1:0/3939930160 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:50.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c8d0f7640 1 --2- 172.21.15.1:0/3939930160 >> v2:172.21.15.167:3300/0 conn(0x7f9c880d1840 0x7f9c880c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.251 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f9c87fff640 1 --2- 172.21.15.1:0/3939930160 >> v2:172.21.15.1:3300/0 conn(0x7f9c88161ac0 0x7f9c880c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f42a1127640 1 Processor -- start 2023-12-02T01:29:50.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7fb314bf3640 1 --2- 172.21.15.1:0/736999838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100b6bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097a0 tx=0x7fb30402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342f277136d13423 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9c877fe640 1 -- 172.21.15.1:0/3939930160 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285203260 0 0) 0x7f9c880ae0e0 con 0x7f9c881616e0 2023-12-02T01:29:50.252 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9c877fe640 1 -- 172.21.15.1:0/3939930160 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c70003520 con 0x7f9c881616e0 2023-12-02T01:29:50.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9c87fff640 1 -- 172.21.15.1:0/3939930160 >> v2:172.21.15.167:3300/0 conn(0x7f9c880d1840 msgr2=0x7f9c880c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f42a1127640 1 -- start start 2023-12-02T01:29:50.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9c87fff640 1 --2- 172.21.15.1:0/3939930160 >> v2:172.21.15.167:3300/0 conn(0x7f9c880d1840 0x7f9c880c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7fb30effd640 1 -- 172.21.15.1:0/736999838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304030710 con 0x7fb3100cff50 2023-12-02T01:29:50.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7fb30effd640 1 -- 172.21.15.1:0/736999838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30402e050 con 0x7fb3100cff50 2023-12-02T01:29:50.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7fb30effd640 1 -- 172.21.15.1:0/736999838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304030a90 con 0x7fb3100cff50 2023-12-02T01:29:50.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9c87fff640 1 -- 172.21.15.1:0/3939930160 >> v1:172.21.15.167:6789/0 conn(0x7f9c881616e0 legacy=0x7f9c880ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9c87fff640 1 -- 172.21.15.1:0/3939930160 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8806bc80 con 0x7f9c88161ac0 2023-12-02T01:29:50.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f4ede2bb640 1 -- 172.21.15.1:0/1342627038 wait complete. 2023-12-02T01:29:50.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9927256640 1 Processor -- start 2023-12-02T01:29:50.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f9927256640 1 -- start start 2023-12-02T01:29:50.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f5e710c3640 1 -- 172.21.15.1:0/488968274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cecd0 msgr2=0x7f5e6c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f5e710c3640 1 --2- 172.21.15.1:0/488968274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cecd0 0x7f5e6c0cf130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0097d0 tx=0x7f5e5c02b860 comp rx=0 tx=0).stop 2023-12-02T01:29:50.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.234+0000 7f61fffff640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0003760 0x7f61f0003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:50.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f6205419640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f0004120 0x7f61f000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:50.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.235+0000 7f6204c18640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f0004f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61f4007fb0 tx=0x7f61f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cb4fb2e290164c server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f5e710c3640 1 -- 172.21.15.1:0/488968274 shutdown_connections 2023-12-02T01:29:50.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f5e710c3640 1 --2- 172.21.15.1:0/488968274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cecd0 0x7f5e6c0cf130 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f5e710c3640 1 -- 172.21.15.1:0/488968274 >> 172.21.15.1:0/488968274 conn(0x7f5e6c06a6b0 msgr2=0x7f5e6c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4004b60 con 0x7f61f0004b90 2023-12-02T01:29:50.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 -- 172.21.15.1:0/736999838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 msgr2=0x7fb3100b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 --2- 172.21.15.1:0/736999838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100b6bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097a0 tx=0x7fb30402b710 comp rx=0 tx=0).stop 2023-12-02T01:29:50.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f4004ce0 con 0x7f61f0004b90 2023-12-02T01:29:50.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f61ff7fe640 1 -- 172.21.15.1:0/446674241 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4007310 con 0x7f61f0004b90 2023-12-02T01:29:50.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f4ede2bb640 1 Processor -- start 2023-12-02T01:29:50.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9c87fff640 1 --2- 172.21.15.1:0/3939930160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c88161ac0 0x7f9c880c3cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c880d1df0 tx=0x7f9c8002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a24891a40b99439 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 -- 172.21.15.1:0/736999838 shutdown_connections 2023-12-02T01:29:50.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 --2- 172.21.15.1:0/736999838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100b6bf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 --2- 172.21.15.1:0/736999838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3100b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 -- 172.21.15.1:0/736999838 >> 172.21.15.1:0/736999838 conn(0x7fb3100d2f00 msgr2=0x7fb3100d3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f42a1127640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f429c14aca0 0x7f429c070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f4ede2bb640 1 -- start start 2023-12-02T01:29:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f42a1127640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c06c170 con 0x7f429c070880 2023-12-02T01:29:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f42a1127640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c06c450 con 0x7f429c0cf3e0 2023-12-02T01:29:50.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f42a1127640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c06c730 con 0x7f429c14aca0 2023-12-02T01:29:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9c877fe640 1 -- 172.21.15.1:0/3939930160 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8002cc70 con 0x7f9c88161ac0 2023-12-02T01:29:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 -- 172.21.15.1:0/736999838 shutdown_connections 2023-12-02T01:29:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9c877fe640 1 -- 172.21.15.1:0/3939930160 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8002cdd0 con 0x7f9c88161ac0 2023-12-02T01:29:50.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9c877fe640 1 -- 172.21.15.1:0/3939930160 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80034640 con 0x7f9c88161ac0 2023-12-02T01:29:50.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f429b7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f429c070880 0x7f429c0cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45164/0 (socket says 172.21.15.1:45164) 2023-12-02T01:29:50.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f429b7fe640 1 -- 172.21.15.1:0/3245124967 learned_addr learned my addr 172.21.15.1:0/3245124967 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:50.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f7bd6ffd640 1 --2- 172.21.15.1:0/599588802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd003c360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8050020 tx=0x7f7bd80a5cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4495b55fef17dab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f429bfff640 1 --2- 172.21.15.1:0/3245124967 >> v2:172.21.15.1:3300/0 conn(0x7f429c14aca0 0x7f429c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9927256640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f992006e3d0 0x7f9920070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9927256640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920158f30 0x7f992006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9927256640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992015fe60 con 0x7f9920159390 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9927256640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200b37d0 con 0x7f992006e3d0 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7f9927256640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200b3ab0 con 0x7f9920158f30 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f991ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920158f30 0x7f992006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f991ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920158f30 0x7f992006c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42266/0 (socket says 172.21.15.1:42266) 2023-12-02T01:29:50.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f991ffff640 1 -- 172.21.15.1:0/2899180936 learned_addr learned my addr 172.21.15.1:0/2899180936 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 msgr2=0x7f61f0004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f6206e7c640 1 --2- 172.21.15.1:0/446674241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f0004f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61f4007fb0 tx=0x7f61f00057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f6205419640 1 -- 172.21.15.1:0/446674241 reap_dead start 2023-12-02T01:29:50.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f9924ff2640 1 --2- 172.21.15.1:0/2899180936 >> v2:172.21.15.1:3300/0 conn(0x7f992006e3d0 0x7f9920070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 shutdown_connections 2023-12-02T01:29:50.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f991ffff640 1 -- 172.21.15.1:0/2899180936 >> v2:172.21.15.1:3300/0 conn(0x7f992006e3d0 msgr2=0x7f9920070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f991ffff640 1 --2- 172.21.15.1:0/2899180936 >> v2:172.21.15.1:3300/0 conn(0x7f992006e3d0 0x7f9920070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f991ffff640 1 -- 172.21.15.1:0/2899180936 >> v1:172.21.15.1:6789/0 conn(0x7f9920159390 legacy=0x7f99200b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 >> 172.21.15.1:0/446674241 conn(0x7f61f8053710 msgr2=0x7f61f8053b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/3939930160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c88161ac0 msgr2=0x7f9c880c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.265 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/3939930160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c88161ac0 0x7f9c880c3cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c880d1df0 tx=0x7f9c8002bec0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 shutdown_connections 2023-12-02T01:29:50.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f429bfff640 1 -- 172.21.15.1:0/3245124967 >> v1:172.21.15.167:6789/0 conn(0x7f429c0cf3e0 legacy=0x7f429c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f429bfff640 1 -- 172.21.15.1:0/3245124967 >> v1:172.21.15.1:6789/0 conn(0x7f429c070880 legacy=0x7f429c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:50.266 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f429bfff640 1 -- 172.21.15.1:0/3245124967 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c06ca10 con 0x7f429c14aca0 2023-12-02T01:29:50.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/3939930160 shutdown_connections 2023-12-02T01:29:50.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/3939930160 >> v2:172.21.15.167:3300/0 conn(0x7f9c880d1840 0x7f9c880c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/3939930160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c88161ac0 0x7f9c880c3cf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/3939930160 >> 172.21.15.1:0/3939930160 conn(0x7f9c880d0d20 msgr2=0x7f9c880d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/3939930160 shutdown_connections 2023-12-02T01:29:50.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/3939930160 wait complete. 2023-12-02T01:29:50.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f6206e7c640 1 -- 172.21.15.1:0/446674241 wait complete. 2023-12-02T01:29:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.236+0000 7fb3153f4640 1 -- 172.21.15.1:0/736999838 wait complete. 2023-12-02T01:29:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f4ede2bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed000aad0 0x7f4ed004e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f5e710c3640 1 -- 172.21.15.1:0/488968274 shutdown_connections 2023-12-02T01:29:50.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7fb3153f4640 1 Processor -- start 2023-12-02T01:29:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.237+0000 7f991ffff640 1 -- 172.21.15.1:0/2899180936 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200b3d90 con 0x7f9920158f30 2023-12-02T01:29:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f7bd67fc640 1 -- 172.21.15.1:0/599588802 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80a6b60 con 0x7f7bd0036170 2023-12-02T01:29:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f7bd67fc640 1 -- 172.21.15.1:0/599588802 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd80a6cc0 con 0x7f7bd0036170 2023-12-02T01:29:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f7bd67fc640 1 -- 172.21.15.1:0/599588802 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80ae640 con 0x7f7bd0036170 2023-12-02T01:29:50.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f429bfff640 1 --2- 172.21.15.1:0/3245124967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c14aca0 0x7f429c070340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4294009d90 tx=0x7f429402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b21fe93dd1b08eb server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7fb3153f4640 1 -- start start 2023-12-02T01:29:50.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f5e710c3640 1 -- 172.21.15.1:0/488968274 wait complete. 2023-12-02T01:29:50.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.238+0000 7f4ede2bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed004fa70 0x7f4ed004a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f429affd640 1 -- 172.21.15.1:0/3245124967 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429402cbd0 con 0x7f429c14aca0 2023-12-02T01:29:50.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed000aad0 0x7f4ed004e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed000aad0 0x7f4ed004e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42274/0 (socket says 172.21.15.1:42274) 2023-12-02T01:29:50.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f429affd640 1 -- 172.21.15.1:0/3245124967 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429402cd30 con 0x7f429c14aca0 2023-12-02T01:29:50.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ed77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed004fa70 0x7f4ed004a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ed77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed004fa70 0x7f4ed004a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58616/0 (socket says 172.21.15.1:58616) 2023-12-02T01:29:50.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f429affd640 1 -- 172.21.15.1:0/3245124967 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429402cea0 con 0x7f429c14aca0 2023-12-02T01:29:50.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ed7fff640 1 -- 172.21.15.1:0/2318637881 learned_addr learned my addr 172.21.15.1:0/2318637881 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed00530a0 0x7f4ed00e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00485f0 con 0x7f4ed004fa70 2023-12-02T01:29:50.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed004aca0 con 0x7f4ed00530a0 2023-12-02T01:29:50.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0186ae0 con 0x7f4ed000aad0 2023-12-02T01:29:50.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f6206e7c640 1 Processor -- start 2023-12-02T01:29:50.273 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f6206e7c640 1 -- start start 2023-12-02T01:29:50.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f7bdc92e640 1 -- 172.21.15.1:0/599588802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 msgr2=0x7f7bd003c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.274 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/599588802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd003c360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8050020 tx=0x7f7bd80a5cf0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f42a1127640 1 -- 172.21.15.1:0/3245124967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c14aca0 msgr2=0x7f429c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f4edc858640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed00530a0 0x7f4ed00e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f42a1127640 1 --2- 172.21.15.1:0/3245124967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c14aca0 0x7f429c070340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4294009d90 tx=0x7f429402be20 comp rx=0 tx=0).stop 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f7bdc92e640 1 -- 172.21.15.1:0/599588802 shutdown_connections 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/599588802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd003c360 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/599588802 >> v2:172.21.15.1:3300/0 conn(0x7f7bd004a2e0 0x7f7bd0039b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f7bdc92e640 1 -- 172.21.15.1:0/599588802 >> 172.21.15.1:0/599588802 conn(0x7f7bd0053770 msgr2=0x7f7bd0053b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f7bdc92e640 1 -- 172.21.15.1:0/599588802 shutdown_connections 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f42a1127640 1 -- 172.21.15.1:0/3245124967 shutdown_connections 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f42a1127640 1 --2- 172.21.15.1:0/3245124967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c14aca0 0x7f429c070340 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f42a1127640 1 -- 172.21.15.1:0/3245124967 >> 172.21.15.1:0/3245124967 conn(0x7f429c06a6b0 msgr2=0x7f429c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7fb3153f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3102026b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f42a1127640 1 -- 172.21.15.1:0/3245124967 shutdown_connections 2023-12-02T01:29:50.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f42a1127640 1 -- 172.21.15.1:0/3245124967 wait complete. 2023-12-02T01:29:50.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f9c8eb5a640 1 Processor -- start 2023-12-02T01:29:50.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f4ed77fe640 1 -- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed000aad0 msgr2=0x7f4ed004e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f4ed77fe640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed000aad0 0x7f4ed004e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f4ed77fe640 1 -- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed00530a0 msgr2=0x7f4ed00e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f4ed77fe640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed00530a0 0x7f4ed00e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f4ed77fe640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed804f730 con 0x7f4ed004fa70 2023-12-02T01:29:50.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f9c8eb5a640 1 -- start start 2023-12-02T01:29:50.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7fb3153f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7fb30ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3102026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f4ed77fe640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed004fa70 0x7f4ed004a760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8079db0 tx=0x7f4ed80695d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb30f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb30ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3102026b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:42278/0 (socket says 172.21.15.1:42278) 2023-12-02T01:29:50.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb30f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58618/0 (socket says 172.21.15.1:58618) 2023-12-02T01:29:50.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f7bdc92e640 1 -- 172.21.15.1:0/599588802 wait complete. 2023-12-02T01:29:50.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f4ed7fff640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed000aad0 0x7f4ed004e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:50.280 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb3153f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310160720 0x7fb3100cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f4ed4ff9640 1 -- 172.21.15.1:0/2318637881 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed806f070 con 0x7f4ed004fa70 2023-12-02T01:29:50.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb30ffff640 1 -- 172.21.15.1:0/3159383923 learned_addr learned my addr 172.21.15.1:0/3159383923 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed0186dc0 con 0x7f4ed004fa70 2023-12-02T01:29:50.281 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f6206e7c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f817c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb314bf3640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310160720 0x7fb3100cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb3153f4640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310200590 con 0x7fb3100cff50 2023-12-02T01:29:50.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb3153f4640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310202bf0 con 0x7fb310160720 2023-12-02T01:29:50.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f6204c18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f817c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7fb3153f4640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101ff9c0 con 0x7fb3100ced00 2023-12-02T01:29:50.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f6204c18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f817c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58624/0 (socket says 172.21.15.1:58624) 2023-12-02T01:29:50.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f6204c18640 1 -- 172.21.15.1:0/3120180113 learned_addr learned my addr 172.21.15.1:0/3120180113 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.283 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8052170 0x7f61f8009480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f5e710c3640 1 Processor -- start 2023-12-02T01:29:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.240+0000 7f5e710c3640 1 -- start start 2023-12-02T01:29:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f5e710c3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cd460 0x7f5e6c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.241+0000 7f5e710c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e6c0cecd0 0x7f5e6c153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f4ed4ff9640 1 -- 172.21.15.1:0/2318637881 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80b3e90 con 0x7f4ed004fa70 2023-12-02T01:29:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e710c3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e6c143ba0 0x7f5e6c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e710c3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c132bd0 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e710c3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c137bd0 con 0x7f5e6c143ba0 2023-12-02T01:29:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e710c3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c1549f0 con 0x7f5e6c0cd460 2023-12-02T01:29:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e6c0cecd0 0x7f5e6c153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c8eb5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c880d1840 0x7f9c88161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed0187380 con 0x7f4ed004fa70 2023-12-02T01:29:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f61fffff640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8052170 0x7f61f8009480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f42a1127640 1 Processor -- start 2023-12-02T01:29:50.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c8eb5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c881616e0 0x7f9c8815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f4ed4ff9640 1 -- 172.21.15.1:0/2318637881 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed806ac00 con 0x7f4ed004fa70 2023-12-02T01:29:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c8eb5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88161ac0 0x7f9c881f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7fb314bf3640 1 -- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 msgr2=0x7fb3102026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c87fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c881616e0 0x7f9c8815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c87fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c881616e0 0x7f9c8815ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:59148/0 (socket says 172.21.15.1:59148) 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c87fff640 1 -- 172.21.15.1:0/1371488256 learned_addr learned my addr 172.21.15.1:0/1371488256 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7fb314bf3640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3102026b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7fb314bf3640 1 -- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 msgr2=0x7fb3100ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7fb314bf3640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7fb314bf3640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009400 con 0x7fb310160720 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7fb30ffff640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3102026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:50.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7fb30f7fe640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880cc980 con 0x7f9c880d1840 2023-12-02T01:29:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f9c8d0f7640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88161ac0 0x7f9c881f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881f72f0 con 0x7f9c881616e0 2023-12-02T01:29:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881f75d0 con 0x7f9c88161ac0 2023-12-02T01:29:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c8c8f6640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c880d1840 0x7f9c88161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8036ec0 0x7f61f8037340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.239+0000 7f991ffff640 1 --2- 172.21.15.1:0/2899180936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920158f30 0x7f992006c9a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9918009870 tx=0x7f991802ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743fd57044ae0382 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f991f7fe640 1 -- 172.21.15.1:0/2899180936 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991802f830 con 0x7f9920158f30 2023-12-02T01:29:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f991f7fe640 1 -- 172.21.15.1:0/2899180936 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991802f990 con 0x7f9920158f30 2023-12-02T01:29:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f991f7fe640 1 -- 172.21.15.1:0/2899180936 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991802fd80 con 0x7f9920158f30 2023-12-02T01:29:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9927256640 1 -- 172.21.15.1:0/2899180936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920158f30 msgr2=0x7f992006c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9927256640 1 --2- 172.21.15.1:0/2899180936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920158f30 0x7f992006c9a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9918009870 tx=0x7f991802ba30 comp rx=0 tx=0).stop 2023-12-02T01:29:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8009cb0 con 0x7f61f0004b90 2023-12-02T01:29:50.290 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8037880 con 0x7f61f8036ec0 2023-12-02T01:29:50.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f7bdc92e640 1 Processor -- start 2023-12-02T01:29:50.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9927256640 1 -- 172.21.15.1:0/2899180936 shutdown_connections 2023-12-02T01:29:50.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9927256640 1 --2- 172.21.15.1:0/2899180936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920158f30 0x7f992006c9a0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9918009870 tx=0x7f991802ba30 comp rx=0 tx=0).stop 2023-12-02T01:29:50.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9927256640 1 --2- 172.21.15.1:0/2899180936 >> v2:172.21.15.1:3300/0 conn(0x7f992006e3d0 0x7f9920070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9927256640 1 -- 172.21.15.1:0/2899180936 >> 172.21.15.1:0/2899180936 conn(0x7f992006a8f0 msgr2=0x7f992006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e6c0cecd0 0x7f5e6c153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58636/0 (socket says 172.21.15.1:58636) 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 -- 172.21.15.1:0/3046144118 learned_addr learned my addr 172.21.15.1:0/3046144118 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6bfff640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cd460 0x7f5e6c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 -- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cd460 msgr2=0x7f5e6c154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cd460 0x7f5e6c154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e708c2640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e6c143ba0 0x7f5e6c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 -- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e6c143ba0 msgr2=0x7f5e6c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e6c143ba0 0x7f5e6c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f5e6b7fe640 1 -- 172.21.15.1:0/3046144118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c009400 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f42a1127640 1 -- start start 2023-12-02T01:29:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f5e6bfff640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cd460 0x7f5e6c154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.242+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8008700 con 0x7f61f8052170 2023-12-02T01:29:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7fb314bf3640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310160720 0x7fb3100cc4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb304032000 tx=0x7fb3040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f7bdc92e640 1 -- start start 2023-12-02T01:29:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7fb30cff9640 1 -- 172.21.15.1:0/3159383923 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30403c8e0 con 0x7fb310160720 2023-12-02T01:29:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7fb30cff9640 1 -- 172.21.15.1:0/3159383923 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30403ca60 con 0x7fb310160720 2023-12-02T01:29:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f61fffff640 1 -- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8036ec0 msgr2=0x7f61f8037340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-02T01:29:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f61fffff640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8036ec0 0x7f61f8037340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f61fffff640 1 -- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 msgr2=0x7f61f817c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f61fffff640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f817c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f61fffff640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f817cd90 con 0x7f61f8052170 2023-12-02T01:29:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c87fff640 1 -- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88161ac0 msgr2=0x7f9c881f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c87fff640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88161ac0 0x7f9c881f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c87fff640 1 -- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c880d1840 msgr2=0x7f9c88161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c87fff640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c880d1840 0x7f9c88161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f9c87fff640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009a70 con 0x7f9c881616e0 2023-12-02T01:29:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.243+0000 7f5e6b7fe640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e6c0cecd0 0x7f5e6c153a50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c034040 tx=0x7f5e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f6204c18640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f817c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f5e68ff9640 1 -- 172.21.15.1:0/3046144118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c032a80 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f5e68ff9640 1 -- 172.21.15.1:0/3046144118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c032c00 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb8005250 con 0x7f4ed004fa70 2023-12-02T01:29:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bdc92e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd0051a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bdc92e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bd004a2e0 0x7f7bd000a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bdc92e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bd00529b0 0x7f7bd0008e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f9c87fff640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c881616e0 0x7f9c8815ce30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c80000f80 tx=0x7f9c80004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bdc92e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0046ee0 con 0x7f7bd004a2e0 2023-12-02T01:29:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bdc92e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd000aac0 con 0x7f7bd00529b0 2023-12-02T01:29:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bdc92e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0046960 con 0x7f7bd0036170 2023-12-02T01:29:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bd004a2e0 0x7f7bd000a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f9927256640 1 -- 172.21.15.1:0/2899180936 shutdown_connections 2023-12-02T01:29:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f42a1127640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f429c070880 0x7f429c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7fb3153f4640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3101ffc60 con 0x7fb310160720 2023-12-02T01:29:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7fb30cff9640 1 -- 172.21.15.1:0/3159383923 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30403ce10 con 0x7fb310160720 2023-12-02T01:29:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7fb3153f4640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb310200220 con 0x7fb310160720 2023-12-02T01:29:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f42a1127640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c0cf3e0 0x7f429c163d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f5e68ff9640 1 -- 172.21.15.1:0/3046144118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c045420 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c154430 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c137e00 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f4ed4ff9640 1 -- 172.21.15.1:0/2318637881 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ed8072260 con 0x7f4ed004fa70 2023-12-02T01:29:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f429bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f429c070880 0x7f429c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bd004a2e0 0x7f7bd000a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58650/0 (socket says 172.21.15.1:58650) 2023-12-02T01:29:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f7bd6ffd640 1 -- 172.21.15.1:0/2063680119 learned_addr learned my addr 172.21.15.1:0/2063680119 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f429bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f429c070880 0x7f429c15aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:59172/0 (socket says 172.21.15.1:59172) 2023-12-02T01:29:50.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c0cf3e0 0x7f429c163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c0cf3e0 0x7f429c163d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58664/0 (socket says 172.21.15.1:58664) 2023-12-02T01:29:50.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f9c857fa640 1 -- 172.21.15.1:0/1371488256 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80009450 con 0x7f9c881616e0 2023-12-02T01:29:50.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f42a1127640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f429c14aca0 0x7f429c143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f9c857fa640 1 -- 172.21.15.1:0/1371488256 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c80004600 con 0x7f9c881616e0 2023-12-02T01:29:50.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f42a1127640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c165610 con 0x7f429c0cf3e0 2023-12-02T01:29:50.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f42a1127640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c164570 con 0x7f429c070880 2023-12-02T01:29:50.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f42a1127640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c164850 con 0x7f429c14aca0 2023-12-02T01:29:50.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f9c857fa640 1 -- 172.21.15.1:0/1371488256 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80034440 con 0x7f9c881616e0 2023-12-02T01:29:50.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f7bd6ffd640 1 -- 172.21.15.1:0/2063680119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 msgr2=0x7f7bd0051a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f7bd6ffd640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd0051a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f7bd6ffd640 1 -- 172.21.15.1:0/2063680119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bd00529b0 msgr2=0x7f7bd0008e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.245+0000 7f7bd7fff640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bd00529b0 0x7f7bd0008e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f4ed4ff9640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4ebc06af10 0x7f4ebc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f4ed4ff9640 1 -- 172.21.15.1:0/2318637881 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ed81253c0 con 0x7f4ed004fa70 2023-12-02T01:29:50.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f7bd6ffd640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bd00529b0 0x7f7bd0008e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f7bd6ffd640 1 -- 172.21.15.1:0/2063680119 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd804f730 con 0x7f7bd004a2e0 2023-12-02T01:29:50.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f7bd6ffd640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bd004a2e0 0x7f7bd000a580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8069ca0 tx=0x7f7bd806a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f61fffff640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8052170 0x7f61f8009480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00e780 tx=0x7f61ec00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c880cc610 con 0x7f9c881616e0 2023-12-02T01:29:50.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.244+0000 7f9927256640 1 -- 172.21.15.1:0/2899180936 wait complete. 2023-12-02T01:29:50.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f9927256640 1 Processor -- start 2023-12-02T01:29:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f429bfff640 1 -- 172.21.15.1:0/4121239606 learned_addr learned my addr 172.21.15.1:0/4121239606 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7fb3153f4640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31004e840 con 0x7fb310160720 2023-12-02T01:29:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8815d370 con 0x7f9c881616e0 2023-12-02T01:29:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f42a0926640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f429c14aca0 0x7f429c143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f4ed7fff640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4ebc06af10 0x7f4ebc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f429b7fe640 1 -- 172.21.15.1:0/4121239606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f429c14aca0 msgr2=0x7f429c143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f429b7fe640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f429c14aca0 0x7f429c143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f429b7fe640 1 -- 172.21.15.1:0/4121239606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f429c070880 msgr2=0x7f429c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f429b7fe640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f429c070880 0x7f429c15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f429b7fe640 1 -- 172.21.15.1:0/4121239606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4294009a70 con 0x7f429c0cf3e0 2023-12-02T01:29:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7fb30cff9640 1 -- 172.21.15.1:0/3159383923 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb304039070 con 0x7fb310160720 2023-12-02T01:29:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f429b7fe640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c0cf3e0 0x7f429c163d20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f429c070cd0 tx=0x7f429000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f61fd7fa640 1 -- 172.21.15.1:0/3120180113 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0050d0 con 0x7f61f8052170 2023-12-02T01:29:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f61fd7fa640 1 -- 172.21.15.1:0/3120180113 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec005230 con 0x7f61f8052170 2023-12-02T01:29:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f61fd7fa640 1 -- 172.21.15.1:0/3120180113 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00c6c0 con 0x7f61f8052170 2023-12-02T01:29:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f4ed7fff640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4ebc06af10 0x7f4ebc06d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc006fd0 tx=0x7f4ecc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7fb30cff9640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2fc06af40 0x7fb2fc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f8008b90 con 0x7f61f8052170 2023-12-02T01:29:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7fb30ffff640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2fc06af40 0x7fb2fc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f8007dd0 con 0x7f61f8052170 2023-12-02T01:29:50.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.246+0000 7f9927256640 1 -- start start 2023-12-02T01:29:50.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f9927256640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992006e3d0 0x7f99200b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f9927256640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920159390 0x7f99201704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f9927256640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9920171710 0x7f99201709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7fb30cff9640 1 -- 172.21.15.1:0/3159383923 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3040ab060 con 0x7fb310160720 2023-12-02T01:29:50.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f99257f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9920171710 0x7f99201709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f99257f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9920171710 0x7f99201709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58678/0 (socket says 172.21.15.1:58678) 2023-12-02T01:29:50.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f99257f3640 1 -- 172.21.15.1:0/2955765213 learned_addr learned my addr 172.21.15.1:0/2955765213 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:50.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920170f30 con 0x7f9920171710 2023-12-02T01:29:50.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200b1390 con 0x7f992006e3d0 2023-12-02T01:29:50.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200aead0 con 0x7f9920159390 2023-12-02T01:29:50.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.247+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6c04e840 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.248+0000 7f9c857fa640 1 -- 172.21.15.1:0/1371488256 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c8003b070 con 0x7f9c881616e0 2023-12-02T01:29:50.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8804e840 con 0x7f9c881616e0 2023-12-02T01:29:50.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7fb30ffff640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2fc06af40 0x7fb2fc06d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3080012e0 tx=0x7fb3080018c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f991ffff640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920159390 0x7f99201704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f99257f3640 1 -- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920159390 msgr2=0x7f99201704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f99257f3640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920159390 0x7f99201704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f99257f3640 1 -- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992006e3d0 msgr2=0x7f99200b09a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f9924ff2640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992006e3d0 0x7f99200b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f99257f3640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992006e3d0 0x7f99200b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f99257f3640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180094d0 con 0x7f9920171710 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f99257f3640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9920171710 0x7f99201709f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f990800c550 tx=0x7f990800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f9c857fa640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9c7406ae90 0x7f9c7406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80056d0 con 0x7f61f8052170 2023-12-02T01:29:50.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f9c857fa640 1 -- 172.21.15.1:0/1371488256 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c800aba20 con 0x7f9c881616e0 2023-12-02T01:29:50.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.249+0000 7f9c8c8f6640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9c7406ae90 0x7f9c7406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.250+0000 7f9c8c8f6640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9c7406ae90 0x7f9c7406d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c007fd0 tx=0x7f9c7c007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.250+0000 7f61fd7fa640 1 -- 172.21.15.1:0/3120180113 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61ec00c820 con 0x7f61f8052170 2023-12-02T01:29:50.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.250+0000 7f61fd7fa640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61e406ae90 0x7f61e406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.250+0000 7f61fd7fa640 1 -- 172.21.15.1:0/3120180113 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61ec089620 con 0x7f61f8052170 2023-12-02T01:29:50.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.250+0000 7f6204c18640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61e406ae90 0x7f61e406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.251+0000 7f6204c18640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61e406ae90 0x7f61e406d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61f4001d90 tx=0x7f61f403a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f4ed4ff9640 1 -- 172.21.15.1:0/2318637881 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ed80f04e0 con 0x7f4ed004fa70 2023-12-02T01:29:50.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f7bc3fff640 1 -- 172.21.15.1:0/2063680119 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80b7810 con 0x7f7bd004a2e0 2023-12-02T01:29:50.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f991d7fa640 1 -- 172.21.15.1:0/2955765213 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080052d0 con 0x7f9920171710 2023-12-02T01:29:50.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99201534c0 con 0x7f9920171710 2023-12-02T01:29:50.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd0046c00 con 0x7f7bd004a2e0 2023-12-02T01:29:50.316 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd0008970 con 0x7f7bd004a2e0 2023-12-02T01:29:50.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99201530e0 con 0x7f9920171710 2023-12-02T01:29:50.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f4298ff9640 1 -- 172.21.15.1:0/4121239606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290005ce0 con 0x7f429c0cf3e0 2023-12-02T01:29:50.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f4298ff9640 1 -- 172.21.15.1:0/4121239606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4290005e40 con 0x7f429c0cf3e0 2023-12-02T01:29:50.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7fb30cff9640 1 -- 172.21.15.1:0/3159383923 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb304076110 con 0x7fb310160720 2023-12-02T01:29:50.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.252+0000 7f7bc3fff640 1 -- 172.21.15.1:0/2063680119 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd80a6b20 con 0x7f7bd004a2e0 2023-12-02T01:29:50.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.253+0000 7f7bc3fff640 1 -- 172.21.15.1:0/2063680119 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80b7b70 con 0x7f7bd004a2e0 2023-12-02T01:29:50.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.253+0000 7f4298ff9640 1 -- 172.21.15.1:0/4121239606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900072d0 con 0x7f429c0cf3e0 2023-12-02T01:29:50.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.253+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c164b30 con 0x7f429c0cf3e0 2023-12-02T01:29:50.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.253+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c1650f0 con 0x7f429c0cf3e0 2023-12-02T01:29:50.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.253+0000 7f5e68ff9640 1 -- 172.21.15.1:0/3046144118 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e5c043070 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.254+0000 7f991d7fa640 1 -- 172.21.15.1:0/2955765213 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908005430 con 0x7f9920171710 2023-12-02T01:29:50.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.254+0000 7f991d7fa640 1 -- 172.21.15.1:0/2955765213 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908007220 con 0x7f9920171710 2023-12-02T01:29:50.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.254+0000 7f5e68ff9640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5e5806aec0 0x7f5e5806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.254+0000 7f5e68ff9640 1 -- 172.21.15.1:0/3046144118 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e5c0ab700 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.255+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb8005250 con 0x7f7bd004a2e0 2023-12-02T01:29:50.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.255+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c071b60 con 0x7f429c0cf3e0 2023-12-02T01:29:50.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.255+0000 7f61fd7fa640 1 -- 172.21.15.1:0/3120180113 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61ec054840 con 0x7f61f8052170 2023-12-02T01:29:50.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.255+0000 7f5e6bfff640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5e5806aec0 0x7f5e5806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.255+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920072630 con 0x7f9920171710 2023-12-02T01:29:50.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.257+0000 7f5e6bfff640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5e5806aec0 0x7f5e5806d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e60000f60 tx=0x7f5e60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.257+0000 7f9c857fa640 1 -- 172.21.15.1:0/1371488256 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c80076b60 con 0x7f9c881616e0 2023-12-02T01:29:50.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.259+0000 7f5e68ff9640 1 -- 172.21.15.1:0/3046144118 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e5c076920 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.261+0000 7f7bc3fff640 1 -- 172.21.15.1:0/2063680119 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7bd80b5040 con 0x7f7bd004a2e0 2023-12-02T01:29:50.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.260+0000 7f991d7fa640 1 -- 172.21.15.1:0/2955765213 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9908007380 con 0x7f9920171710 2023-12-02T01:29:50.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.261+0000 7f991d7fa640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f990006ae40 0x7f990006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.261+0000 7f991d7fa640 1 -- 172.21.15.1:0/2955765213 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9908058d20 con 0x7f9920171710 2023-12-02T01:29:50.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.262+0000 7f7bc3fff640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7bbc06ae40 0x7f7bbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.262+0000 7f7bc3fff640 1 -- 172.21.15.1:0/2063680119 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bd81262f0 con 0x7f7bd004a2e0 2023-12-02T01:29:50.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.262+0000 7f7bd77fe640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7bbc06ae40 0x7f7bbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.263+0000 7f7bd77fe640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7bbc06ae40 0x7f7bbc06d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc006fd0 tx=0x7f7bcc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.263+0000 7f9924ff2640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f990006ae40 0x7f990006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.263+0000 7f4298ff9640 1 -- 172.21.15.1:0/4121239606 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4290007430 con 0x7f429c0cf3e0 2023-12-02T01:29:50.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.263+0000 7f4298ff9640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f428806ae40 0x7f428806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:50.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.263+0000 7f429bfff640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f428806ae40 0x7f428806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:50.324 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.263+0000 7f4298ff9640 1 -- 172.21.15.1:0/4121239606 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42900892a0 con 0x7f429c0cf3e0 2023-12-02T01:29:50.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.264+0000 7f429bfff640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f428806ae40 0x7f428806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f429c0cd1e0 tx=0x7f4294030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.264+0000 7f9924ff2640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f990006ae40 0x7f990006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9910009f30 tx=0x7f991000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:50.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.267+0000 7f991d7fa640 1 -- 172.21.15.1:0/2955765213 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9908054960 con 0x7f9920171710 2023-12-02T01:29:50.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.271+0000 7f7bc3fff640 1 -- 172.21.15.1:0/2063680119 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7bd80f1300 con 0x7f7bd004a2e0 2023-12-02T01:29:50.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.280+0000 7f4298ff9640 1 -- 172.21.15.1:0/4121239606 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4290054470 con 0x7f429c0cf3e0 2023-12-02T01:29:50.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.660+0000 7fb3153f4640 1 -- 172.21.15.1:0/3159383923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb31015f570 con 0x7fb310160720 2023-12-02T01:29:50.662 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.661+0000 7fb30cff9640 1 -- 172.21.15.1:0/3159383923 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb304037020 con 0x7fb310160720 2023-12-02T01:29:50.663 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-12-02T01:29:50.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.664+0000 7fb2f67fc640 1 -- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2fc06af40 msgr2=0x7fb2fc06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.664+0000 7fb2f67fc640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2fc06af40 0x7fb2fc06d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3080012e0 tx=0x7fb3080018c0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.664+0000 7fb2f67fc640 1 -- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310160720 msgr2=0x7fb3100cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.664+0000 7fb2f67fc640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310160720 0x7fb3100cc4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb304032000 tx=0x7fb3040046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.666 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 -- 172.21.15.1:0/3159383923 shutdown_connections 2023-12-02T01:29:50.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2fc06af40 0x7fb2fc06d400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310160720 0x7fb3100cc4d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3100cff50 0x7fb3100ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 --2- 172.21.15.1:0/3159383923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100ced00 0x7fb3102026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 -- 172.21.15.1:0/3159383923 >> 172.21.15.1:0/3159383923 conn(0x7fb3100d2f00 msgr2=0x7fb31015ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 -- 172.21.15.1:0/3159383923 shutdown_connections 2023-12-02T01:29:50.667 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.665+0000 7fb2f67fc640 1 -- 172.21.15.1:0/3159383923 wait complete. 2023-12-02T01:29:50.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.672+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9c881650d0 con 0x7f9c881616e0 2023-12-02T01:29:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-12-02T01:29:50.674 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.673+0000 7f9c857fa640 1 -- 172.21.15.1:0/1371488256 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c80039090 con 0x7f9c881616e0 2023-12-02T01:29:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.674+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61f8008840 con 0x7f61f8052170 2023-12-02T01:29:50.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.674+0000 7f61fd7fa640 1 -- 172.21.15.1:0/3120180113 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61ec057e60 con 0x7f61f8052170 2023-12-02T01:29:50.676 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-12-02T01:29:50.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.676+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9c7406ae90 msgr2=0x7f9c7406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.676+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9c7406ae90 0x7f9c7406d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c007fd0 tx=0x7f9c7c007d60 comp rx=0 tx=0).stop 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.676+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c881616e0 msgr2=0x7f9c8815ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.676+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c881616e0 0x7f9c8815ce30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c80000f80 tx=0x7f9c80004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 shutdown_connections 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c88161ac0 0x7f9c881f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9c7406ae90 0x7f9c7406d350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c881616e0 0x7f9c8815ce30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 --2- 172.21.15.1:0/1371488256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c880d1840 0x7f9c88161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 >> 172.21.15.1:0/1371488256 conn(0x7f9c880d0d20 msgr2=0x7f9c8806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 shutdown_connections 2023-12-02T01:29:50.680 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.677+0000 7f9c8eb5a640 1 -- 172.21.15.1:0/1371488256 wait complete. 2023-12-02T01:29:50.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.678+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61e406ae90 msgr2=0x7f61e406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.678+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61e406ae90 0x7f61e406d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61f4001d90 tx=0x7f61f403a040 comp rx=0 tx=0).stop 2023-12-02T01:29:50.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.678+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8052170 msgr2=0x7f61f8009480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.678+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8052170 0x7f61f8009480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00e780 tx=0x7f61ec00ec40 comp rx=0 tx=0).stop 2023-12-02T01:29:50.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.678+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5e6c0cdb00 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f5e68ff9640 1 -- 172.21.15.1:0/3046144118 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e5c04a090 con 0x7f5e6c0cecd0 2023-12-02T01:29:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 shutdown_connections 2023-12-02T01:29:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f61e406ae90 0x7f61e406d350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8036ec0 0x7f61f8037340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61f8052170 0x7f61f8009480 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 --2- 172.21.15.1:0/3120180113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61f0004b90 0x7f61f817c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 >> 172.21.15.1:0/3120180113 conn(0x7f61f8053710 msgr2=0x7f61f8053af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 shutdown_connections 2023-12-02T01:29:50.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.679+0000 7f6206e7c640 1 -- 172.21.15.1:0/3120180113 wait complete. 2023-12-02T01:29:50.685 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-12-02T01:29:50.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.681+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4eb8005500 con 0x7f4ed004fa70 2023-12-02T01:29:50.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-12-02T01:29:50.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.682+0000 7f4ed4ff9640 1 -- 172.21.15.1:0/2318637881 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ed80ba090 con 0x7f4ed004fa70 2023-12-02T01:29:50.686 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-12-02T01:29:50.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.682+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5e5806aec0 msgr2=0x7f5e5806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.682+0000 7f5e710c3640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5e5806aec0 0x7f5e5806d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e60000f60 tx=0x7f5e60009040 comp rx=0 tx=0).stop 2023-12-02T01:29:50.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.682+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e6c0cecd0 msgr2=0x7f5e6c153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.682+0000 7f5e710c3640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e6c0cecd0 0x7f5e6c153a50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c034040 tx=0x7f5e5c0046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.687 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 shutdown_connections 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5e5806aec0 0x7f5e5806d380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e6c143ba0 0x7f5e6c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e6c0cecd0 0x7f5e6c153a50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 --2- 172.21.15.1:0/3046144118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e6c0cd460 0x7f5e6c154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 >> 172.21.15.1:0/3046144118 conn(0x7f5e6c06a6b0 msgr2=0x7f5e6c0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 shutdown_connections 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.683+0000 7f5e710c3640 1 -- 172.21.15.1:0/3046144118 wait complete. 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.684+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4ebc06af10 msgr2=0x7f4ebc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.684+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4ebc06af10 0x7f4ebc06d3d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc006fd0 tx=0x7f4ecc008040 comp rx=0 tx=0).stop 2023-12-02T01:29:50.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed004fa70 msgr2=0x7f4ed004a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed004fa70 0x7f4ed004a760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8079db0 tx=0x7f4ed80695d0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99200b1500 con 0x7f9920171710 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 shutdown_connections 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4ebc06af10 0x7f4ebc06d3d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed00530a0 0x7f4ed00e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ed004fa70 0x7f4ed004a760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 --2- 172.21.15.1:0/2318637881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ed000aad0 0x7f4ed004e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 >> 172.21.15.1:0/2318637881 conn(0x7f4ed0009fb0 msgr2=0x7f4ed0004a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 shutdown_connections 2023-12-02T01:29:50.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.685+0000 7f4ede2bb640 1 -- 172.21.15.1:0/2318637881 wait complete. 2023-12-02T01:29:50.691 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-12-02T01:29:50.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.686+0000 7f991d7fa640 1 -- 172.21.15.1:0/2955765213 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9908016090 con 0x7f9920171710 2023-12-02T01:29:50.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.688+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7bb80057d0 con 0x7f7bd004a2e0 2023-12-02T01:29:50.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.688+0000 7f7bc3fff640 1 -- 172.21.15.1:0/2063680119 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bd80b3020 con 0x7f7bd004a2e0 2023-12-02T01:29:50.692 INFO:teuthology.orchestra.run.smithi001.stdout:55834574853 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.689+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f990006ae40 msgr2=0x7f990006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.689+0000 7f9927256640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f990006ae40 0x7f990006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9910009f30 tx=0x7f991000b040 comp rx=0 tx=0).stop 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.689+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9920171710 msgr2=0x7f99201709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.689+0000 7f9927256640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9920171710 0x7f99201709f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f990800c550 tx=0x7f990800ca10 comp rx=0 tx=0).stop 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 shutdown_connections 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9920171710 0x7f99201709f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9920159390 0x7f99201704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f990006ae40 0x7f990006d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 --2- 172.21.15.1:0/2955765213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992006e3d0 0x7f99200b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 >> 172.21.15.1:0/2955765213 conn(0x7f992006a8f0 msgr2=0x7f99200702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 shutdown_connections 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.690+0000 7f9927256640 1 -- 172.21.15.1:0/2955765213 wait complete. 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.691+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7bbc06ae40 msgr2=0x7f7bbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.691+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7bbc06ae40 0x7f7bbc06d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc006fd0 tx=0x7f7bcc008040 comp rx=0 tx=0).stop 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bd004a2e0 msgr2=0x7f7bd000a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bd004a2e0 0x7f7bd000a580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8069ca0 tx=0x7f7bd806a1c0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 shutdown_connections 2023-12-02T01:29:50.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7bbc06ae40 0x7f7bbc06d300 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc006fd0 tx=0x7f7bcc008040 comp rx=0 tx=0).stop 2023-12-02T01:29:50.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bd00529b0 0x7f7bd0008e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bd004a2e0 0x7f7bd000a580 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8069ca0 tx=0x7f7bd806a1c0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 --2- 172.21.15.1:0/2063680119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bd0036170 0x7f7bd0051a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.692+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 >> 172.21.15.1:0/2063680119 conn(0x7f7bd0053770 msgr2=0x7f7bd00398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.693+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f429c04e840 con 0x7f429c0cf3e0 2023-12-02T01:29:50.695 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.693+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 shutdown_connections 2023-12-02T01:29:50.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.693+0000 7f7bdc92e640 1 -- 172.21.15.1:0/2063680119 wait complete. 2023-12-02T01:29:50.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.694+0000 7f4298ff9640 1 -- 172.21.15.1:0/4121239606 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4290057a90 con 0x7f429c0cf3e0 2023-12-02T01:29:50.696 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:50.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.696+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f428806ae40 msgr2=0x7f428806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.696+0000 7f42a1127640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f428806ae40 0x7f428806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f429c0cd1e0 tx=0x7f4294030000 comp rx=0 tx=0).stop 2023-12-02T01:29:50.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.696+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c0cf3e0 msgr2=0x7f429c163d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:50.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.696+0000 7f42a1127640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c0cf3e0 0x7f429c163d20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f429c070cd0 tx=0x7f429000c870 comp rx=0 tx=0).stop 2023-12-02T01:29:50.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.697+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 shutdown_connections 2023-12-02T01:29:50.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.697+0000 7f42a1127640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f429c14aca0 0x7f429c143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.697+0000 7f42a1127640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f429c0cf3e0 0x7f429c163d20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.697+0000 7f42a1127640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f428806ae40 0x7f428806d300 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f429c0cd1e0 tx=0x7f4294030000 comp rx=0 tx=0).stop 2023-12-02T01:29:50.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.697+0000 7f42a1127640 1 --2- 172.21.15.1:0/4121239606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f429c070880 0x7f429c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:50.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.697+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 >> 172.21.15.1:0/4121239606 conn(0x7f429c06a6b0 msgr2=0x7f429c0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:50.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-02T01:29:50.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.698+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 shutdown_connections 2023-12-02T01:29:50.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:50.698+0000 7f42a1127640 1 -- 172.21.15.1:0/4121239606 wait complete. 2023-12-02T01:29:50.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-02T01:29:50.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-02T01:29:50.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-12-02T01:29:50.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-12-02T01:29:50.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-02T01:29:50.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-12-02T01:29:51.687 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-02T01:29:51.701 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-02T01:29:51.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-02T01:29:51.706 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-02T01:29:51.709 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-02T01:29:51.710 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-02T01:29:51.713 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-02T01:29:51.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-02T01:29:51.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.865+0000 7f1b4bfff640 1 Processor -- start 2023-12-02T01:29:51.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.865+0000 7f1b4bfff640 1 -- start start 2023-12-02T01:29:51.869 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.866+0000 7f1b4bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1b440df7d0 0x7f1b44055ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.866+0000 7f1b4bfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b44036670 0x7f1b4404fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.866+0000 7f1b4bfff640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b44006c50 con 0x7f1b4403a070 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.866+0000 7f1b4bfff640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b44006f30 con 0x7f1b44036670 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.866+0000 7f1b4bfff640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b44007210 con 0x7f1b440df7d0 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.867+0000 7f1b4a7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b44036670 0x7f1b4404fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.867+0000 7f1b4a7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b44036670 0x7f1b4404fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59386/0 (socket says 172.21.15.1:59386) 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.867+0000 7f1b4a7fc640 1 -- 172.21.15.1:0/2322138933 learned_addr learned my addr 172.21.15.1:0/2322138933 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.867+0000 7f1b4affd640 1 --2- 172.21.15.1:0/2322138933 >> v2:172.21.15.167:3300/0 conn(0x7f1b440df7d0 0x7f1b44055ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.868+0000 7f1b49ffb640 1 -- 172.21.15.1:0/2322138933 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998191913 0 0) 0x7f1b44006c50 con 0x7f1b4403a070 2023-12-02T01:29:51.870 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.868+0000 7f1b49ffb640 1 -- 172.21.15.1:0/2322138933 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b34003520 con 0x7f1b4403a070 2023-12-02T01:29:51.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.868+0000 7f1b4affd640 1 -- 172.21.15.1:0/2322138933 >> v2:172.21.15.1:3300/0 conn(0x7f1b44036670 msgr2=0x7f1b4404fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.868+0000 7f1b4affd640 1 --2- 172.21.15.1:0/2322138933 >> v2:172.21.15.1:3300/0 conn(0x7f1b44036670 0x7f1b4404fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.868+0000 7f1b4affd640 1 -- 172.21.15.1:0/2322138933 >> v1:172.21.15.167:6789/0 conn(0x7f1b4403a070 legacy=0x7f1b4403a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.868+0000 7f1b4affd640 1 -- 172.21.15.1:0/2322138933 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b440074f0 con 0x7f1b440df7d0 2023-12-02T01:29:51.871 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.870+0000 7f1b4affd640 1 --2- 172.21.15.1:0/2322138933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44055ce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400dc30 tx=0x7f1b4002df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d455183cec17204 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.870+0000 7f1b49ffb640 1 -- 172.21.15.1:0/2322138933 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4002ed00 con 0x7f1b440df7d0 2023-12-02T01:29:51.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.870+0000 7f1b49ffb640 1 -- 172.21.15.1:0/2322138933 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40032070 con 0x7f1b440df7d0 2023-12-02T01:29:51.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.871+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2322138933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 msgr2=0x7f1b44055ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.871+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2322138933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44055ce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400dc30 tx=0x7f1b4002df50 comp rx=0 tx=0).stop 2023-12-02T01:29:51.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.871+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2322138933 shutdown_connections 2023-12-02T01:29:51.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.871+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2322138933 >> v2:172.21.15.1:3300/0 conn(0x7f1b44036670 0x7f1b4404fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.871+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2322138933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44055ce0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.871+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2322138933 >> 172.21.15.1:0/2322138933 conn(0x7f1b4401e690 msgr2=0x7f1b440553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.872+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2322138933 shutdown_connections 2023-12-02T01:29:51.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.872+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2322138933 wait complete. 2023-12-02T01:29:51.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.874+0000 7f1b4bfff640 1 Processor -- start 2023-12-02T01:29:51.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.874+0000 7f1b4bfff640 1 -- start start 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b44036670 0x7f1b4404b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4403a070 0x7f1b44054850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44048ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4bfff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b440dd350 con 0x7f1b44036670 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b44036670 0x7f1b4404b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b44036670 0x7f1b4404b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59398/0 (socket says 172.21.15.1:59398) 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4affd640 1 -- 172.21.15.1:0/2399735121 learned_addr learned my addr 172.21.15.1:0/2399735121 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44054d90 con 0x7f1b440df7d0 2023-12-02T01:29:51.878 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4b7fe640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44048ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.876+0000 7f1b4a7fc640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4403a070 0x7f1b44054850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.879 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.877+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44037c60 con 0x7f1b4403a070 2023-12-02T01:29:51.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.877+0000 7f1b4affd640 1 -- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4403a070 msgr2=0x7f1b44054850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.877+0000 7f1b4affd640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4403a070 0x7f1b44054850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.877+0000 7f1b4affd640 1 -- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 msgr2=0x7f1b44048ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.881 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.877+0000 7f1b4affd640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44048ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.877+0000 7f1b4affd640 1 -- 172.21.15.1:0/2399735121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4000b6a0 con 0x7f1b44036670 2023-12-02T01:29:51.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.878+0000 7f1b4b7fe640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44048ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:51.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.878+0000 7f1b4affd640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b44036670 0x7f1b4404b9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b4002e560 tx=0x7f1b400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.879+0000 7f1b4a7fc640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4403a070 0x7f1b44054850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:51.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.879+0000 7f1b337fe640 1 -- 172.21.15.1:0/2399735121 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40003c90 con 0x7f1b44036670 2023-12-02T01:29:51.882 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.879+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b440dcab0 con 0x7f1b44036670 2023-12-02T01:29:51.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.882+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b440dd070 con 0x7f1b44036670 2023-12-02T01:29:51.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.884+0000 7f1b337fe640 1 -- 172.21.15.1:0/2399735121 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40003df0 con 0x7f1b44036670 2023-12-02T01:29:51.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.884+0000 7f1b337fe640 1 -- 172.21.15.1:0/2399735121 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40042670 con 0x7f1b44036670 2023-12-02T01:29:51.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.884+0000 7f1b337fe640 1 -- 172.21.15.1:0/2399735121 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b40042810 con 0x7f1b44036670 2023-12-02T01:29:51.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.885+0000 7f1b337fe640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b3406b420 0x7f1b3406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.885+0000 7f1b4a7fc640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b3406b420 0x7f1b3406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.885+0000 7f1b337fe640 1 -- 172.21.15.1:0/2399735121 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b400b0170 con 0x7f1b44036670 2023-12-02T01:29:51.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.886+0000 7f1b4a7fc640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b3406b420 0x7f1b3406d8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b4404f970 tx=0x7f1b3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.886+0000 7f1b317fa640 1 -- 172.21.15.1:0/2399735121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b440056e0 con 0x7f1b44036670 2023-12-02T01:29:51.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.896+0000 7f1b337fe640 1 -- 172.21.15.1:0/2399735121 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b400b1060 con 0x7f1b44036670 2023-12-02T01:29:51.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.918+0000 7f9086aad640 1 Processor -- start 2023-12-02T01:29:51.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.918+0000 7f9086aad640 1 -- start start 2023-12-02T01:29:51.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.919+0000 7f81980d3640 1 Processor -- start 2023-12-02T01:29:51.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.919+0000 7f81980d3640 1 -- start start 2023-12-02T01:29:51.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.919+0000 7f4c3ff25640 1 Processor -- start 2023-12-02T01:29:51.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f9086aad640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f90800719d0 0x7f9080161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f9086aad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90800b3910 0x7f90800cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f9086aad640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908006ea60 con 0x7f9080071db0 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f9086aad640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9080162220 con 0x7f90800719d0 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f9086aad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080162500 con 0x7f90800b3910 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f90862ac640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9080071db0 0x7f90800b2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47244/0 (socket says 172.21.15.1:47244) 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f90862ac640 1 -- 172.21.15.1:0/2292986760 learned_addr learned my addr 172.21.15.1:0/2292986760 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f90852aa640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90800b3910 0x7f90800cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9085aab640 1 --2- 172.21.15.1:0/2292986760 >> v2:172.21.15.1:3300/0 conn(0x7f90800719d0 0x7f9080161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236917380 0 0) 0x7f908006ea60 con 0x7f9080071db0 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c003520 con 0x7f9080071db0 2023-12-02T01:29:51.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f81980d3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f8190160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.920+0000 7f4c3ff25640 1 -- start start 2023-12-02T01:29:51.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7fc486763640 1 Processor -- start 2023-12-02T01:29:51.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f4c3ff25640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c30050180 0x7f4c300e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f4c3ff25640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4c300530a0 0x7f4c30005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f4c3ff25640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300df4e0 con 0x7f4c300df100 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f4c3ff25640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3004f840 con 0x7f4c300530a0 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f4c3ff25640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c300e0640 con 0x7f4c30050180 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f4c3dcc1640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4c300df100 0x7f4c3004fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47248/0 (socket says 172.21.15.1:47248) 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f4c3dcc1640 1 -- 172.21.15.1:0/1161307968 learned_addr learned my addr 172.21.15.1:0/1161307968 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7fc486763640 1 -- start start 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f81980d3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8190070ed0 0x7f8190071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f81980d3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81900ceea0 con 0x7f81901434c0 2023-12-02T01:29:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f81980d3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8190161dc0 con 0x7f8190070ed0 2023-12-02T01:29:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f81980d3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81900718a0 con 0x7f81900ceac0 2023-12-02T01:29:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f4c3d4c0640 1 --2- 172.21.15.1:0/1161307968 >> v2:172.21.15.167:3300/0 conn(0x7f4c30050180 0x7f4c300e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f819566e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f81901434c0 0x7f819006cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:41584/0 (socket says 172.21.15.1:41584) 2023-12-02T01:29:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f819566e640 1 -- 172.21.15.1:0/3325386484 learned_addr learned my addr 172.21.15.1:0/3325386484 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f8195e6f640 1 --2- 172.21.15.1:0/3325386484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f8190160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f4c3e4c2640 1 --2- 172.21.15.1:0/1161307968 >> v2:172.21.15.1:3300/0 conn(0x7f4c300530a0 0x7f4c30005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f8196670640 1 --2- 172.21.15.1:0/3325386484 >> v2:172.21.15.1:3300/0 conn(0x7f8190070ed0 0x7f8190071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f89ab6fc640 1 Processor -- start 2023-12-02T01:29:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f8196670640 1 -- 172.21.15.1:0/3325386484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 msgr2=0x7f8190160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f8196670640 1 --2- 172.21.15.1:0/3325386484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f8190160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f8196670640 1 -- 172.21.15.1:0/3325386484 >> v1:172.21.15.167:6789/0 conn(0x7f81901434c0 legacy=0x7f819006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f8196670640 1 -- 172.21.15.1:0/3325386484 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819006d1e0 con 0x7f8190070ed0 2023-12-02T01:29:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7fc486763640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4800719d0 0x7fc48006e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fc486763640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4800b3910 0x7fc480071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fb2dc63d640 1 Processor -- start 2023-12-02T01:29:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fb2dc63d640 1 -- start start 2023-12-02T01:29:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f75fd0a2640 1 Processor -- start 2023-12-02T01:29:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f4c3e4c2640 1 -- 172.21.15.1:0/1161307968 >> v2:172.21.15.167:3300/0 conn(0x7f4c30050180 msgr2=0x7f4c300e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f4c3e4c2640 1 --2- 172.21.15.1:0/1161307968 >> v2:172.21.15.167:3300/0 conn(0x7f4c30050180 0x7f4c300e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f4c3ccbf640 1 -- 172.21.15.1:0/1161307968 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201415394 0 0) 0x7f4c300df4e0 con 0x7f4c300df100 2023-12-02T01:29:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f4c3e4c2640 1 -- 172.21.15.1:0/1161307968 >> v1:172.21.15.1:6789/0 conn(0x7f4c300df100 legacy=0x7f4c3004fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f4c3e4c2640 1 -- 172.21.15.1:0/1161307968 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300535f0 con 0x7f4c300530a0 2023-12-02T01:29:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f4c3e4c2640 1 --2- 172.21.15.1:0/1161307968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300530a0 0x7f4c30005fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c30052740 tx=0x7f4c2802cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b196601f48aaaaf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f89ab6fc640 1 -- start start 2023-12-02T01:29:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479289052 0 0) 0x7f906c003520 con 0x7f9080071db0 2023-12-02T01:29:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90800b3910 msgr2=0x7f90800cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90800b3910 0x7f90800cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 >> v2:172.21.15.1:3300/0 conn(0x7f90800719d0 msgr2=0x7f9080161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 --2- 172.21.15.1:0/2292986760 >> v2:172.21.15.1:3300/0 conn(0x7f90800719d0 0x7f9080161bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.921+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90801627e0 con 0x7f9080071db0 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f90780019f0 con 0x7f9080071db0 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 >> v1:172.21.15.1:6789/0 conn(0x7f9080071db0 legacy=0x7f90800b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f906c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90800b3910 0x7f906c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f906c004d00 0x7f906c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080162220 con 0x7f906c004d00 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080162500 con 0x7f906c003970 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c00ba60 con 0x7f90800b3910 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.922+0000 7f9085aab640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f906c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f9085aab640 1 -- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90800b3910 msgr2=0x7f906c0047c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f9085aab640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90800b3910 0x7f906c0047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f9085aab640 1 -- 172.21.15.1:0/2292986760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f906c004d00 msgr2=0x7f906c005180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f9085aab640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f906c004d00 0x7f906c005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f9085aab640 1 -- 172.21.15.1:0/2292986760 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c003520 con 0x7f906c003970 2023-12-02T01:29:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f4c3ccbf640 1 -- 172.21.15.1:0/1161307968 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2802d9d0 con 0x7f4c300530a0 2023-12-02T01:29:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f8196670640 1 --2- 172.21.15.1:0/3325386484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8190070ed0 0x7f8190071360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8180009a00 tx=0x7f818002bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f0731f966d1f0f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fc486763640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800cd110 con 0x7fc4800700c0 2023-12-02T01:29:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fc486763640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800b2e70 con 0x7fc4800719d0 2023-12-02T01:29:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fc486763640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48006e5b0 con 0x7fc4800b3910 2023-12-02T01:29:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fc484f60640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4800b3910 0x7fc480071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fc484f60640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4800b3910 0x7fc480071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:44054/0 (socket says 172.21.15.1:44054) 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7fc484f60640 1 -- 172.21.15.1:0/2523076188 learned_addr learned my addr 172.21.15.1:0/2523076188 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fc485761640 1 --2- 172.21.15.1:0/2523076188 >> v2:172.21.15.1:3300/0 conn(0x7fc4800719d0 0x7fc48006e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fc484f60640 1 -- 172.21.15.1:0/2523076188 >> v2:172.21.15.1:3300/0 conn(0x7fc4800719d0 msgr2=0x7fc48006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fc484f60640 1 --2- 172.21.15.1:0/2523076188 >> v2:172.21.15.1:3300/0 conn(0x7fc4800719d0 0x7fc48006e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fc484f60640 1 -- 172.21.15.1:0/2523076188 >> v1:172.21.15.167:6789/0 conn(0x7fc4800700c0 legacy=0x7fc4800b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fc484f60640 1 -- 172.21.15.1:0/2523076188 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800ce5b0 con 0x7fc4800b3910 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89ab6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c0061b0 0x7f899c006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89ab6fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f899c006b70 0x7f899c03c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89ab6fc640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0e36a0 con 0x7f899c0e32c0 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89ab6fc640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c058780 con 0x7f899c006b70 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89ab6fc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c006fc0 con 0x7f899c0061b0 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fb2dc63d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb2d40b3760 0x7fb2d40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fb2dc63d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40cf670 0x7fb2d40ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fb2dc63d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d415c300 con 0x7fb2d40ce140 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fb2dc63d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d415b4e0 con 0x7fb2d40b3760 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7fb2dc63d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40cd6d0 con 0x7fb2d40cf670 2023-12-02T01:29:51.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.923+0000 7f75fd0a2640 1 -- start start 2023-12-02T01:29:51.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89a8c97640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c0061b0 0x7f899c006630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f75fd0a2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f75f0057670 0x7f75f0057b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f75fd0a2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f0007040 con 0x7f75f003bee0 2023-12-02T01:29:51.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f75fd0a2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00e78c0 con 0x7f75f00e74e0 2023-12-02T01:29:51.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f75fd0a2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f0058cd0 con 0x7f75f0057670 2023-12-02T01:29:51.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89a9c99640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f899c006b70 0x7f899c03c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89a9c99640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f899c006b70 0x7f899c03c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59442/0 (socket says 172.21.15.1:59442) 2023-12-02T01:29:51.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f89a9c99640 1 -- 172.21.15.1:0/3811012247 learned_addr learned my addr 172.21.15.1:0/3811012247 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.924+0000 7f9085aab640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f906c003d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f907000ba30 tx=0x7f906c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b0ff7edde7ecefc server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2dabda640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40cf670 0x7fb2d40ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2dabda640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40cf670 0x7fb2d40ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:43200/0 (socket says 172.21.15.1:43200) 2023-12-02T01:29:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2dabda640 1 -- 172.21.15.1:0/2443497684 learned_addr learned my addr 172.21.15.1:0/2443497684 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f75fc8a1640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f75f003bee0 0x7f75f00536e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47274/0 (socket says 172.21.15.1:47274) 2023-12-02T01:29:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f75fc8a1640 1 -- 172.21.15.1:0/1313838362 learned_addr learned my addr 172.21.15.1:0/1313838362 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070030660 con 0x7f906c003970 2023-12-02T01:29:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700307c0 con 0x7f906c003970 2023-12-02T01:29:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f9084aa9640 1 -- 172.21.15.1:0/2292986760 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070030b90 con 0x7f906c003970 2023-12-02T01:29:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f75f659c640 1 --2- 172.21.15.1:0/1313838362 >> v2:172.21.15.1:3300/0 conn(0x7f75f0057670 0x7f75f0057b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2dabda640 1 -- 172.21.15.1:0/2443497684 >> v2:172.21.15.167:3300/0 conn(0x7fb2d40b3760 msgr2=0x7fb2d40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2da3d9640 1 --2- 172.21.15.1:0/2443497684 >> v2:172.21.15.167:3300/0 conn(0x7fb2d40b3760 0x7fb2d40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f8194e6d640 1 -- 172.21.15.1:0/3325386484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818002d6e0 con 0x7f8190070ed0 2023-12-02T01:29:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f8194e6d640 1 -- 172.21.15.1:0/3325386484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818002d840 con 0x7f8190070ed0 2023-12-02T01:29:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f8194e6d640 1 -- 172.21.15.1:0/3325386484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818002dbb0 con 0x7f8190070ed0 2023-12-02T01:29:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2dabda640 1 --2- 172.21.15.1:0/2443497684 >> v2:172.21.15.167:3300/0 conn(0x7fb2d40b3760 0x7fb2d40cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2dabda640 1 -- 172.21.15.1:0/2443497684 >> v1:172.21.15.1:6789/0 conn(0x7fb2d40ce140 legacy=0x7fb2d40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2d93d7640 1 -- 172.21.15.1:0/2443497684 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753622300 0 0) 0x7fb2d415c300 con 0x7fb2d40ce140 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f4c3ccbf640 1 -- 172.21.15.1:0/1161307968 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2802db30 con 0x7f4c300530a0 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f4c3ff25640 1 -- 172.21.15.1:0/1161307968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300530a0 msgr2=0x7f4c30005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/1161307968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300530a0 0x7f4c30005fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c30052740 tx=0x7f4c2802cc20 comp rx=0 tx=0).stop 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f4c3ff25640 1 -- 172.21.15.1:0/1161307968 shutdown_connections 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/1161307968 >> v2:172.21.15.167:3300/0 conn(0x7f4c30050180 0x7f4c300e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/1161307968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300530a0 0x7f4c30005fe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f4c3ff25640 1 -- 172.21.15.1:0/1161307968 >> 172.21.15.1:0/1161307968 conn(0x7f4c30009fb0 msgr2=0x7f4c3000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f89a8c97640 1 -- 172.21.15.1:0/3811012247 >> v2:172.21.15.1:3300/0 conn(0x7f899c006b70 msgr2=0x7f899c03c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f89a8c97640 1 --2- 172.21.15.1:0/3811012247 >> v2:172.21.15.1:3300/0 conn(0x7f899c006b70 0x7f899c03c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f89a8c97640 1 -- 172.21.15.1:0/3811012247 >> v1:172.21.15.167:6789/0 conn(0x7f899c0e32c0 legacy=0x7f899c0572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7f89a8c97640 1 -- 172.21.15.1:0/3811012247 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c057b00 con 0x7f899c0061b0 2023-12-02T01:29:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f89a8c97640 1 --2- 172.21.15.1:0/3811012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c0061b0 0x7f899c006630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f89a4069ca0 tx=0x7f89a40a5c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd391140e66f30a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f81980d3640 1 -- 172.21.15.1:0/3325386484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8190070ed0 msgr2=0x7f8190071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f81980d3640 1 --2- 172.21.15.1:0/3325386484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8190070ed0 0x7f8190071360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8180009a00 tx=0x7f818002bb30 comp rx=0 tx=0).stop 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f9086aad640 1 -- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 msgr2=0x7f906c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f9086aad640 1 --2- 172.21.15.1:0/2292986760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f906c003d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f907000ba30 tx=0x7f906c0057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f90862ac640 1 -- 172.21.15.1:0/2292986760 reap_dead start 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f9086aad640 1 -- 172.21.15.1:0/2292986760 shutdown_connections 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f9086aad640 1 -- 172.21.15.1:0/2292986760 >> 172.21.15.1:0/2292986760 conn(0x7f90800ceb20 msgr2=0x7f90800cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f9086aad640 1 -- 172.21.15.1:0/2292986760 shutdown_connections 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f9086aad640 1 -- 172.21.15.1:0/2292986760 wait complete. 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7fc484f60640 1 --2- 172.21.15.1:0/2523076188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800b3910 0x7fc480071db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc48006baf0 tx=0x7fc47c02bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ff34fc37e27e480 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7fc477fff640 1 -- 172.21.15.1:0/2523076188 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c02cb10 con 0x7fc4800b3910 2023-12-02T01:29:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7fc477fff640 1 -- 172.21.15.1:0/2523076188 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c02cc70 con 0x7fc4800b3910 2023-12-02T01:29:51.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7fc477fff640 1 -- 172.21.15.1:0/2523076188 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0343f0 con 0x7fc4800b3910 2023-12-02T01:29:51.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.925+0000 7fb2dabda640 1 -- 172.21.15.1:0/2443497684 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d415b6f0 con 0x7fb2d40cf670 2023-12-02T01:29:51.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f75f659c640 1 -- 172.21.15.1:0/1313838362 >> v1:172.21.15.167:6789/0 conn(0x7f75f00e74e0 legacy=0x7f75f00074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f75f659c640 1 -- 172.21.15.1:0/1313838362 >> v1:172.21.15.1:6789/0 conn(0x7f75f003bee0 legacy=0x7f75f00536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.926+0000 7f75f659c640 1 -- 172.21.15.1:0/1313838362 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0006430 con 0x7f75f0057670 2023-12-02T01:29:51.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f899bfff640 1 -- 172.21.15.1:0/3811012247 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40a6af0 con 0x7f899c0061b0 2023-12-02T01:29:51.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f899bfff640 1 -- 172.21.15.1:0/3811012247 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a40a6c50 con 0x7f899c0061b0 2023-12-02T01:29:51.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f899bfff640 1 -- 172.21.15.1:0/3811012247 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40ae640 con 0x7f899c0061b0 2023-12-02T01:29:51.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f81980d3640 1 -- 172.21.15.1:0/3325386484 shutdown_connections 2023-12-02T01:29:51.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f81980d3640 1 --2- 172.21.15.1:0/3325386484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8190070ed0 0x7f8190071360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f81980d3640 1 --2- 172.21.15.1:0/3325386484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f8190160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f81980d3640 1 -- 172.21.15.1:0/3325386484 >> 172.21.15.1:0/3325386484 conn(0x7f81900b1630 msgr2=0x7f81900b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f75f659c640 1 --2- 172.21.15.1:0/1313838362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 0x7f75f0057b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75f8069ca0 tx=0x7f75f80a5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60001cdececfde88 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f4c3ff25640 1 -- 172.21.15.1:0/1161307968 shutdown_connections 2023-12-02T01:29:51.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f81980d3640 1 -- 172.21.15.1:0/3325386484 shutdown_connections 2023-12-02T01:29:51.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f81980d3640 1 -- 172.21.15.1:0/3325386484 wait complete. 2023-12-02T01:29:51.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fb2dabda640 1 --2- 172.21.15.1:0/2443497684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40cf670 0x7fb2d40ce5d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009870 tx=0x7fb2c402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b42d362f38cf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fb2d93d7640 1 -- 172.21.15.1:0/2443497684 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4030860 con 0x7fb2d40cf670 2023-12-02T01:29:51.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fb2d93d7640 1 -- 172.21.15.1:0/2443497684 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c40309c0 con 0x7fb2d40cf670 2023-12-02T01:29:51.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fb2d93d7640 1 -- 172.21.15.1:0/2443497684 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4030d90 con 0x7fb2d40cf670 2023-12-02T01:29:51.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fc486763640 1 -- 172.21.15.1:0/2523076188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800b3910 msgr2=0x7fc480071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f75f5d9b640 1 -- 172.21.15.1:0/1313838362 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80a79e0 con 0x7f75f0057670 2023-12-02T01:29:51.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f75f5d9b640 1 -- 172.21.15.1:0/1313838362 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f80a7b40 con 0x7f75f0057670 2023-12-02T01:29:51.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f75f5d9b640 1 -- 172.21.15.1:0/1313838362 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80a6440 con 0x7f75f0057670 2023-12-02T01:29:51.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fc486763640 1 --2- 172.21.15.1:0/2523076188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800b3910 0x7fc480071db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc48006baf0 tx=0x7fc47c02bf70 comp rx=0 tx=0).stop 2023-12-02T01:29:51.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fc486763640 1 -- 172.21.15.1:0/2523076188 shutdown_connections 2023-12-02T01:29:51.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fc486763640 1 --2- 172.21.15.1:0/2523076188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800b3910 0x7fc480071db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fc486763640 1 --2- 172.21.15.1:0/2523076188 >> v2:172.21.15.1:3300/0 conn(0x7fc4800719d0 0x7fc48006e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7fc486763640 1 -- 172.21.15.1:0/2523076188 >> 172.21.15.1:0/2523076188 conn(0x7fc4800ceb20 msgr2=0x7fc4800cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f89ab6fc640 1 -- 172.21.15.1:0/3811012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c0061b0 msgr2=0x7f899c006630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/3811012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c0061b0 0x7f899c006630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f89a4069ca0 tx=0x7f89a40a5c80 comp rx=0 tx=0).stop 2023-12-02T01:29:51.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.927+0000 7f4c3ff25640 1 -- 172.21.15.1:0/1161307968 wait complete. 2023-12-02T01:29:51.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7fc486763640 1 -- 172.21.15.1:0/2523076188 shutdown_connections 2023-12-02T01:29:51.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f9086aad640 1 Processor -- start 2023-12-02T01:29:51.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f9086aad640 1 -- start start 2023-12-02T01:29:51.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f89ab6fc640 1 -- 172.21.15.1:0/3811012247 shutdown_connections 2023-12-02T01:29:51.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/3811012247 >> v2:172.21.15.1:3300/0 conn(0x7f899c006b70 0x7f899c03c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/3811012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c0061b0 0x7f899c006630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f89ab6fc640 1 -- 172.21.15.1:0/3811012247 >> 172.21.15.1:0/3811012247 conn(0x7f899c058eb0 msgr2=0x7f899c0592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7fb2dc63d640 1 -- 172.21.15.1:0/2443497684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40cf670 msgr2=0x7fb2d40ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7f89ab6fc640 1 -- 172.21.15.1:0/3811012247 shutdown_connections 2023-12-02T01:29:51.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f75fd0a2640 1 -- 172.21.15.1:0/1313838362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 msgr2=0x7f75f0057b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/1313838362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 0x7f75f0057b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75f8069ca0 tx=0x7f75f80a5b60 comp rx=0 tx=0).stop 2023-12-02T01:29:51.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f81980d3640 1 Processor -- start 2023-12-02T01:29:51.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/2443497684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40cf670 0x7fb2d40ce5d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009870 tx=0x7fb2c402b9a0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f89ab6fc640 1 -- 172.21.15.1:0/3811012247 wait complete. 2023-12-02T01:29:51.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f75fd0a2640 1 -- 172.21.15.1:0/1313838362 shutdown_connections 2023-12-02T01:29:51.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/1313838362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 0x7f75f0057b00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f75fd0a2640 1 -- 172.21.15.1:0/1313838362 >> 172.21.15.1:0/1313838362 conn(0x7f75f0059090 msgr2=0x7f75f00594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f81980d3640 1 -- start start 2023-12-02T01:29:51.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f75fd0a2640 1 -- 172.21.15.1:0/1313838362 shutdown_connections 2023-12-02T01:29:51.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f9086aad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f908015f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f9086aad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9080161020 0x7f9080151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f9086aad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f908015ec30 0x7f908009bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9086aad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015fd50 con 0x7f908015ec30 2023-12-02T01:29:51.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9086aad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015ff80 con 0x7f906c003970 2023-12-02T01:29:51.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.928+0000 7fc486763640 1 -- 172.21.15.1:0/2523076188 wait complete. 2023-12-02T01:29:51.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7fc486763640 1 Processor -- start 2023-12-02T01:29:51.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9086aad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080160260 con 0x7f9080161020 2023-12-02T01:29:51.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f908015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f908015f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:44080/0 (socket says 172.21.15.1:44080) 2023-12-02T01:29:51.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 -- 172.21.15.1:0/2338908975 learned_addr learned my addr 172.21.15.1:0/2338908975 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f90862ac640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f908015ec30 0x7f908009bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f90852aa640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9080161020 0x7f9080151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 -- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9080161020 msgr2=0x7f9080151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9080161020 0x7f9080151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 -- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f908015ec30 msgr2=0x7f908009bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f908015ec30 0x7f908009bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 -- 172.21.15.1:0/2338908975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080160540 con 0x7f906c003970 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f90862ac640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f908015ec30 0x7f908009bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f9085aab640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f908015f810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f907002bfe0 tx=0x7f9070004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f81980d3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190070ed0 0x7f8190160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7fb2dc63d640 1 -- 172.21.15.1:0/2443497684 shutdown_connections 2023-12-02T01:29:51.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/2443497684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40cf670 0x7fb2d40ce5d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/2443497684 >> v2:172.21.15.167:3300/0 conn(0x7fb2d40b3760 0x7fb2d40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fb2dc63d640 1 -- 172.21.15.1:0/2443497684 >> 172.21.15.1:0/2443497684 conn(0x7fb2d40b0ca0 msgr2=0x7fb2d40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:51.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fb2dc63d640 1 -- 172.21.15.1:0/2443497684 shutdown_connections 2023-12-02T01:29:51.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fb2dc63d640 1 -- 172.21.15.1:0/2443497684 wait complete. 2023-12-02T01:29:51.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f81980d3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f819015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f81980d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81901434c0 0x7f819015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f4c3ff25640 1 Processor -- start 2023-12-02T01:29:51.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f4c3ff25640 1 -- start start 2023-12-02T01:29:51.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f4c3ff25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c30050180 0x7f4c300478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f4c3ff25640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c300530a0 0x7f4c30036b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f4c3ff25640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300df100 0x7f4c3017d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f4c3ff25640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3004b190 con 0x7f4c300df100 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f4c3ff25640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3017d5b0 con 0x7f4c30050180 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7f4c3ff25640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30046800 con 0x7f4c300530a0 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f4c3e4c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300df100 0x7f4c3017d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f4c3e4c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300df100 0x7f4c3017d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59474/0 (socket says 172.21.15.1:59474) 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f4c3e4c2640 1 -- 172.21.15.1:0/780250773 learned_addr learned my addr 172.21.15.1:0/780250773 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f81980d3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81901e83d0 con 0x7f81901434c0 2023-12-02T01:29:51.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f81980d3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81901e8670 con 0x7f8190070ed0 2023-12-02T01:29:51.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f89ab6fc640 1 Processor -- start 2023-12-02T01:29:51.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.930+0000 7fc486763640 1 -- start start 2023-12-02T01:29:51.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.929+0000 7f75fd0a2640 1 -- 172.21.15.1:0/1313838362 wait complete. 2023-12-02T01:29:51.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc486763640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800700c0 0x7fc480089a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc486763640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4800719d0 0x7fc48009b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc486763640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4800b3910 0x7fc48009bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc486763640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48009a830 con 0x7fc4800719d0 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc486763640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48009ab10 con 0x7fc4800700c0 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc486763640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48016a320 con 0x7fc4800b3910 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f89ab6fc640 1 -- start start 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f819566e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f819015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f819566e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f819015c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:43204/0 (socket says 172.21.15.1:43204) 2023-12-02T01:29:51.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f819566e640 1 -- 172.21.15.1:0/760574645 learned_addr learned my addr 172.21.15.1:0/760574645 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f8196670640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81901434c0 0x7f819015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f75fd0a2640 1 Processor -- start 2023-12-02T01:29:51.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81901e8950 con 0x7f81900ceac0 2023-12-02T01:29:51.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc485761640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800700c0 0x7fc480089a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f4c3dcc1640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c30050180 0x7f4c300478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f4c3d4c0640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c300530a0 0x7f4c30036b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f75fd0a2640 1 -- start start 2023-12-02T01:29:51.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7f90767fc640 1 -- 172.21.15.1:0/2338908975 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907003f070 con 0x7f906c003970 2023-12-02T01:29:51.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc485761640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800700c0 0x7fc480089a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:44106/0 (socket says 172.21.15.1:44106) 2023-12-02T01:29:51.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.931+0000 7fc485761640 1 -- 172.21.15.1:0/3531961383 learned_addr learned my addr 172.21.15.1:0/3531961383 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f8195e6f640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190070ed0 0x7f8190160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.965 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7fc485f62640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4800b3910 0x7fc48009bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f90767fc640 1 -- 172.21.15.1:0/2338908975 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907003a760 con 0x7f906c003970 2023-12-02T01:29:51.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f90767fc640 1 -- 172.21.15.1:0/2338908975 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907003ab10 con 0x7f906c003970 2023-12-02T01:29:51.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9080160820 con 0x7f906c003970 2023-12-02T01:29:51.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f4c3e4c2640 1 -- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c300530a0 msgr2=0x7f4c30036b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f4c3e4c2640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c300530a0 0x7f4c30036b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f4c3e4c2640 1 -- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c30050180 msgr2=0x7f4c300478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f4c3e4c2640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c30050180 0x7f4c300478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f4c3e4c2640 1 -- 172.21.15.1:0/780250773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28009c90 con 0x7f4c300df100 2023-12-02T01:29:51.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9080152070 con 0x7f906c003970 2023-12-02T01:29:51.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7fc485761640 1 -- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4800b3910 msgr2=0x7fc48009bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f4c3e4c2640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300df100 0x7f4c3017d070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4c2802d230 tx=0x7f4c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7fc485761640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4800b3910 0x7fc48009bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7fc485761640 1 -- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4800719d0 msgr2=0x7fc48009b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f819566e640 1 -- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190070ed0 msgr2=0x7f8190160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f819566e640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190070ed0 0x7f8190160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f819566e640 1 -- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81901434c0 msgr2=0x7f819015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f819566e640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81901434c0 0x7f819015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f819566e640 1 -- 172.21.15.1:0/760574645 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009400 con 0x7f81900ceac0 2023-12-02T01:29:51.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f819566e640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f819015c590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f818800cbc0 tx=0x7f818800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7fb2dc63d640 1 Processor -- start 2023-12-02T01:29:51.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7fb2dc63d640 1 -- start start 2023-12-02T01:29:51.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f75fd0a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75f003bee0 0x7f75f00521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f75fd0a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 0x7f75f00de2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f89ab6fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f899c0061b0 0x7f899c0d6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f75f659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 0x7f75f00de2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89ab6fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c006b70 0x7f899c0e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7f4c2e7fc640 1 -- 172.21.15.1:0/780250773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2802dea0 con 0x7f4c300df100 2023-12-02T01:29:51.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f4c2e7fc640 1 -- 172.21.15.1:0/780250773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2800c050 con 0x7f4c300df100 2023-12-02T01:29:51.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f4c2e7fc640 1 -- 172.21.15.1:0/780250773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28040860 con 0x7f4c300df100 2023-12-02T01:29:51.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c30046ae0 con 0x7f4c300df100 2023-12-02T01:29:51.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89a9498640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f899c0061b0 0x7f899c0d6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89ab6fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f899c0e32c0 0x7f899c0e6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89a9498640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f899c0061b0 0x7f899c0d6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59502/0 (socket says 172.21.15.1:59502) 2023-12-02T01:29:51.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.933+0000 7f75f6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75f003bee0 0x7f75f00521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75f6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75f003bee0 0x7f75f00521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:44110/0 (socket says 172.21.15.1:44110) 2023-12-02T01:29:51.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75f6d9d640 1 -- 172.21.15.1:0/687182014 learned_addr learned my addr 172.21.15.1:0/687182014 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c300470a0 con 0x7f4c300df100 2023-12-02T01:29:51.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89a8c97640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c006b70 0x7f899c0e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89a9498640 1 -- 172.21.15.1:0/1538432993 learned_addr learned my addr 172.21.15.1:0/1538432993 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75f00e74e0 0x7f75f00e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00e3310 con 0x7f75f0057670 2023-12-02T01:29:51.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f81867fc640 1 -- 172.21.15.1:0/760574645 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818800aca0 con 0x7f81900ceac0 2023-12-02T01:29:51.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00e2090 con 0x7f75f003bee0 2023-12-02T01:29:51.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00e2cc0 con 0x7f75f00e74e0 2023-12-02T01:29:51.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f81867fc640 1 -- 172.21.15.1:0/760574645 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818800ae00 con 0x7f81900ceac0 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75f6d9d640 1 -- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75f00e74e0 msgr2=0x7f75f00e37a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75f6d9d640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75f00e74e0 0x7f75f00e37a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75f6d9d640 1 -- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 msgr2=0x7f75f00de2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75f6d9d640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 0x7f75f00de2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f75f6d9d640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f804f730 con 0x7f75f003bee0 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f90767fc640 1 -- 172.21.15.1:0/2338908975 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f907003ac70 con 0x7f906c003970 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f90767fc640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f906406aec0 0x7f906406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f90767fc640 1 -- 172.21.15.1:0/2338908975 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90700abd70 con 0x7f906c003970 2023-12-02T01:29:51.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f75f6d9d640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75f003bee0 0x7f75f00521b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75e800c780 tx=0x7f75e800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f81867fc640 1 -- 172.21.15.1:0/760574645 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188012600 con 0x7f81900ceac0 2023-12-02T01:29:51.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2dc63d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40b3760 0x7fb2d415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2dc63d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d40ce140 0x7fb2d409b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2dc63d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d40cf670 0x7fb2d40aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2dc63d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c9b20 con 0x7fb2d40ce140 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2dc63d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c9e00 con 0x7fb2d40cf670 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2dc63d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c8ea0 con 0x7fb2d40b3760 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0e57f0 con 0x7f899c0061b0 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c04caa0 con 0x7f899c0e32c0 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0505b0 con 0x7f899c006b70 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.934+0000 7f89a9c99640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f899c0e32c0 0x7f899c0e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f89a9498640 1 -- 172.21.15.1:0/1538432993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c006b70 msgr2=0x7f899c0e5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f89a9498640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c006b70 0x7f899c0e5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f89a9498640 1 -- 172.21.15.1:0/1538432993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f899c0e32c0 msgr2=0x7f899c0e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f89a9498640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f899c0e32c0 0x7f899c0e6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f89a9498640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a404f730 con 0x7f899c0061b0 2023-12-02T01:29:51.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f89a9498640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f899c0061b0 0x7f899c0d6970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f899400c3c0 tx=0x7f899400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7fc485761640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4800719d0 0x7fc48009b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.932+0000 7fc485761640 1 -- 172.21.15.1:0/3531961383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009b30 con 0x7fc4800700c0 2023-12-02T01:29:51.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2da3d9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40b3760 0x7fb2d415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2da3d9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40b3760 0x7fb2d415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:43250/0 (socket says 172.21.15.1:43250) 2023-12-02T01:29:51.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2da3d9640 1 -- 172.21.15.1:0/479238843 learned_addr learned my addr 172.21.15.1:0/479238843 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:51.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f75df7fe640 1 -- 172.21.15.1:0/687182014 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8005270 con 0x7f75f003bee0 2023-12-02T01:29:51.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f75df7fe640 1 -- 172.21.15.1:0/687182014 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e80053d0 con 0x7f75f003bee0 2023-12-02T01:29:51.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f75df7fe640 1 -- 172.21.15.1:0/687182014 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800a860 con 0x7f75f003bee0 2023-12-02T01:29:51.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f90852aa640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f906406aec0 0x7f906406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f00e2fa0 con 0x7f75f003bee0 2023-12-02T01:29:51.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f8999ffb640 1 -- 172.21.15.1:0/1538432993 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940050d0 con 0x7f899c0061b0 2023-12-02T01:29:51.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f00ded60 con 0x7f75f003bee0 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f8999ffb640 1 -- 172.21.15.1:0/1538432993 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994005250 con 0x7f899c0061b0 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7fb2d9bd8640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d40ce140 0x7fb2d409b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7fb2da3d9640 1 -- 172.21.15.1:0/479238843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d40cf670 msgr2=0x7fb2d40aefa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7fb2da3d9640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d40cf670 0x7fb2d40aefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7fb2da3d9640 1 -- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d40ce140 msgr2=0x7fb2d409b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7fb2da3d9640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d40ce140 0x7fb2d409b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7fb2da3d9640 1 -- 172.21.15.1:0/479238843 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c40094d0 con 0x7fb2d40b3760 2023-12-02T01:29:51.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7fb2d9bd8640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d40ce140 0x7fb2d409b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:51.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f8999ffb640 1 -- 172.21.15.1:0/1538432993 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994007020 con 0x7f899c0061b0 2023-12-02T01:29:51.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9080160d40 con 0x7f906c003970 2023-12-02T01:29:51.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f90852aa640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f906406aec0 0x7f906406d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9080162100 tx=0x7f907c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7fb2da3d9640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40b3760 0x7fb2d415a2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000c820 tx=0x7fb2d000cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81901e8c30 con 0x7f81900ceac0 2023-12-02T01:29:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8190160770 con 0x7f81900ceac0 2023-12-02T01:29:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.935+0000 7f4c2e7fc640 1 -- 172.21.15.1:0/780250773 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c2803c040 con 0x7f4c300df100 2023-12-02T01:29:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f4c2e7fc640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4c1c06af10 0x7f4c1c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f4c2e7fc640 1 -- 172.21.15.1:0/780250773 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c280ab750 con 0x7f4c300df100 2023-12-02T01:29:51.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.937+0000 7f4c3dcc1640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4c1c06af10 0x7f4c1c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c04ff80 con 0x7f899c0061b0 2023-12-02T01:29:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.936+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c0e5160 con 0x7f899c0061b0 2023-12-02T01:29:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.937+0000 7fb2caffd640 1 -- 172.21.15.1:0/479238843 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0004020 con 0x7fb2d40b3760 2023-12-02T01:29:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.937+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c300379a0 con 0x7f4c300df100 2023-12-02T01:29:51.985 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.937+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40c9180 con 0x7fb2d40b3760 2023-12-02T01:29:51.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.937+0000 7f4c3dcc1640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4c1c06af10 0x7f4c1c06d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c34000f60 tx=0x7f4c34007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d40c9740 con 0x7fb2d40b3760 2023-12-02T01:29:51.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81901e9150 con 0x7f81900ceac0 2023-12-02T01:29:51.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c0056d0 con 0x7f899c0061b0 2023-12-02T01:29:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7fc485761640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800700c0 0x7fc480089a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc47000d5f0 tx=0x7fc47000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7f75df7fe640 1 -- 172.21.15.1:0/687182014 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75e800a9c0 con 0x7f75f003bee0 2023-12-02T01:29:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7f75df7fe640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f75e406af40 0x7f75e406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7f75df7fe640 1 -- 172.21.15.1:0/687182014 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75e8088ae0 con 0x7f75f003bee0 2023-12-02T01:29:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7fb2caffd640 1 -- 172.21.15.1:0/479238843 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0004180 con 0x7fb2d40b3760 2023-12-02T01:29:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.938+0000 7fb2caffd640 1 -- 172.21.15.1:0/479238843 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0007830 con 0x7fb2d40b3760 2023-12-02T01:29:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f0054660 con 0x7f75f003bee0 2023-12-02T01:29:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7f81867fc640 1 -- 172.21.15.1:0/760574645 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8188007070 con 0x7f81900ceac0 2023-12-02T01:29:51.988 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7f75f659c640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f75e406af40 0x7f75e406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7f81867fc640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f817406af40 0x7f817406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc005250 con 0x7fb2d40b3760 2023-12-02T01:29:51.989 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7fb2caffd640 1 -- 172.21.15.1:0/479238843 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2d0007990 con 0x7fb2d40b3760 2023-12-02T01:29:51.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7f8999ffb640 1 -- 172.21.15.1:0/1538432993 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89940071a0 con 0x7f899c0061b0 2023-12-02T01:29:51.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7f8195e6f640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f817406af40 0x7f817406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.939+0000 7f81867fc640 1 -- 172.21.15.1:0/760574645 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81880893b0 con 0x7f81900ceac0 2023-12-02T01:29:51.990 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7f8999ffb640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f898806af40 0x7f898806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7f75f659c640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f75e406af40 0x7f75e406d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75f0011dc0 tx=0x7f75f806d030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7fb2caffd640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2b806ae90 0x7fb2b806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7f89a8c97640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f898806af40 0x7f898806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.991 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7fb2d9bd8640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2b806ae90 0x7fb2b806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7fb2caffd640 1 -- 172.21.15.1:0/479238843 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2d0089160 con 0x7fb2d40b3760 2023-12-02T01:29:51.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7f8999ffb640 1 -- 172.21.15.1:0/1538432993 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89940996f0 con 0x7f899c0061b0 2023-12-02T01:29:51.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.940+0000 7f8195e6f640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f817406af40 0x7f817406d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f818c009b40 tx=0x7f818c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.992 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.941+0000 7f89a8c97640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f898806af40 0x7f898806d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f899c0085a0 tx=0x7f89a40aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.941+0000 7fb2d9bd8640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2b806ae90 0x7fb2b806d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2d409b1e0 tx=0x7fb2cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.944+0000 7f4c2e7fc640 1 -- 172.21.15.1:0/780250773 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c280769b0 con 0x7f4c300df100 2023-12-02T01:29:51.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.944+0000 7fc475ffb640 1 -- 172.21.15.1:0/3531961383 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700125f0 con 0x7fc4800700c0 2023-12-02T01:29:51.993 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.944+0000 7f90767fc640 1 -- 172.21.15.1:0/2338908975 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9080160d40 con 0x7f906c003970 2023-12-02T01:29:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.944+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48016a600 con 0x7fc4800700c0 2023-12-02T01:29:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.944+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48015e960 con 0x7fc4800700c0 2023-12-02T01:29:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.945+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48004e840 con 0x7fc4800700c0 2023-12-02T01:29:51.994 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.949+0000 7f81867fc640 1 -- 172.21.15.1:0/760574645 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81901e9150 con 0x7f81900ceac0 2023-12-02T01:29:51.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.952+0000 7f8999ffb640 1 -- 172.21.15.1:0/1538432993 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8994064830 con 0x7f899c0061b0 2023-12-02T01:29:51.995 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.954+0000 7f75df7fe640 1 -- 172.21.15.1:0/687182014 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75e8017020 con 0x7f75f003bee0 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.953+0000 7fc475ffb640 1 -- 172.21.15.1:0/3531961383 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470012750 con 0x7fc4800700c0 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.953+0000 7fc475ffb640 1 -- 172.21.15.1:0/3531961383 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470012ac0 con 0x7fc4800700c0 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.956+0000 7fc475ffb640 1 -- 172.21.15.1:0/3531961383 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc470012c20 con 0x7fc4800700c0 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.956+0000 7fc475ffb640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc46406ae40 0x7fc46406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.956+0000 7fc475ffb640 1 -- 172.21.15.1:0/3531961383 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc47008a520 con 0x7fc4800700c0 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.957+0000 7fc484f60640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc46406ae40 0x7fc46406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.957+0000 7fc484f60640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc46406ae40 0x7fc46406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc47c035000 tx=0x7fc47c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:51.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.959+0000 7fb2caffd640 1 -- 172.21.15.1:0/479238843 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2d0054360 con 0x7fb2d40b3760 2023-12-02T01:29:51.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:51.961+0000 7fc475ffb640 1 -- 172.21.15.1:0/3531961383 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc470055640 con 0x7fc4800700c0 2023-12-02T01:29:52.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.294+0000 7f1b317fa640 1 -- 172.21.15.1:0/2399735121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1b44005f80 con 0x7f1b44036670 2023-12-02T01:29:52.296 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.295+0000 7f1b337fe640 1 -- 172.21.15.1:0/2399735121 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b40076d80 con 0x7f1b44036670 2023-12-02T01:29:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:52.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.298+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b3406b420 msgr2=0x7f1b3406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.298+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b3406b420 0x7f1b3406d8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b4404f970 tx=0x7f1b3c008040 comp rx=0 tx=0).stop 2023-12-02T01:29:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.298+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b44036670 msgr2=0x7f1b4404b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.298+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b44036670 0x7f1b4404b9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b4002e560 tx=0x7f1b400046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 shutdown_connections 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b3406b420 0x7f1b3406d8e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440df7d0 0x7f1b44048ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4403a070 0x7f1b44054850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 --2- 172.21.15.1:0/2399735121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b44036670 0x7f1b4404b9b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 >> 172.21.15.1:0/2399735121 conn(0x7f1b4401e690 msgr2=0x7f1b440064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 shutdown_connections 2023-12-02T01:29:52.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.299+0000 7f1b4bfff640 1 -- 172.21.15.1:0/2399735121 wait complete. 2023-12-02T01:29:52.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-12-02T01:29:52.318 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.333+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81901e9150 con 0x7f81900ceac0 2023-12-02T01:29:52.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.333+0000 7f81867fc640 1 -- 172.21.15.1:0/760574645 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81901e9150 con 0x7f81900ceac0 2023-12-02T01:29:52.335 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f817406af40 msgr2=0x7f817406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f817406af40 0x7f817406d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f818c009b40 tx=0x7f818c009190 comp rx=0 tx=0).stop 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 msgr2=0x7f819015c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f819015c590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f818800cbc0 tx=0x7f818800a060 comp rx=0 tx=0).stop 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 shutdown_connections 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81901434c0 0x7f819015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81900ceac0 0x7f819015c590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f817406af40 0x7f817406d400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 --2- 172.21.15.1:0/760574645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8190070ed0 0x7f8190160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 >> 172.21.15.1:0/760574645 conn(0x7f81900b1630 msgr2=0x7f81900ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 shutdown_connections 2023-12-02T01:29:52.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.336+0000 7f81980d3640 1 -- 172.21.15.1:0/760574645 wait complete. 2023-12-02T01:29:52.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.340+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4c30052c50 con 0x7f4c300df100 2023-12-02T01:29:52.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.341+0000 7f4c2e7fc640 1 -- 172.21.15.1:0/780250773 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c2803a020 con 0x7f4c300df100 2023-12-02T01:29:52.342 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.344+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4c1c06af10 msgr2=0x7f4c1c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.344+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4c1c06af10 0x7f4c1c06d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c34000f60 tx=0x7f4c34007d50 comp rx=0 tx=0).stop 2023-12-02T01:29:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.344+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300df100 msgr2=0x7f4c3017d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.344+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300df100 0x7f4c3017d070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4c2802d230 tx=0x7f4c280046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 shutdown_connections 2023-12-02T01:29:52.347 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c300df100 0x7f4c3017d070 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c300530a0 0x7f4c30036b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4c1c06af10 0x7f4c1c06d3d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 --2- 172.21.15.1:0/780250773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c30050180 0x7f4c300478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 >> 172.21.15.1:0/780250773 conn(0x7f4c30009fb0 msgr2=0x7f4c300de110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 shutdown_connections 2023-12-02T01:29:52.348 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.345+0000 7f4c3ff25640 1 -- 172.21.15.1:0/780250773 wait complete. 2023-12-02T01:29:52.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-12-02T01:29:52.352 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.355+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9080160d40 con 0x7f906c003970 2023-12-02T01:29:52.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.356+0000 7f90767fc640 1 -- 172.21.15.1:0/2338908975 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9080160d40 con 0x7f906c003970 2023-12-02T01:29:52.357 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.356+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f899c039760 con 0x7f899c0061b0 2023-12-02T01:29:52.357 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:52.358 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.356+0000 7f8999ffb640 1 -- 172.21.15.1:0/1538432993 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8994067e50 con 0x7f899c0061b0 2023-12-02T01:29:52.358 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f906406aec0 msgr2=0x7f906406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f906406aec0 0x7f906406d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9080162100 tx=0x7f907c008040 comp rx=0 tx=0).stop 2023-12-02T01:29:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 msgr2=0x7f908015f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f908015f810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f907002bfe0 tx=0x7f9070004730 comp rx=0 tx=0).stop 2023-12-02T01:29:52.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-12-02T01:29:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f898806af40 msgr2=0x7f898806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f898806af40 0x7f898806d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f899c0085a0 tx=0x7f89a40aa000 comp rx=0 tx=0).stop 2023-12-02T01:29:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f899c0061b0 msgr2=0x7f899c0d6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f899c0061b0 0x7f899c0d6970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f899400c3c0 tx=0x7f899400c880 comp rx=0 tx=0).stop 2023-12-02T01:29:52.362 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 shutdown_connections 2023-12-02T01:29:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f908015ec30 0x7f908009bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9080161020 0x7f9080151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f906406aec0 0x7f906406d380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 --2- 172.21.15.1:0/2338908975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f906c003970 0x7f908015f810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 >> 172.21.15.1:0/2338908975 conn(0x7f90800ceb20 msgr2=0x7f90800af160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 shutdown_connections 2023-12-02T01:29:52.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f898806af40 0x7f898806d400 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 shutdown_connections 2023-12-02T01:29:52.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f9086aad640 1 -- 172.21.15.1:0/2338908975 wait complete. 2023-12-02T01:29:52.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f899c0e32c0 0x7f899c0e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899c006b70 0x7f899c0e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 --2- 172.21.15.1:0/1538432993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f899c0061b0 0x7f899c0d6970 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.359+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 >> 172.21.15.1:0/1538432993 conn(0x7f899c058eb0 msgr2=0x7f899c038c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.360+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 shutdown_connections 2023-12-02T01:29:52.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.360+0000 7f89ab6fc640 1 -- 172.21.15.1:0/1538432993 wait complete. 2023-12-02T01:29:52.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.367+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc48009ac50 con 0x7fc4800700c0 2023-12-02T01:29:52.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.369+0000 7fc475ffb640 1 -- 172.21.15.1:0/3531961383 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc48009ac50 con 0x7fc4800700c0 2023-12-02T01:29:52.370 INFO:teuthology.orchestra.run.smithi001.stdout:55834574855 2023-12-02T01:29:52.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75f00058b0 con 0x7f75f003bee0 2023-12-02T01:29:52.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7f75df7fe640 1 -- 172.21.15.1:0/687182014 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75e8053cb0 con 0x7f75f003bee0 2023-12-02T01:29:52.373 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:52.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc46406ae40 msgr2=0x7fc46406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc46406ae40 0x7fc46406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc47c035000 tx=0x7fc47c02e000 comp rx=0 tx=0).stop 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800700c0 msgr2=0x7fc480089a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800700c0 0x7fc480089a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc47000d5f0 tx=0x7fc47000dab0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 shutdown_connections 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4800b3910 0x7fc48009bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4800719d0 0x7fc48009b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc46406ae40 0x7fc46406d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 --2- 172.21.15.1:0/3531961383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4800700c0 0x7fc480089a60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 >> 172.21.15.1:0/3531961383 conn(0x7fc4800ceb20 msgr2=0x7fc4800affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.371+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 shutdown_connections 2023-12-02T01:29:52.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-12-02T01:29:52.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.372+0000 7fc486763640 1 -- 172.21.15.1:0/3531961383 wait complete. 2023-12-02T01:29:52.376 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-12-02T01:29:52.377 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f75e406af40 msgr2=0x7f75e406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f75e406af40 0x7f75e406d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75f0011dc0 tx=0x7f75f806d030 comp rx=0 tx=0).stop 2023-12-02T01:29:52.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75f003bee0 msgr2=0x7f75f00521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75f003bee0 0x7f75f00521b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75e800c780 tx=0x7f75e800cc40 comp rx=0 tx=0).stop 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 shutdown_connections 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75f00e74e0 0x7f75f00e37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75f0057670 0x7f75f00de2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f75e406af40 0x7f75e406d400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 --2- 172.21.15.1:0/687182014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75f003bee0 0x7f75f00521b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 >> 172.21.15.1:0/687182014 conn(0x7f75f0059090 msgr2=0x7f75f00e06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 shutdown_connections 2023-12-02T01:29:52.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.374+0000 7f75fd0a2640 1 -- 172.21.15.1:0/687182014 wait complete. 2023-12-02T01:29:52.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.378+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb2bc0057d0 con 0x7fb2d40b3760 2023-12-02T01:29:52.380 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.379+0000 7fb2caffd640 1 -- 172.21.15.1:0/479238843 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2d0057980 con 0x7fb2d40b3760 2023-12-02T01:29:52.380 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2023-12-02T01:29:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2b806ae90 msgr2=0x7fb2b806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2b806ae90 0x7fb2b806d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2d409b1e0 tx=0x7fb2cc009040 comp rx=0 tx=0).stop 2023-12-02T01:29:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40b3760 msgr2=0x7fb2d415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40b3760 0x7fb2d415a2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000c820 tx=0x7fb2d000cce0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 shutdown_connections 2023-12-02T01:29:52.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb2b806ae90 0x7fb2b806d350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d40cf670 0x7fb2d40aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d40ce140 0x7fb2d409b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 --2- 172.21.15.1:0/479238843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2d40b3760 0x7fb2d415a2a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 >> 172.21.15.1:0/479238843 conn(0x7fb2d40b0ca0 msgr2=0x7fb2d40cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 shutdown_connections 2023-12-02T01:29:52.385 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.382+0000 7fb2dc63d640 1 -- 172.21.15.1:0/479238843 wait complete. 2023-12-02T01:29:52.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-02T01:29:52.386 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-02T01:29:52.389 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-12-02T01:29:52.395 DEBUG:teuthology.parallel:result is None 2023-12-02T01:29:52.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-02T01:29:52.395 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-02T01:29:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.539+0000 7fed93583640 1 Processor -- start 2023-12-02T01:29:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.540+0000 7fed93583640 1 -- start start 2023-12-02T01:29:52.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.540+0000 7fed93583640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed8c15d3e0 0x7fed8c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.540+0000 7fed93583640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0b5f90 con 0x7fed8c0ced30 2023-12-02T01:29:52.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.540+0000 7fed93583640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0b61e0 con 0x7fed8c0d1e30 2023-12-02T01:29:52.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.540+0000 7fed93583640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0cf170 con 0x7fed8c15d3e0 2023-12-02T01:29:52.548 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed90b1e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fed8c0ced30 0x7fed8c0d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47286/0 (socket says 172.21.15.1:47286) 2023-12-02T01:29:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed90b1e640 1 -- 172.21.15.1:0/1375163212 learned_addr learned my addr 172.21.15.1:0/1375163212 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed9131f640 1 --2- 172.21.15.1:0/1375163212 >> v2:172.21.15.167:3300/0 conn(0x7fed8c15d3e0 0x7fed8c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542568086 0 0) 0x7fed8c0b5f90 con 0x7fed8c0ced30 2023-12-02T01:29:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed74003520 con 0x7fed8c0ced30 2023-12-02T01:29:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 625512774 0 0) 0x7fed74003520 con 0x7fed8c0ced30 2023-12-02T01:29:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 >> v2:172.21.15.167:3300/0 conn(0x7fed8c15d3e0 msgr2=0x7fed8c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:52.549 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 --2- 172.21.15.1:0/1375163212 >> v2:172.21.15.167:3300/0 conn(0x7fed8c15d3e0 0x7fed8c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 >> v1:172.21.15.167:6789/0 conn(0x7fed8c0d1e30 legacy=0x7fed8c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0b64c0 con 0x7fed8c0ced30 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fed80001670 con 0x7fed8c0ced30 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 >> v1:172.21.15.1:6789/0 conn(0x7fed8c0ced30 legacy=0x7fed8c0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74003970 0x7fed74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74005180 0x7fed7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0cf170 con 0x7fed740047c0 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7400c030 con 0x7fed74005180 2023-12-02T01:29:52.550 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7400c1f0 con 0x7fed74003970 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed90b1e640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed91b20640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74005180 0x7fed7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.541+0000 7fed9131f640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74003970 0x7fed74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed90b1e640 1 -- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74003970 msgr2=0x7fed74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed90b1e640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74003970 0x7fed74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed90b1e640 1 -- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74005180 msgr2=0x7fed7400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed90b1e640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74005180 0x7fed7400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.551 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed90b1e640 1 -- 172.21.15.1:0/1375163212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74003520 con 0x7fed740047c0 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed91b20640 1 -- 172.21.15.1:0/1375163212 reap_dead start 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed90b1e640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed74004c40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed8000c240 tx=0x7fed740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c81241552d2788 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80005ad0 con 0x7fed740047c0 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80005c30 con 0x7fed740047c0 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.542+0000 7fed8bfff640 1 -- 172.21.15.1:0/1375163212 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8002caf0 con 0x7fed740047c0 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.543+0000 7fed93583640 1 -- 172.21.15.1:0/1375163212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 msgr2=0x7fed74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.543+0000 7fed93583640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed74004c40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed8000c240 tx=0x7fed740057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.543+0000 7fed93583640 1 -- 172.21.15.1:0/1375163212 shutdown_connections 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.543+0000 7fed93583640 1 --2- 172.21.15.1:0/1375163212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed74004c40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.543+0000 7fed93583640 1 -- 172.21.15.1:0/1375163212 >> 172.21.15.1:0/1375163212 conn(0x7fed8c09c480 msgr2=0x7fed8c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.543+0000 7fed93583640 1 -- 172.21.15.1:0/1375163212 shutdown_connections 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.543+0000 7fed93583640 1 -- 172.21.15.1:0/1375163212 wait complete. 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.544+0000 7fed93583640 1 Processor -- start 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.544+0000 7fed93583640 1 -- start start 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed93583640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed8c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed93583640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8c0cb2f0 0x7fed8c0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed93583640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8c09f3b0 0x7fed8c09f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed93583640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c09fd80 con 0x7fed740047c0 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed93583640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c09cdf0 con 0x7fed8c09f3b0 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed93583640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c151a90 con 0x7fed8c0cb2f0 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed8c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed8c151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59516/0 (socket says 172.21.15.1:59516) 2023-12-02T01:29:52.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 -- 172.21.15.1:0/2782155847 learned_addr learned my addr 172.21.15.1:0/2782155847 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 -- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8c0cb2f0 msgr2=0x7fed8c0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8c0cb2f0 0x7fed8c0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed91b20640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8c09f3b0 0x7fed8c09f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 -- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8c09f3b0 msgr2=0x7fed8c09f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8c09f3b0 0x7fed8c09f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed9131f640 1 -- 172.21.15.1:0/2782155847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0ccaf0 con 0x7fed740047c0 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.545+0000 7fed91b20640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8c09f3b0 0x7fed8c09f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.546+0000 7fed9131f640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed8c151550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed84011a70 tx=0x7fed84011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.546+0000 7fed89ffb640 1 -- 172.21.15.1:0/2782155847 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84009680 con 0x7fed740047c0 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.546+0000 7fed89ffb640 1 -- 172.21.15.1:0/2782155847 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8400fb50 con 0x7fed740047c0 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.546+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c09d090 con 0x7fed740047c0 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.546+0000 7fed89ffb640 1 -- 172.21.15.1:0/2782155847 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400fee0 con 0x7fed740047c0 2023-12-02T01:29:52.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.546+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c09d650 con 0x7fed740047c0 2023-12-02T01:29:52.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.547+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c0ce7f0 con 0x7fed740047c0 2023-12-02T01:29:52.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.547+0000 7fed89ffb640 1 -- 172.21.15.1:0/2782155847 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed84014440 con 0x7fed740047c0 2023-12-02T01:29:52.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.548+0000 7fed89ffb640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fed7806ae40 0x7fed7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.548+0000 7fed89ffb640 1 -- 172.21.15.1:0/2782155847 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed84089f40 con 0x7fed740047c0 2023-12-02T01:29:52.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.548+0000 7fed90b1e640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fed7806ae40 0x7fed7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.548+0000 7fed90b1e640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fed7806ae40 0x7fed7806d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed80034000 tx=0x7fed80039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:52.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.552+0000 7fed89ffb640 1 -- 172.21.15.1:0/2782155847 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed84054ff0 con 0x7fed740047c0 2023-12-02T01:29:52.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.724+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 --> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed8c0b6d60 con 0x7fed7806ae40 2023-12-02T01:29:52.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.730+0000 7fed89ffb640 1 -- 172.21.15.1:0/2782155847 <== mgr.4110 v2:172.21.15.1:6832/1281506213 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264602 (secure 0 0 0) 0x7fed80001430 con 0x7fed7806ae40 2023-12-02T01:29:52.734 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:52.736 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-12-02T01:29:52.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.733+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fed7806ae40 msgr2=0x7fed7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.733+0000 7fed93583640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fed7806ae40 0x7fed7806d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed80034000 tx=0x7fed80039040 comp rx=0 tx=0).stop 2023-12-02T01:29:52.737 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 msgr2=0x7fed8c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed8c151550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed84011a70 tx=0x7fed84011f30 comp rx=0 tx=0).stop 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 shutdown_connections 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fed7806ae40 0x7fed7806d300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed8c09f3b0 0x7fed8c09f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed8c0cb2f0 0x7fed8c0cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 --2- 172.21.15.1:0/2782155847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed740047c0 0x7fed8c151550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 >> 172.21.15.1:0/2782155847 conn(0x7fed8c09c480 msgr2=0x7fed8c06b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 shutdown_connections 2023-12-02T01:29:52.738 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.734+0000 7fed93583640 1 -- 172.21.15.1:0/2782155847 wait complete. 2023-12-02T01:29:52.746 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-02T01:29:52.634280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235668,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001931"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812463+0000","last_change":"2023-12-02T01:29:45.289065+0000","last_active":"2023-12-02T01:29:46.812463+0000","last_peered":"2023-12-02T01:29:46.812463+0000","last_clean":"2023-12-02T01:29:46.812463+0000","last_became_active":"2023-12-02T01:29:45.288799+0000","last_became_peered":"2023-12-02T01:29:45.288799+0000","last_unstale":"2023-12-02T01:29:46.812463+0000","last_undegraded":"2023-12-02T01:29:46.812463+0000","last_fullsized":"2023-12-02T01:29:46.812463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:36:04.474471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278772+0000","last_change":"2023-12-02T01:29:45.287280+0000","last_active":"2023-12-02T01:29:46.278772+0000","last_peered":"2023-12-02T01:29:46.278772+0000","last_clean":"2023-12-02T01:29:46.278772+0000","last_became_active":"2023-12-02T01:29:45.286996+0000","last_became_peered":"2023-12-02T01:29:45.286996+0000","last_unstale":"2023-12-02T01:29:46.278772+0000","last_undegraded":"2023-12-02T01:29:46.278772+0000","last_fullsized":"2023-12-02T01:29:46.278772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504640+0000","last_change":"2023-12-02T01:29:45.281765+0000","last_active":"2023-12-02T01:29:46.504640+0000","last_peered":"2023-12-02T01:29:46.504640+0000","last_clean":"2023-12-02T01:29:46.504640+0000","last_became_active":"2023-12-02T01:29:45.281451+0000","last_became_peered":"2023-12-02T01:29:45.281451+0000","last_unstale":"2023-12-02T01:29:46.504640+0000","last_undegraded":"2023-12-02T01:29:46.504640+0000","last_fullsized":"2023-12-02T01:29:46.504640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862929+0000","last_change":"2023-12-02T01:29:45.297982+0000","last_active":"2023-12-02T01:29:46.862929+0000","last_peered":"2023-12-02T01:29:46.862929+0000","last_clean":"2023-12-02T01:29:46.862929+0000","last_became_active":"2023-12-02T01:29:45.297711+0000","last_became_peered":"2023-12-02T01:29:45.297711+0000","last_unstale":"2023-12-02T01:29:46.862929+0000","last_undegraded":"2023-12-02T01:29:46.862929+0000","last_fullsized":"2023-12-02T01:29:46.862929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:21:01.551671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812058+0000","last_change":"2023-12-02T01:29:45.293266+0000","last_active":"2023-12-02T01:29:46.812058+0000","last_peered":"2023-12-02T01:29:46.812058+0000","last_clean":"2023-12-02T01:29:46.812058+0000","last_became_active":"2023-12-02T01:29:45.292952+0000","last_became_peered":"2023-12-02T01:29:45.292952+0000","last_unstale":"2023-12-02T01:29:46.812058+0000","last_undegraded":"2023-12-02T01:29:46.812058+0000","last_fullsized":"2023-12-02T01:29:46.812058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:21:01.551671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862416+0000","last_change":"2023-12-02T01:29:45.296193+0000","last_active":"2023-12-02T01:29:46.862416+0000","last_peered":"2023-12-02T01:29:46.862416+0000","last_clean":"2023-12-02T01:29:46.862416+0000","last_became_active":"2023-12-02T01:29:45.295761+0000","last_became_peered":"2023-12-02T01:29:45.295761+0000","last_unstale":"2023-12-02T01:29:46.862416+0000","last_undegraded":"2023-12-02T01:29:46.862416+0000","last_fullsized":"2023-12-02T01:29:46.862416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.811940+0000","last_change":"2023-12-02T01:29:45.291904+0000","last_active":"2023-12-02T01:29:46.811940+0000","last_peered":"2023-12-02T01:29:46.811940+0000","last_clean":"2023-12-02T01:29:46.811940+0000","last_became_active":"2023-12-02T01:29:45.291616+0000","last_became_peered":"2023-12-02T01:29:45.291616+0000","last_unstale":"2023-12-02T01:29:46.811940+0000","last_undegraded":"2023-12-02T01:29:46.811940+0000","last_fullsized":"2023-12-02T01:29:46.811940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861779+0000","last_change":"2023-12-02T01:29:45.296142+0000","last_active":"2023-12-02T01:29:46.861779+0000","last_peered":"2023-12-02T01:29:46.861779+0000","last_clean":"2023-12-02T01:29:46.861779+0000","last_became_active":"2023-12-02T01:29:45.295778+0000","last_became_peered":"2023-12-02T01:29:45.295778+0000","last_unstale":"2023-12-02T01:29:46.861779+0000","last_undegraded":"2023-12-02T01:29:46.861779+0000","last_fullsized":"2023-12-02T01:29:46.861779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:29.267506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812467+0000","last_change":"2023-12-02T01:29:45.299688+0000","last_active":"2023-12-02T01:29:46.812467+0000","last_peered":"2023-12-02T01:29:46.812467+0000","last_clean":"2023-12-02T01:29:46.812467+0000","last_became_active":"2023-12-02T01:29:45.299362+0000","last_became_peered":"2023-12-02T01:29:45.299362+0000","last_unstale":"2023-12-02T01:29:46.812467+0000","last_undegraded":"2023-12-02T01:29:46.812467+0000","last_fullsized":"2023-12-02T01:29:46.812467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:13:58.565887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862789+0000","last_change":"2023-12-02T01:29:45.294653+0000","last_active":"2023-12-02T01:29:46.862789+0000","last_peered":"2023-12-02T01:29:46.862789+0000","last_clean":"2023-12-02T01:29:46.862789+0000","last_became_active":"2023-12-02T01:29:45.294403+0000","last_became_peered":"2023-12-02T01:29:45.294403+0000","last_unstale":"2023-12-02T01:29:46.862789+0000","last_undegraded":"2023-12-02T01:29:46.862789+0000","last_fullsized":"2023-12-02T01:29:46.862789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862586+0000","last_change":"2023-12-02T01:29:45.296336+0000","last_active":"2023-12-02T01:29:46.862586+0000","last_peered":"2023-12-02T01:29:46.862586+0000","last_clean":"2023-12-02T01:29:46.862586+0000","last_became_active":"2023-12-02T01:29:45.296065+0000","last_became_peered":"2023-12-02T01:29:45.296065+0000","last_unstale":"2023-12-02T01:29:46.862586+0000","last_undegraded":"2023-12-02T01:29:46.862586+0000","last_fullsized":"2023-12-02T01:29:46.862586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279488+0000","last_change":"2023-12-02T01:29:45.289558+0000","last_active":"2023-12-02T01:29:46.279488+0000","last_peered":"2023-12-02T01:29:46.279488+0000","last_clean":"2023-12-02T01:29:46.279488+0000","last_became_active":"2023-12-02T01:29:45.289116+0000","last_became_peered":"2023-12-02T01:29:45.289116+0000","last_unstale":"2023-12-02T01:29:46.279488+0000","last_undegraded":"2023-12-02T01:29:46.279488+0000","last_fullsized":"2023-12-02T01:29:46.279488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:28.529390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862143+0000","last_change":"2023-12-02T01:29:45.288300+0000","last_active":"2023-12-02T01:29:46.862143+0000","last_peered":"2023-12-02T01:29:46.862143+0000","last_clean":"2023-12-02T01:29:46.862143+0000","last_became_active":"2023-12-02T01:29:45.288019+0000","last_became_peered":"2023-12-02T01:29:45.288019+0000","last_unstale":"2023-12-02T01:29:46.862143+0000","last_undegraded":"2023-12-02T01:29:46.862143+0000","last_fullsized":"2023-12-02T01:29:46.862143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504355+0000","last_change":"2023-12-02T01:29:45.288371+0000","last_active":"2023-12-02T01:29:46.504355+0000","last_peered":"2023-12-02T01:29:46.504355+0000","last_clean":"2023-12-02T01:29:46.504355+0000","last_became_active":"2023-12-02T01:29:45.288048+0000","last_became_peered":"2023-12-02T01:29:45.288048+0000","last_unstale":"2023-12-02T01:29:46.504355+0000","last_undegraded":"2023-12-02T01:29:46.504355+0000","last_fullsized":"2023-12-02T01:29:46.504355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278590+0000","last_change":"2023-12-02T01:29:45.297919+0000","last_active":"2023-12-02T01:29:46.278590+0000","last_peered":"2023-12-02T01:29:46.278590+0000","last_clean":"2023-12-02T01:29:46.278590+0000","last_became_active":"2023-12-02T01:29:45.297629+0000","last_became_peered":"2023-12-02T01:29:45.297629+0000","last_unstale":"2023-12-02T01:29:46.278590+0000","last_undegraded":"2023-12-02T01:29:46.278590+0000","last_fullsized":"2023-12-02T01:29:46.278590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862149+0000","last_change":"2023-12-02T01:29:45.291354+0000","last_active":"2023-12-02T01:29:46.862149+0000","last_peered":"2023-12-02T01:29:46.862149+0000","last_clean":"2023-12-02T01:29:46.862149+0000","last_became_active":"2023-12-02T01:29:45.290958+0000","last_became_peered":"2023-12-02T01:29:45.290958+0000","last_unstale":"2023-12-02T01:29:46.862149+0000","last_undegraded":"2023-12-02T01:29:46.862149+0000","last_fullsized":"2023-12-02T01:29:46.862149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863341+0000","last_change":"2023-12-02T01:29:45.299054+0000","last_active":"2023-12-02T01:29:46.863341+0000","last_peered":"2023-12-02T01:29:46.863341+0000","last_clean":"2023-12-02T01:29:46.863341+0000","last_became_active":"2023-12-02T01:29:45.298788+0000","last_became_peered":"2023-12-02T01:29:45.298788+0000","last_unstale":"2023-12-02T01:29:46.863341+0000","last_undegraded":"2023-12-02T01:29:46.863341+0000","last_fullsized":"2023-12-02T01:29:46.863341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:13:58.565887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277543+0000","last_change":"2023-12-02T01:29:45.285978+0000","last_active":"2023-12-02T01:29:46.277543+0000","last_peered":"2023-12-02T01:29:46.277543+0000","last_clean":"2023-12-02T01:29:46.277543+0000","last_became_active":"2023-12-02T01:29:45.285621+0000","last_became_peered":"2023-12-02T01:29:45.285621+0000","last_unstale":"2023-12-02T01:29:46.277543+0000","last_undegraded":"2023-12-02T01:29:46.277543+0000","last_fullsized":"2023-12-02T01:29:46.277543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:15.348786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812431+0000","last_change":"2023-12-02T01:29:45.293553+0000","last_active":"2023-12-02T01:29:46.812431+0000","last_peered":"2023-12-02T01:29:46.812431+0000","last_clean":"2023-12-02T01:29:46.812431+0000","last_became_active":"2023-12-02T01:29:45.292966+0000","last_became_peered":"2023-12-02T01:29:45.292966+0000","last_unstale":"2023-12-02T01:29:46.812431+0000","last_undegraded":"2023-12-02T01:29:46.812431+0000","last_fullsized":"2023-12-02T01:29:46.812431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:01:53.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862689+0000","last_change":"2023-12-02T01:29:45.291596+0000","last_active":"2023-12-02T01:29:46.862689+0000","last_peered":"2023-12-02T01:29:46.862689+0000","last_clean":"2023-12-02T01:29:46.862689+0000","last_became_active":"2023-12-02T01:29:45.291340+0000","last_became_peered":"2023-12-02T01:29:45.291340+0000","last_unstale":"2023-12-02T01:29:46.862689+0000","last_undegraded":"2023-12-02T01:29:46.862689+0000","last_fullsized":"2023-12-02T01:29:46.862689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504467+0000","last_change":"2023-12-02T01:29:45.289467+0000","last_active":"2023-12-02T01:29:46.504467+0000","last_peered":"2023-12-02T01:29:46.504467+0000","last_clean":"2023-12-02T01:29:46.504467+0000","last_became_active":"2023-12-02T01:29:45.289182+0000","last_became_peered":"2023-12-02T01:29:45.289182+0000","last_unstale":"2023-12-02T01:29:46.504467+0000","last_undegraded":"2023-12-02T01:29:46.504467+0000","last_fullsized":"2023-12-02T01:29:46.504467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862498+0000","last_change":"2023-12-02T01:29:45.300021+0000","last_active":"2023-12-02T01:29:46.862498+0000","last_peered":"2023-12-02T01:29:46.862498+0000","last_clean":"2023-12-02T01:29:46.862498+0000","last_became_active":"2023-12-02T01:29:45.299751+0000","last_became_peered":"2023-12-02T01:29:45.299751+0000","last_unstale":"2023-12-02T01:29:46.862498+0000","last_undegraded":"2023-12-02T01:29:46.862498+0000","last_fullsized":"2023-12-02T01:29:46.862498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861844+0000","last_change":"2023-12-02T01:29:45.292603+0000","last_active":"2023-12-02T01:29:46.861844+0000","last_peered":"2023-12-02T01:29:46.861844+0000","last_clean":"2023-12-02T01:29:46.861844+0000","last_became_active":"2023-12-02T01:29:45.292325+0000","last_became_peered":"2023-12-02T01:29:45.292325+0000","last_unstale":"2023-12-02T01:29:46.861844+0000","last_undegraded":"2023-12-02T01:29:46.861844+0000","last_fullsized":"2023-12-02T01:29:46.861844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862254+0000","last_change":"2023-12-02T01:29:45.294653+0000","last_active":"2023-12-02T01:29:46.862254+0000","last_peered":"2023-12-02T01:29:46.862254+0000","last_clean":"2023-12-02T01:29:46.862254+0000","last_became_active":"2023-12-02T01:29:45.294371+0000","last_became_peered":"2023-12-02T01:29:45.294371+0000","last_unstale":"2023-12-02T01:29:46.862254+0000","last_undegraded":"2023-12-02T01:29:46.862254+0000","last_fullsized":"2023-12-02T01:29:46.862254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862338+0000","last_change":"2023-12-02T01:29:45.292542+0000","last_active":"2023-12-02T01:29:46.862338+0000","last_peered":"2023-12-02T01:29:46.862338+0000","last_clean":"2023-12-02T01:29:46.862338+0000","last_became_active":"2023-12-02T01:29:45.292250+0000","last_became_peered":"2023-12-02T01:29:45.292250+0000","last_unstale":"2023-12-02T01:29:46.862338+0000","last_undegraded":"2023-12-02T01:29:46.862338+0000","last_fullsized":"2023-12-02T01:29:46.862338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862942+0000","last_change":"2023-12-02T01:29:45.290121+0000","last_active":"2023-12-02T01:29:46.862942+0000","last_peered":"2023-12-02T01:29:46.862942+0000","last_clean":"2023-12-02T01:29:46.862942+0000","last_became_active":"2023-12-02T01:29:45.289862+0000","last_became_peered":"2023-12-02T01:29:45.289862+0000","last_unstale":"2023-12-02T01:29:46.862942+0000","last_undegraded":"2023-12-02T01:29:46.862942+0000","last_fullsized":"2023-12-02T01:29:46.862942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278875+0000","last_change":"2023-12-02T01:29:45.295312+0000","last_active":"2023-12-02T01:29:46.278875+0000","last_peered":"2023-12-02T01:29:46.278875+0000","last_clean":"2023-12-02T01:29:46.278875+0000","last_became_active":"2023-12-02T01:29:45.295007+0000","last_became_peered":"2023-12-02T01:29:45.295007+0000","last_unstale":"2023-12-02T01:29:46.278875+0000","last_undegraded":"2023-12-02T01:29:46.278875+0000","last_fullsized":"2023-12-02T01:29:46.278875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862182+0000","last_change":"2023-12-02T01:29:45.294208+0000","last_active":"2023-12-02T01:29:46.862182+0000","last_peered":"2023-12-02T01:29:46.862182+0000","last_clean":"2023-12-02T01:29:46.862182+0000","last_became_active":"2023-12-02T01:29:45.293819+0000","last_became_peered":"2023-12-02T01:29:45.293819+0000","last_unstale":"2023-12-02T01:29:46.862182+0000","last_undegraded":"2023-12-02T01:29:46.862182+0000","last_fullsized":"2023-12-02T01:29:46.862182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504519+0000","last_change":"2023-12-02T01:29:45.293594+0000","last_active":"2023-12-02T01:29:46.504519+0000","last_peered":"2023-12-02T01:29:46.504519+0000","last_clean":"2023-12-02T01:29:46.504519+0000","last_became_active":"2023-12-02T01:29:45.293292+0000","last_became_peered":"2023-12-02T01:29:45.293292+0000","last_unstale":"2023-12-02T01:29:46.504519+0000","last_undegraded":"2023-12-02T01:29:46.504519+0000","last_fullsized":"2023-12-02T01:29:46.504519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862565+0000","last_change":"2023-12-02T01:29:45.293967+0000","last_active":"2023-12-02T01:29:46.862565+0000","last_peered":"2023-12-02T01:29:46.862565+0000","last_clean":"2023-12-02T01:29:46.862565+0000","last_became_active":"2023-12-02T01:29:45.293685+0000","last_became_peered":"2023-12-02T01:29:45.293685+0000","last_unstale":"2023-12-02T01:29:46.862565+0000","last_undegraded":"2023-12-02T01:29:46.862565+0000","last_fullsized":"2023-12-02T01:29:46.862565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277375+0000","last_change":"2023-12-02T01:29:45.286671+0000","last_active":"2023-12-02T01:29:46.277375+0000","last_peered":"2023-12-02T01:29:46.277375+0000","last_clean":"2023-12-02T01:29:46.277375+0000","last_became_active":"2023-12-02T01:29:45.286387+0000","last_became_peered":"2023-12-02T01:29:45.286387+0000","last_unstale":"2023-12-02T01:29:46.277375+0000","last_undegraded":"2023-12-02T01:29:46.277375+0000","last_fullsized":"2023-12-02T01:29:46.277375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862239+0000","last_change":"2023-12-02T01:29:45.287262+0000","last_active":"2023-12-02T01:29:46.862239+0000","last_peered":"2023-12-02T01:29:46.862239+0000","last_clean":"2023-12-02T01:29:46.862239+0000","last_became_active":"2023-12-02T01:29:45.286609+0000","last_became_peered":"2023-12-02T01:29:45.286609+0000","last_unstale":"2023-12-02T01:29:46.862239+0000","last_undegraded":"2023-12-02T01:29:46.862239+0000","last_fullsized":"2023-12-02T01:29:46.862239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279008+0000","last_change":"2023-12-02T01:29:45.290257+0000","last_active":"2023-12-02T01:29:46.279008+0000","last_peered":"2023-12-02T01:29:46.279008+0000","last_clean":"2023-12-02T01:29:46.279008+0000","last_became_active":"2023-12-02T01:29:45.289574+0000","last_became_peered":"2023-12-02T01:29:45.289574+0000","last_unstale":"2023-12-02T01:29:46.279008+0000","last_undegraded":"2023-12-02T01:29:46.279008+0000","last_fullsized":"2023-12-02T01:29:46.279008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:55.160149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.657985+0000","last_change":"2023-12-02T01:29:44.349543+0000","last_active":"2023-12-02T01:29:46.657985+0000","last_peered":"2023-12-02T01:29:46.657985+0000","last_clean":"2023-12-02T01:29:46.657985+0000","last_became_active":"2023-12-02T01:29:44.349239+0000","last_became_peered":"2023-12-02T01:29:44.349239+0000","last_unstale":"2023-12-02T01:29:46.657985+0000","last_undegraded":"2023-12-02T01:29:46.657985+0000","last_fullsized":"2023-12-02T01:29:46.657985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504676+0000","last_change":"2023-12-02T01:29:45.290443+0000","last_active":"2023-12-02T01:29:46.504676+0000","last_peered":"2023-12-02T01:29:46.504676+0000","last_clean":"2023-12-02T01:29:46.504676+0000","last_became_active":"2023-12-02T01:29:45.290132+0000","last_became_peered":"2023-12-02T01:29:45.290132+0000","last_unstale":"2023-12-02T01:29:46.504676+0000","last_undegraded":"2023-12-02T01:29:46.504676+0000","last_fullsized":"2023-12-02T01:29:46.504676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651553+0000","last_change":"2023-12-02T01:29:44.347904+0000","last_active":"2023-12-02T01:29:46.651553+0000","last_peered":"2023-12-02T01:29:46.651553+0000","last_clean":"2023-12-02T01:29:46.651553+0000","last_became_active":"2023-12-02T01:29:44.347621+0000","last_became_peered":"2023-12-02T01:29:44.347621+0000","last_unstale":"2023-12-02T01:29:46.651553+0000","last_undegraded":"2023-12-02T01:29:46.651553+0000","last_fullsized":"2023-12-02T01:29:46.651553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:28.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.657929+0000","last_change":"2023-12-02T01:29:44.347813+0000","last_active":"2023-12-02T01:29:46.657929+0000","last_peered":"2023-12-02T01:29:46.657929+0000","last_clean":"2023-12-02T01:29:46.657929+0000","last_became_active":"2023-12-02T01:29:44.347529+0000","last_became_peered":"2023-12-02T01:29:44.347529+0000","last_unstale":"2023-12-02T01:29:46.657929+0000","last_undegraded":"2023-12-02T01:29:46.657929+0000","last_fullsized":"2023-12-02T01:29:46.657929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861829+0000","last_change":"2023-12-02T01:29:45.291020+0000","last_active":"2023-12-02T01:29:46.861829+0000","last_peered":"2023-12-02T01:29:46.861829+0000","last_clean":"2023-12-02T01:29:46.861829+0000","last_became_active":"2023-12-02T01:29:45.290736+0000","last_became_peered":"2023-12-02T01:29:45.290736+0000","last_unstale":"2023-12-02T01:29:46.861829+0000","last_undegraded":"2023-12-02T01:29:46.861829+0000","last_fullsized":"2023-12-02T01:29:46.861829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:07.658204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.653948+0000","last_change":"2023-12-02T01:29:44.345129+0000","last_active":"2023-12-02T01:29:46.653948+0000","last_peered":"2023-12-02T01:29:46.653948+0000","last_clean":"2023-12-02T01:29:46.653948+0000","last_became_active":"2023-12-02T01:29:44.344808+0000","last_became_peered":"2023-12-02T01:29:44.344808+0000","last_unstale":"2023-12-02T01:29:46.653948+0000","last_undegraded":"2023-12-02T01:29:46.653948+0000","last_fullsized":"2023-12-02T01:29:46.653948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278811+0000","last_change":"2023-12-02T01:29:45.294374+0000","last_active":"2023-12-02T01:29:46.278811+0000","last_peered":"2023-12-02T01:29:46.278811+0000","last_clean":"2023-12-02T01:29:46.278811+0000","last_became_active":"2023-12-02T01:29:45.294104+0000","last_became_peered":"2023-12-02T01:29:45.294104+0000","last_unstale":"2023-12-02T01:29:46.278811+0000","last_undegraded":"2023-12-02T01:29:46.278811+0000","last_fullsized":"2023-12-02T01:29:46.278811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651627+0000","last_change":"2023-12-02T01:29:44.350703+0000","last_active":"2023-12-02T01:29:46.651627+0000","last_peered":"2023-12-02T01:29:46.651627+0000","last_clean":"2023-12-02T01:29:46.651627+0000","last_became_active":"2023-12-02T01:29:44.350399+0000","last_became_peered":"2023-12-02T01:29:44.350399+0000","last_unstale":"2023-12-02T01:29:46.651627+0000","last_undegraded":"2023-12-02T01:29:46.651627+0000","last_fullsized":"2023-12-02T01:29:46.651627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:01.723991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863127+0000","last_change":"2023-12-02T01:29:45.294483+0000","last_active":"2023-12-02T01:29:46.863127+0000","last_peered":"2023-12-02T01:29:46.863127+0000","last_clean":"2023-12-02T01:29:46.863127+0000","last_became_active":"2023-12-02T01:29:45.294221+0000","last_became_peered":"2023-12-02T01:29:45.294221+0000","last_unstale":"2023-12-02T01:29:46.863127+0000","last_undegraded":"2023-12-02T01:29:46.863127+0000","last_fullsized":"2023-12-02T01:29:46.863127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:29:54.906793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654232+0000","last_change":"2023-12-02T01:29:44.348206+0000","last_active":"2023-12-02T01:29:46.654232+0000","last_peered":"2023-12-02T01:29:46.654232+0000","last_clean":"2023-12-02T01:29:46.654232+0000","last_became_active":"2023-12-02T01:29:44.347824+0000","last_became_peered":"2023-12-02T01:29:44.347824+0000","last_unstale":"2023-12-02T01:29:46.654232+0000","last_undegraded":"2023-12-02T01:29:46.654232+0000","last_fullsized":"2023-12-02T01:29:46.654232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504691+0000","last_change":"2023-12-02T01:29:45.290778+0000","last_active":"2023-12-02T01:29:46.504691+0000","last_peered":"2023-12-02T01:29:46.504691+0000","last_clean":"2023-12-02T01:29:46.504691+0000","last_became_active":"2023-12-02T01:29:45.290465+0000","last_became_peered":"2023-12-02T01:29:45.290465+0000","last_unstale":"2023-12-02T01:29:46.504691+0000","last_undegraded":"2023-12-02T01:29:46.504691+0000","last_fullsized":"2023-12-02T01:29:46.504691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278661+0000","last_change":"2023-12-02T01:29:44.354772+0000","last_active":"2023-12-02T01:29:46.278661+0000","last_peered":"2023-12-02T01:29:46.278661+0000","last_clean":"2023-12-02T01:29:46.278661+0000","last_became_active":"2023-12-02T01:29:44.354324+0000","last_became_peered":"2023-12-02T01:29:44.354324+0000","last_unstale":"2023-12-02T01:29:46.278661+0000","last_undegraded":"2023-12-02T01:29:46.278661+0000","last_fullsized":"2023-12-02T01:29:46.278661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:13.495997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279468+0000","last_change":"2023-12-02T01:29:45.290328+0000","last_active":"2023-12-02T01:29:46.279468+0000","last_peered":"2023-12-02T01:29:46.279468+0000","last_clean":"2023-12-02T01:29:46.279468+0000","last_became_active":"2023-12-02T01:29:45.290057+0000","last_became_peered":"2023-12-02T01:29:45.290057+0000","last_unstale":"2023-12-02T01:29:46.279468+0000","last_undegraded":"2023-12-02T01:29:46.279468+0000","last_fullsized":"2023-12-02T01:29:46.279468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:21.086467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651577+0000","last_change":"2023-12-02T01:29:44.349532+0000","last_active":"2023-12-02T01:29:46.651577+0000","last_peered":"2023-12-02T01:29:46.651577+0000","last_clean":"2023-12-02T01:29:46.651577+0000","last_became_active":"2023-12-02T01:29:44.349218+0000","last_became_peered":"2023-12-02T01:29:44.349218+0000","last_unstale":"2023-12-02T01:29:46.651577+0000","last_undegraded":"2023-12-02T01:29:46.651577+0000","last_fullsized":"2023-12-02T01:29:46.651577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:06.651434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812215+0000","last_change":"2023-12-02T01:29:45.293735+0000","last_active":"2023-12-02T01:29:46.812215+0000","last_peered":"2023-12-02T01:29:46.812215+0000","last_clean":"2023-12-02T01:29:46.812215+0000","last_became_active":"2023-12-02T01:29:45.293291+0000","last_became_peered":"2023-12-02T01:29:45.293291+0000","last_unstale":"2023-12-02T01:29:46.812215+0000","last_undegraded":"2023-12-02T01:29:46.812215+0000","last_fullsized":"2023-12-02T01:29:46.812215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:29:54.906793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504662+0000","last_change":"2023-12-02T01:29:44.354982+0000","last_active":"2023-12-02T01:29:46.504662+0000","last_peered":"2023-12-02T01:29:46.504662+0000","last_clean":"2023-12-02T01:29:46.504662+0000","last_became_active":"2023-12-02T01:29:44.354668+0000","last_became_peered":"2023-12-02T01:29:44.354668+0000","last_unstale":"2023-12-02T01:29:46.504662+0000","last_undegraded":"2023-12-02T01:29:46.504662+0000","last_fullsized":"2023-12-02T01:29:46.504662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504397+0000","last_change":"2023-12-02T01:29:45.288825+0000","last_active":"2023-12-02T01:29:46.504397+0000","last_peered":"2023-12-02T01:29:46.504397+0000","last_clean":"2023-12-02T01:29:46.504397+0000","last_became_active":"2023-12-02T01:29:45.288301+0000","last_became_peered":"2023-12-02T01:29:45.288301+0000","last_unstale":"2023-12-02T01:29:46.504397+0000","last_undegraded":"2023-12-02T01:29:46.504397+0000","last_fullsized":"2023-12-02T01:29:46.504397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654040+0000","last_change":"2023-12-02T01:29:44.351474+0000","last_active":"2023-12-02T01:29:46.654040+0000","last_peered":"2023-12-02T01:29:46.654040+0000","last_clean":"2023-12-02T01:29:46.654040+0000","last_became_active":"2023-12-02T01:29:44.351168+0000","last_became_peered":"2023-12-02T01:29:44.351168+0000","last_unstale":"2023-12-02T01:29:46.654040+0000","last_undegraded":"2023-12-02T01:29:46.654040+0000","last_fullsized":"2023-12-02T01:29:46.654040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:27.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812094+0000","last_change":"2023-12-02T01:29:45.297986+0000","last_active":"2023-12-02T01:29:46.812094+0000","last_peered":"2023-12-02T01:29:46.812094+0000","last_clean":"2023-12-02T01:29:46.812094+0000","last_became_active":"2023-12-02T01:29:45.297733+0000","last_became_peered":"2023-12-02T01:29:45.297733+0000","last_unstale":"2023-12-02T01:29:46.812094+0000","last_undegraded":"2023-12-02T01:29:46.812094+0000","last_fullsized":"2023-12-02T01:29:46.812094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:42:36.390155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651523+0000","last_change":"2023-12-02T01:29:44.347247+0000","last_active":"2023-12-02T01:29:46.651523+0000","last_peered":"2023-12-02T01:29:46.651523+0000","last_clean":"2023-12-02T01:29:46.651523+0000","last_became_active":"2023-12-02T01:29:44.346905+0000","last_became_peered":"2023-12-02T01:29:44.346905+0000","last_unstale":"2023-12-02T01:29:46.651523+0000","last_undegraded":"2023-12-02T01:29:46.651523+0000","last_fullsized":"2023-12-02T01:29:46.651523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862358+0000","last_change":"2023-12-02T01:29:45.287422+0000","last_active":"2023-12-02T01:29:46.862358+0000","last_peered":"2023-12-02T01:29:46.862358+0000","last_clean":"2023-12-02T01:29:46.862358+0000","last_became_active":"2023-12-02T01:29:45.286995+0000","last_became_peered":"2023-12-02T01:29:45.286995+0000","last_unstale":"2023-12-02T01:29:46.862358+0000","last_undegraded":"2023-12-02T01:29:46.862358+0000","last_fullsized":"2023-12-02T01:29:46.862358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277352+0000","last_change":"2023-12-02T01:29:44.348128+0000","last_active":"2023-12-02T01:29:46.277352+0000","last_peered":"2023-12-02T01:29:46.277352+0000","last_clean":"2023-12-02T01:29:46.277352+0000","last_became_active":"2023-12-02T01:29:44.347814+0000","last_became_peered":"2023-12-02T01:29:44.347814+0000","last_unstale":"2023-12-02T01:29:46.277352+0000","last_undegraded":"2023-12-02T01:29:46.277352+0000","last_fullsized":"2023-12-02T01:29:46.277352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.811993+0000","last_change":"2023-12-02T01:29:45.297889+0000","last_active":"2023-12-02T01:29:46.811993+0000","last_peered":"2023-12-02T01:29:46.811993+0000","last_clean":"2023-12-02T01:29:46.811993+0000","last_became_active":"2023-12-02T01:29:45.297639+0000","last_became_peered":"2023-12-02T01:29:45.297639+0000","last_unstale":"2023-12-02T01:29:46.811993+0000","last_undegraded":"2023-12-02T01:29:46.811993+0000","last_fullsized":"2023-12-02T01:29:46.811993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279286+0000","last_change":"2023-12-02T01:29:44.348659+0000","last_active":"2023-12-02T01:29:46.279286+0000","last_peered":"2023-12-02T01:29:46.279286+0000","last_clean":"2023-12-02T01:29:46.279286+0000","last_became_active":"2023-12-02T01:29:44.348107+0000","last_became_peered":"2023-12-02T01:29:44.348107+0000","last_unstale":"2023-12-02T01:29:46.279286+0000","last_undegraded":"2023-12-02T01:29:46.279286+0000","last_fullsized":"2023-12-02T01:29:46.279286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812370+0000","last_change":"2023-12-02T01:29:45.296461+0000","last_active":"2023-12-02T01:29:46.812370+0000","last_peered":"2023-12-02T01:29:46.812370+0000","last_clean":"2023-12-02T01:29:46.812370+0000","last_became_active":"2023-12-02T01:29:45.296220+0000","last_became_peered":"2023-12-02T01:29:45.296220+0000","last_unstale":"2023-12-02T01:29:46.812370+0000","last_undegraded":"2023-12-02T01:29:46.812370+0000","last_fullsized":"2023-12-02T01:29:46.812370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:43.782344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277634+0000","last_change":"2023-12-02T01:29:44.349307+0000","last_active":"2023-12-02T01:29:46.277634+0000","last_peered":"2023-12-02T01:29:46.277634+0000","last_clean":"2023-12-02T01:29:46.277634+0000","last_became_active":"2023-12-02T01:29:44.349025+0000","last_became_peered":"2023-12-02T01:29:44.349025+0000","last_unstale":"2023-12-02T01:29:46.277634+0000","last_undegraded":"2023-12-02T01:29:46.277634+0000","last_fullsized":"2023-12-02T01:29:46.277634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:54.153379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812564+0000","last_change":"2023-12-02T01:29:45.297278+0000","last_active":"2023-12-02T01:29:46.812564+0000","last_peered":"2023-12-02T01:29:46.812564+0000","last_clean":"2023-12-02T01:29:46.812564+0000","last_became_active":"2023-12-02T01:29:45.297012+0000","last_became_peered":"2023-12-02T01:29:45.297012+0000","last_unstale":"2023-12-02T01:29:46.812564+0000","last_undegraded":"2023-12-02T01:29:46.812564+0000","last_fullsized":"2023-12-02T01:29:46.812564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:57:41.631704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278766+0000","last_change":"2023-12-02T01:29:44.350480+0000","last_active":"2023-12-02T01:29:46.278766+0000","last_peered":"2023-12-02T01:29:46.278766+0000","last_clean":"2023-12-02T01:29:46.278766+0000","last_became_active":"2023-12-02T01:29:44.350151+0000","last_became_peered":"2023-12-02T01:29:44.350151+0000","last_unstale":"2023-12-02T01:29:46.278766+0000","last_undegraded":"2023-12-02T01:29:46.278766+0000","last_fullsized":"2023-12-02T01:29:46.278766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863103+0000","last_change":"2023-12-02T01:29:45.295690+0000","last_active":"2023-12-02T01:29:46.863103+0000","last_peered":"2023-12-02T01:29:46.863103+0000","last_clean":"2023-12-02T01:29:46.863103+0000","last_became_active":"2023-12-02T01:29:45.295369+0000","last_became_peered":"2023-12-02T01:29:45.295369+0000","last_unstale":"2023-12-02T01:29:46.863103+0000","last_undegraded":"2023-12-02T01:29:46.863103+0000","last_fullsized":"2023-12-02T01:29:46.863103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:40:06.285555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277571+0000","last_change":"2023-12-02T01:29:44.345332+0000","last_active":"2023-12-02T01:29:46.277571+0000","last_peered":"2023-12-02T01:29:46.277571+0000","last_clean":"2023-12-02T01:29:46.277571+0000","last_became_active":"2023-12-02T01:29:44.344979+0000","last_became_peered":"2023-12-02T01:29:44.344979+0000","last_unstale":"2023-12-02T01:29:46.277571+0000","last_undegraded":"2023-12-02T01:29:46.277571+0000","last_fullsized":"2023-12-02T01:29:46.277571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:56:20.601142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812247+0000","last_change":"2023-12-02T01:29:45.298734+0000","last_active":"2023-12-02T01:29:46.812247+0000","last_peered":"2023-12-02T01:29:46.812247+0000","last_clean":"2023-12-02T01:29:46.812247+0000","last_became_active":"2023-12-02T01:29:45.298413+0000","last_became_peered":"2023-12-02T01:29:45.298413+0000","last_unstale":"2023-12-02T01:29:46.812247+0000","last_undegraded":"2023-12-02T01:29:46.812247+0000","last_fullsized":"2023-12-02T01:29:46.812247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:40:06.285555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.281966+0000","last_change":"2023-12-02T01:29:33.915833+0000","last_active":"2023-12-02T01:29:45.281966+0000","last_peered":"2023-12-02T01:29:45.281966+0000","last_clean":"2023-12-02T01:29:45.281966+0000","last_became_active":"2023-12-02T01:29:33.915012+0000","last_became_peered":"2023-12-02T01:29:33.915012+0000","last_unstale":"2023-12-02T01:29:45.281966+0000","last_undegraded":"2023-12-02T01:29:45.281966+0000","last_fullsized":"2023-12-02T01:29:45.281966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_clean_scrub_stamp":"2023-12-02T01:29:32.688531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:25:40.082821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654093+0000","last_change":"2023-12-02T01:29:44.348495+0000","last_active":"2023-12-02T01:29:46.654093+0000","last_peered":"2023-12-02T01:29:46.654093+0000","last_clean":"2023-12-02T01:29:46.654093+0000","last_became_active":"2023-12-02T01:29:44.347921+0000","last_became_peered":"2023-12-02T01:29:44.347921+0000","last_unstale":"2023-12-02T01:29:46.654093+0000","last_undegraded":"2023-12-02T01:29:46.654093+0000","last_fullsized":"2023-12-02T01:29:46.654093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862033+0000","last_change":"2023-12-02T01:29:45.298682+0000","last_active":"2023-12-02T01:29:46.862033+0000","last_peered":"2023-12-02T01:29:46.862033+0000","last_clean":"2023-12-02T01:29:46.862033+0000","last_became_active":"2023-12-02T01:29:45.298430+0000","last_became_peered":"2023-12-02T01:29:45.298430+0000","last_unstale":"2023-12-02T01:29:46.862033+0000","last_undegraded":"2023-12-02T01:29:46.862033+0000","last_fullsized":"2023-12-02T01:29:46.862033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654022+0000","last_change":"2023-12-02T01:29:44.356428+0000","last_active":"2023-12-02T01:29:46.654022+0000","last_peered":"2023-12-02T01:29:46.654022+0000","last_clean":"2023-12-02T01:29:46.654022+0000","last_became_active":"2023-12-02T01:29:44.356144+0000","last_became_peered":"2023-12-02T01:29:44.356144+0000","last_unstale":"2023-12-02T01:29:46.654022+0000","last_undegraded":"2023-12-02T01:29:46.654022+0000","last_fullsized":"2023-12-02T01:29:46.654022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:54.153379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504303+0000","last_change":"2023-12-02T01:29:45.291319+0000","last_active":"2023-12-02T01:29:46.504303+0000","last_peered":"2023-12-02T01:29:46.504303+0000","last_clean":"2023-12-02T01:29:46.504303+0000","last_became_active":"2023-12-02T01:29:45.291009+0000","last_became_peered":"2023-12-02T01:29:45.291009+0000","last_unstale":"2023-12-02T01:29:46.504303+0000","last_undegraded":"2023-12-02T01:29:46.504303+0000","last_fullsized":"2023-12-02T01:29:46.504303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:07.658204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277465+0000","last_change":"2023-12-02T01:29:44.344424+0000","last_active":"2023-12-02T01:29:46.277465+0000","last_peered":"2023-12-02T01:29:46.277465+0000","last_clean":"2023-12-02T01:29:46.277465+0000","last_became_active":"2023-12-02T01:29:44.344133+0000","last_became_peered":"2023-12-02T01:29:44.344133+0000","last_unstale":"2023-12-02T01:29:46.277465+0000","last_undegraded":"2023-12-02T01:29:46.277465+0000","last_fullsized":"2023-12-02T01:29:46.277465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:59:58.483054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278607+0000","last_change":"2023-12-02T01:29:45.287869+0000","last_active":"2023-12-02T01:29:46.278607+0000","last_peered":"2023-12-02T01:29:46.278607+0000","last_clean":"2023-12-02T01:29:46.278607+0000","last_became_active":"2023-12-02T01:29:45.287600+0000","last_became_peered":"2023-12-02T01:29:45.287600+0000","last_unstale":"2023-12-02T01:29:46.278607+0000","last_undegraded":"2023-12-02T01:29:46.278607+0000","last_fullsized":"2023-12-02T01:29:46.278607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654073+0000","last_change":"2023-12-02T01:29:44.349176+0000","last_active":"2023-12-02T01:29:46.654073+0000","last_peered":"2023-12-02T01:29:46.654073+0000","last_clean":"2023-12-02T01:29:46.654073+0000","last_became_active":"2023-12-02T01:29:44.347726+0000","last_became_peered":"2023-12-02T01:29:44.347726+0000","last_unstale":"2023-12-02T01:29:46.654073+0000","last_undegraded":"2023-12-02T01:29:46.654073+0000","last_fullsized":"2023-12-02T01:29:46.654073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:13.495997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279304+0000","last_change":"2023-12-02T01:29:45.290437+0000","last_active":"2023-12-02T01:29:46.279304+0000","last_peered":"2023-12-02T01:29:46.279304+0000","last_clean":"2023-12-02T01:29:46.279304+0000","last_became_active":"2023-12-02T01:29:45.290093+0000","last_became_peered":"2023-12-02T01:29:45.290093+0000","last_unstale":"2023-12-02T01:29:46.279304+0000","last_undegraded":"2023-12-02T01:29:46.279304+0000","last_fullsized":"2023-12-02T01:29:46.279304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:15.348786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278769+0000","last_change":"2023-12-02T01:29:44.348440+0000","last_active":"2023-12-02T01:29:46.278769+0000","last_peered":"2023-12-02T01:29:46.278769+0000","last_clean":"2023-12-02T01:29:46.278769+0000","last_became_active":"2023-12-02T01:29:44.348165+0000","last_became_peered":"2023-12-02T01:29:44.348165+0000","last_unstale":"2023-12-02T01:29:46.278769+0000","last_undegraded":"2023-12-02T01:29:46.278769+0000","last_fullsized":"2023-12-02T01:29:46.278769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:20.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863332+0000","last_change":"2023-12-02T01:29:45.295551+0000","last_active":"2023-12-02T01:29:46.863332+0000","last_peered":"2023-12-02T01:29:46.863332+0000","last_clean":"2023-12-02T01:29:46.863332+0000","last_became_active":"2023-12-02T01:29:45.295164+0000","last_became_peered":"2023-12-02T01:29:45.295164+0000","last_unstale":"2023-12-02T01:29:46.863332+0000","last_undegraded":"2023-12-02T01:29:46.863332+0000","last_fullsized":"2023-12-02T01:29:46.863332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:01:53.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654273+0000","last_change":"2023-12-02T01:29:44.354009+0000","last_active":"2023-12-02T01:29:46.654273+0000","last_peered":"2023-12-02T01:29:46.654273+0000","last_clean":"2023-12-02T01:29:46.654273+0000","last_became_active":"2023-12-02T01:29:44.353730+0000","last_became_peered":"2023-12-02T01:29:44.353730+0000","last_unstale":"2023-12-02T01:29:46.654273+0000","last_undegraded":"2023-12-02T01:29:46.654273+0000","last_fullsized":"2023-12-02T01:29:46.654273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:56.926421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278706+0000","last_change":"2023-12-02T01:29:45.288340+0000","last_active":"2023-12-02T01:29:46.278706+0000","last_peered":"2023-12-02T01:29:46.278706+0000","last_clean":"2023-12-02T01:29:46.278706+0000","last_became_active":"2023-12-02T01:29:45.288025+0000","last_became_peered":"2023-12-02T01:29:45.288025+0000","last_unstale":"2023-12-02T01:29:46.278706+0000","last_undegraded":"2023-12-02T01:29:46.278706+0000","last_fullsized":"2023-12-02T01:29:46.278706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.650260+0000","last_change":"2023-12-02T01:29:44.356197+0000","last_active":"2023-12-02T01:29:46.650260+0000","last_peered":"2023-12-02T01:29:46.650260+0000","last_clean":"2023-12-02T01:29:46.650260+0000","last_became_active":"2023-12-02T01:29:44.355856+0000","last_became_peered":"2023-12-02T01:29:44.355856+0000","last_unstale":"2023-12-02T01:29:46.650260+0000","last_undegraded":"2023-12-02T01:29:46.650260+0000","last_fullsized":"2023-12-02T01:29:46.650260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862318+0000","last_change":"2023-12-02T01:29:45.295847+0000","last_active":"2023-12-02T01:29:46.862318+0000","last_peered":"2023-12-02T01:29:46.862318+0000","last_clean":"2023-12-02T01:29:46.862318+0000","last_became_active":"2023-12-02T01:29:45.293122+0000","last_became_peered":"2023-12-02T01:29:45.293122+0000","last_unstale":"2023-12-02T01:29:46.862318+0000","last_undegraded":"2023-12-02T01:29:46.862318+0000","last_fullsized":"2023-12-02T01:29:46.862318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651638+0000","last_change":"2023-12-02T01:29:44.352578+0000","last_active":"2023-12-02T01:29:46.651638+0000","last_peered":"2023-12-02T01:29:46.651638+0000","last_clean":"2023-12-02T01:29:46.651638+0000","last_became_active":"2023-12-02T01:29:44.352301+0000","last_became_peered":"2023-12-02T01:29:44.352301+0000","last_unstale":"2023-12-02T01:29:46.651638+0000","last_undegraded":"2023-12-02T01:29:46.651638+0000","last_fullsized":"2023-12-02T01:29:46.651638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504710+0000","last_change":"2023-12-02T01:29:45.289358+0000","last_active":"2023-12-02T01:29:46.504710+0000","last_peered":"2023-12-02T01:29:46.504710+0000","last_clean":"2023-12-02T01:29:46.504710+0000","last_became_active":"2023-12-02T01:29:45.288764+0000","last_became_peered":"2023-12-02T01:29:45.288764+0000","last_unstale":"2023-12-02T01:29:46.504710+0000","last_undegraded":"2023-12-02T01:29:46.504710+0000","last_fullsized":"2023-12-02T01:29:46.504710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654001+0000","last_change":"2023-12-02T01:29:44.353622+0000","last_active":"2023-12-02T01:29:46.654001+0000","last_peered":"2023-12-02T01:29:46.654001+0000","last_clean":"2023-12-02T01:29:46.654001+0000","last_became_active":"2023-12-02T01:29:44.353356+0000","last_became_peered":"2023-12-02T01:29:44.353356+0000","last_unstale":"2023-12-02T01:29:46.654001+0000","last_undegraded":"2023-12-02T01:29:46.654001+0000","last_fullsized":"2023-12-02T01:29:46.654001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279022+0000","last_change":"2023-12-02T01:29:45.289816+0000","last_active":"2023-12-02T01:29:46.279022+0000","last_peered":"2023-12-02T01:29:46.279022+0000","last_clean":"2023-12-02T01:29:46.279022+0000","last_became_active":"2023-12-02T01:29:45.289305+0000","last_became_peered":"2023-12-02T01:29:45.289305+0000","last_unstale":"2023-12-02T01:29:46.279022+0000","last_undegraded":"2023-12-02T01:29:46.279022+0000","last_fullsized":"2023-12-02T01:29:46.279022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278678+0000","last_change":"2023-12-02T01:29:44.356341+0000","last_active":"2023-12-02T01:29:46.278678+0000","last_peered":"2023-12-02T01:29:46.278678+0000","last_clean":"2023-12-02T01:29:46.278678+0000","last_became_active":"2023-12-02T01:29:44.355976+0000","last_became_peered":"2023-12-02T01:29:44.355976+0000","last_unstale":"2023-12-02T01:29:46.278678+0000","last_undegraded":"2023-12-02T01:29:46.278678+0000","last_fullsized":"2023-12-02T01:29:46.278678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:28.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861932+0000","last_change":"2023-12-02T01:29:45.293848+0000","last_active":"2023-12-02T01:29:46.861932+0000","last_peered":"2023-12-02T01:29:46.861932+0000","last_clean":"2023-12-02T01:29:46.861932+0000","last_became_active":"2023-12-02T01:29:45.293579+0000","last_became_peered":"2023-12-02T01:29:45.293579+0000","last_unstale":"2023-12-02T01:29:46.861932+0000","last_undegraded":"2023-12-02T01:29:46.861932+0000","last_fullsized":"2023-12-02T01:29:46.861932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278841+0000","last_change":"2023-12-02T01:29:44.353369+0000","last_active":"2023-12-02T01:29:46.278841+0000","last_peered":"2023-12-02T01:29:46.278841+0000","last_clean":"2023-12-02T01:29:46.278841+0000","last_became_active":"2023-12-02T01:29:44.352947+0000","last_became_peered":"2023-12-02T01:29:44.352947+0000","last_unstale":"2023-12-02T01:29:46.278841+0000","last_undegraded":"2023-12-02T01:29:46.278841+0000","last_fullsized":"2023-12-02T01:29:46.278841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:27.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862112+0000","last_change":"2023-12-02T01:29:45.285988+0000","last_active":"2023-12-02T01:29:46.862112+0000","last_peered":"2023-12-02T01:29:46.862112+0000","last_clean":"2023-12-02T01:29:46.862112+0000","last_became_active":"2023-12-02T01:29:45.285710+0000","last_became_peered":"2023-12-02T01:29:45.285710+0000","last_unstale":"2023-12-02T01:29:46.862112+0000","last_undegraded":"2023-12-02T01:29:46.862112+0000","last_fullsized":"2023-12-02T01:29:46.862112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654144+0000","last_change":"2023-12-02T01:29:44.351734+0000","last_active":"2023-12-02T01:29:46.654144+0000","last_peered":"2023-12-02T01:29:46.654144+0000","last_clean":"2023-12-02T01:29:46.654144+0000","last_became_active":"2023-12-02T01:29:44.351459+0000","last_became_peered":"2023-12-02T01:29:44.351459+0000","last_unstale":"2023-12-02T01:29:46.654144+0000","last_undegraded":"2023-12-02T01:29:46.654144+0000","last_fullsized":"2023-12-02T01:29:46.654144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862270+0000","last_change":"2023-12-02T01:29:45.292288+0000","last_active":"2023-12-02T01:29:46.862270+0000","last_peered":"2023-12-02T01:29:46.862270+0000","last_clean":"2023-12-02T01:29:46.862270+0000","last_became_active":"2023-12-02T01:29:45.291969+0000","last_became_peered":"2023-12-02T01:29:45.291969+0000","last_unstale":"2023-12-02T01:29:46.862270+0000","last_undegraded":"2023-12-02T01:29:46.862270+0000","last_fullsized":"2023-12-02T01:29:46.862270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863256+0000","last_change":"2023-12-02T01:29:45.297737+0000","last_active":"2023-12-02T01:29:46.863256+0000","last_peered":"2023-12-02T01:29:46.863256+0000","last_clean":"2023-12-02T01:29:46.863256+0000","last_became_active":"2023-12-02T01:29:45.297288+0000","last_became_peered":"2023-12-02T01:29:45.297288+0000","last_unstale":"2023-12-02T01:29:46.863256+0000","last_undegraded":"2023-12-02T01:29:46.863256+0000","last_fullsized":"2023-12-02T01:29:46.863256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:43.782344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654165+0000","last_change":"2023-12-02T01:29:44.351702+0000","last_active":"2023-12-02T01:29:46.654165+0000","last_peered":"2023-12-02T01:29:46.654165+0000","last_clean":"2023-12-02T01:29:46.654165+0000","last_became_active":"2023-12-02T01:29:44.351340+0000","last_became_peered":"2023-12-02T01:29:44.351340+0000","last_unstale":"2023-12-02T01:29:46.654165+0000","last_undegraded":"2023-12-02T01:29:46.654165+0000","last_fullsized":"2023-12-02T01:29:46.654165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:20.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863072+0000","last_change":"2023-12-02T01:29:45.296949+0000","last_active":"2023-12-02T01:29:46.863072+0000","last_peered":"2023-12-02T01:29:46.863072+0000","last_clean":"2023-12-02T01:29:46.863072+0000","last_became_active":"2023-12-02T01:29:45.296653+0000","last_became_peered":"2023-12-02T01:29:45.296653+0000","last_unstale":"2023-12-02T01:29:46.863072+0000","last_undegraded":"2023-12-02T01:29:46.863072+0000","last_fullsized":"2023-12-02T01:29:46.863072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:42:36.390155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654224+0000","last_change":"2023-12-02T01:29:44.354118+0000","last_active":"2023-12-02T01:29:46.654224+0000","last_peered":"2023-12-02T01:29:46.654224+0000","last_clean":"2023-12-02T01:29:46.654224+0000","last_became_active":"2023-12-02T01:29:44.353835+0000","last_became_peered":"2023-12-02T01:29:44.353835+0000","last_unstale":"2023-12-02T01:29:46.654224+0000","last_undegraded":"2023-12-02T01:29:46.654224+0000","last_fullsized":"2023-12-02T01:29:46.654224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504573+0000","last_change":"2023-12-02T01:29:45.295870+0000","last_active":"2023-12-02T01:29:46.504573+0000","last_peered":"2023-12-02T01:29:46.504573+0000","last_clean":"2023-12-02T01:29:46.504573+0000","last_became_active":"2023-12-02T01:29:45.295589+0000","last_became_peered":"2023-12-02T01:29:45.295589+0000","last_unstale":"2023-12-02T01:29:46.504573+0000","last_undegraded":"2023-12-02T01:29:46.504573+0000","last_fullsized":"2023-12-02T01:29:46.504573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.658014+0000","last_change":"2023-12-02T01:29:44.352609+0000","last_active":"2023-12-02T01:29:46.658014+0000","last_peered":"2023-12-02T01:29:46.658014+0000","last_clean":"2023-12-02T01:29:46.658014+0000","last_became_active":"2023-12-02T01:29:44.352295+0000","last_became_peered":"2023-12-02T01:29:44.352295+0000","last_unstale":"2023-12-02T01:29:46.658014+0000","last_undegraded":"2023-12-02T01:29:46.658014+0000","last_fullsized":"2023-12-02T01:29:46.658014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862220+0000","last_change":"2023-12-02T01:29:45.287684+0000","last_active":"2023-12-02T01:29:46.862220+0000","last_peered":"2023-12-02T01:29:46.862220+0000","last_clean":"2023-12-02T01:29:46.862220+0000","last_became_active":"2023-12-02T01:29:45.287406+0000","last_became_peered":"2023-12-02T01:29:45.287406+0000","last_unstale":"2023-12-02T01:29:46.862220+0000","last_undegraded":"2023-12-02T01:29:46.862220+0000","last_fullsized":"2023-12-02T01:29:46.862220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504719+0000","last_change":"2023-12-02T01:29:44.354342+0000","last_active":"2023-12-02T01:29:46.504719+0000","last_peered":"2023-12-02T01:29:46.504719+0000","last_clean":"2023-12-02T01:29:46.504719+0000","last_became_active":"2023-12-02T01:29:44.353999+0000","last_became_peered":"2023-12-02T01:29:44.353999+0000","last_unstale":"2023-12-02T01:29:46.504719+0000","last_undegraded":"2023-12-02T01:29:46.504719+0000","last_fullsized":"2023-12-02T01:29:46.504719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-02T01:29:52.750 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-02T01:29:52.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.891+0000 7f0ad35d0640 1 Processor -- start 2023-12-02T01:29:52.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.891+0000 7f0ad35d0640 1 -- start start 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad35d0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0acc06dc30 0x7f0acc071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad35d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0acc0b1df0 0x7f0acc0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad35d0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0b3130 con 0x7f0acc142d20 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad35d0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc143100 con 0x7f0acc06dc30 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad35d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc0b2520 con 0x7f0acc0b1df0 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad0b6b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0acc06dc30 0x7f0acc071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad136c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0acc142d20 0x7f0acc06d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47296/0 (socket says 172.21.15.1:47296) 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad0b6b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0acc06dc30 0x7f0acc071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59528/0 (socket says 172.21.15.1:59528) 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad136c640 1 -- 172.21.15.1:0/1213634934 learned_addr learned my addr 172.21.15.1:0/1213634934 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad0b6b640 1 -- 172.21.15.1:0/1213634934 >> v2:172.21.15.167:3300/0 conn(0x7f0acc0b1df0 msgr2=0x7f0acc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:52.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad1b6d640 1 --2- 172.21.15.1:0/1213634934 >> v2:172.21.15.167:3300/0 conn(0x7f0acc0b1df0 0x7f0acc0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ac3fff640 1 -- 172.21.15.1:0/1213634934 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034917877 0 0) 0x7f0acc0b3130 con 0x7f0acc142d20 2023-12-02T01:29:52.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad0b6b640 1 --2- 172.21.15.1:0/1213634934 >> v2:172.21.15.167:3300/0 conn(0x7f0acc0b1df0 0x7f0acc0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad0b6b640 1 -- 172.21.15.1:0/1213634934 >> v1:172.21.15.1:6789/0 conn(0x7f0acc142d20 legacy=0x7f0acc06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.892+0000 7f0ad0b6b640 1 -- 172.21.15.1:0/1213634934 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0b2800 con 0x7f0acc06dc30 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.893+0000 7f0ad0b6b640 1 --2- 172.21.15.1:0/1213634934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc071f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0acc06e0e0 tx=0x7f0abc02e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebfeb4338e00ace server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.893+0000 7f0ac3fff640 1 -- 172.21.15.1:0/1213634934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc02ee50 con 0x7f0acc06dc30 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.893+0000 7f0ac3fff640 1 -- 172.21.15.1:0/1213634934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc036440 con 0x7f0acc06dc30 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.893+0000 7f0ac3fff640 1 -- 172.21.15.1:0/1213634934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0367d0 con 0x7f0acc06dc30 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 -- 172.21.15.1:0/1213634934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 msgr2=0x7f0acc071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/1213634934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc071f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0acc06e0e0 tx=0x7f0abc02e0a0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 -- 172.21.15.1:0/1213634934 shutdown_connections 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/1213634934 >> v2:172.21.15.167:3300/0 conn(0x7f0acc0b1df0 0x7f0acc0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/1213634934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc071f00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 -- 172.21.15.1:0/1213634934 >> 172.21.15.1:0/1213634934 conn(0x7f0acc0b0af0 msgr2=0x7f0acc0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 -- 172.21.15.1:0/1213634934 shutdown_connections 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.894+0000 7f0ad35d0640 1 -- 172.21.15.1:0/1213634934 wait complete. 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.895+0000 7f0ad35d0640 1 Processor -- start 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.895+0000 7f0ad35d0640 1 -- start start 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad35d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad35d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc0b1df0 0x7f0acc15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad35d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0acc142d20 0x7f0acc15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad35d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc15bd70 con 0x7f0acc06dc30 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad35d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc159fa0 con 0x7f0acc0b1df0 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad35d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc15b1a0 con 0x7f0acc142d20 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59534/0 (socket says 172.21.15.1:59534) 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 -- 172.21.15.1:0/2239783859 learned_addr learned my addr 172.21.15.1:0/2239783859 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad1b6d640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0acc142d20 0x7f0acc15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad0b6b640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc0b1df0 0x7f0acc15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 -- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0acc142d20 msgr2=0x7f0acc15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0acc142d20 0x7f0acc15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 -- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc0b1df0 msgr2=0x7f0acc15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc0b1df0 0x7f0acc15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 -- 172.21.15.1:0/2239783859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc00b6a0 con 0x7f0acc06dc30 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad0b6b640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc0b1df0 0x7f0acc15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad136c640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc159a60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c430 tx=0x7f0ac800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ac1ffb640 1 -- 172.21.15.1:0/2239783859 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80074e0 con 0x7f0acc06dc30 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ac1ffb640 1 -- 172.21.15.1:0/2239783859 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8007660 con 0x7f0acc06dc30 2023-12-02T01:29:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ac1ffb640 1 -- 172.21.15.1:0/2239783859 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8004a20 con 0x7f0acc06dc30 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.896+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc15b440 con 0x7f0acc06dc30 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.897+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc15ba00 con 0x7f0acc06dc30 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.898+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc067420 con 0x7f0acc06dc30 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.898+0000 7f0ac1ffb640 1 -- 172.21.15.1:0/2239783859 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ac8004b80 con 0x7f0acc06dc30 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.898+0000 7f0ac1ffb640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0ab006ae40 0x7f0ab006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.898+0000 7f0ad0b6b640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0ab006ae40 0x7f0ab006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.898+0000 7f0ac1ffb640 1 -- 172.21.15.1:0/2239783859 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ac8089440 con 0x7f0acc06dc30 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.899+0000 7f0ad0b6b640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0ab006ae40 0x7f0ab006d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0abc038000 tx=0x7f0abc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:52.902+0000 7f0ac1ffb640 1 -- 172.21.15.1:0/2239783859 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ac80544f0 con 0x7f0acc06dc30 2023-12-02T01:29:53.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.074+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 --> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0acc0b2240 con 0x7f0ab006ae40 2023-12-02T01:29:53.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.081+0000 7f0ac1ffb640 1 -- 172.21.15.1:0/2239783859 <== mgr.4110 v2:172.21.15.1:6832/1281506213 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264602 (secure 0 0 0) 0x7f0abc040410 con 0x7f0ab006ae40 2023-12-02T01:29:53.085 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:53.086 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0ab006ae40 msgr2=0x7f0ab006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0ab006ae40 0x7f0ab006d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0abc038000 tx=0x7f0abc032000 comp rx=0 tx=0).stop 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 msgr2=0x7f0acc159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc159a60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c430 tx=0x7f0ac800c8f0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 shutdown_connections 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0acc142d20 0x7f0acc15d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0ab006ae40 0x7f0ab006d300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0acc0b1df0 0x7f0acc15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 --2- 172.21.15.1:0/2239783859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0acc06dc30 0x7f0acc159a60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 >> 172.21.15.1:0/2239783859 conn(0x7f0acc0b0af0 msgr2=0x7f0acc13fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 shutdown_connections 2023-12-02T01:29:53.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.084+0000 7f0ad35d0640 1 -- 172.21.15.1:0/2239783859 wait complete. 2023-12-02T01:29:53.098 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-02T01:29:52.634280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235668,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001931"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812463+0000","last_change":"2023-12-02T01:29:45.289065+0000","last_active":"2023-12-02T01:29:46.812463+0000","last_peered":"2023-12-02T01:29:46.812463+0000","last_clean":"2023-12-02T01:29:46.812463+0000","last_became_active":"2023-12-02T01:29:45.288799+0000","last_became_peered":"2023-12-02T01:29:45.288799+0000","last_unstale":"2023-12-02T01:29:46.812463+0000","last_undegraded":"2023-12-02T01:29:46.812463+0000","last_fullsized":"2023-12-02T01:29:46.812463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:36:04.474471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278772+0000","last_change":"2023-12-02T01:29:45.287280+0000","last_active":"2023-12-02T01:29:46.278772+0000","last_peered":"2023-12-02T01:29:46.278772+0000","last_clean":"2023-12-02T01:29:46.278772+0000","last_became_active":"2023-12-02T01:29:45.286996+0000","last_became_peered":"2023-12-02T01:29:45.286996+0000","last_unstale":"2023-12-02T01:29:46.278772+0000","last_undegraded":"2023-12-02T01:29:46.278772+0000","last_fullsized":"2023-12-02T01:29:46.278772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504640+0000","last_change":"2023-12-02T01:29:45.281765+0000","last_active":"2023-12-02T01:29:46.504640+0000","last_peered":"2023-12-02T01:29:46.504640+0000","last_clean":"2023-12-02T01:29:46.504640+0000","last_became_active":"2023-12-02T01:29:45.281451+0000","last_became_peered":"2023-12-02T01:29:45.281451+0000","last_unstale":"2023-12-02T01:29:46.504640+0000","last_undegraded":"2023-12-02T01:29:46.504640+0000","last_fullsized":"2023-12-02T01:29:46.504640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862929+0000","last_change":"2023-12-02T01:29:45.297982+0000","last_active":"2023-12-02T01:29:46.862929+0000","last_peered":"2023-12-02T01:29:46.862929+0000","last_clean":"2023-12-02T01:29:46.862929+0000","last_became_active":"2023-12-02T01:29:45.297711+0000","last_became_peered":"2023-12-02T01:29:45.297711+0000","last_unstale":"2023-12-02T01:29:46.862929+0000","last_undegraded":"2023-12-02T01:29:46.862929+0000","last_fullsized":"2023-12-02T01:29:46.862929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:21:01.551671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812058+0000","last_change":"2023-12-02T01:29:45.293266+0000","last_active":"2023-12-02T01:29:46.812058+0000","last_peered":"2023-12-02T01:29:46.812058+0000","last_clean":"2023-12-02T01:29:46.812058+0000","last_became_active":"2023-12-02T01:29:45.292952+0000","last_became_peered":"2023-12-02T01:29:45.292952+0000","last_unstale":"2023-12-02T01:29:46.812058+0000","last_undegraded":"2023-12-02T01:29:46.812058+0000","last_fullsized":"2023-12-02T01:29:46.812058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:21:01.551671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862416+0000","last_change":"2023-12-02T01:29:45.296193+0000","last_active":"2023-12-02T01:29:46.862416+0000","last_peered":"2023-12-02T01:29:46.862416+0000","last_clean":"2023-12-02T01:29:46.862416+0000","last_became_active":"2023-12-02T01:29:45.295761+0000","last_became_peered":"2023-12-02T01:29:45.295761+0000","last_unstale":"2023-12-02T01:29:46.862416+0000","last_undegraded":"2023-12-02T01:29:46.862416+0000","last_fullsized":"2023-12-02T01:29:46.862416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.811940+0000","last_change":"2023-12-02T01:29:45.291904+0000","last_active":"2023-12-02T01:29:46.811940+0000","last_peered":"2023-12-02T01:29:46.811940+0000","last_clean":"2023-12-02T01:29:46.811940+0000","last_became_active":"2023-12-02T01:29:45.291616+0000","last_became_peered":"2023-12-02T01:29:45.291616+0000","last_unstale":"2023-12-02T01:29:46.811940+0000","last_undegraded":"2023-12-02T01:29:46.811940+0000","last_fullsized":"2023-12-02T01:29:46.811940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861779+0000","last_change":"2023-12-02T01:29:45.296142+0000","last_active":"2023-12-02T01:29:46.861779+0000","last_peered":"2023-12-02T01:29:46.861779+0000","last_clean":"2023-12-02T01:29:46.861779+0000","last_became_active":"2023-12-02T01:29:45.295778+0000","last_became_peered":"2023-12-02T01:29:45.295778+0000","last_unstale":"2023-12-02T01:29:46.861779+0000","last_undegraded":"2023-12-02T01:29:46.861779+0000","last_fullsized":"2023-12-02T01:29:46.861779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:29.267506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812467+0000","last_change":"2023-12-02T01:29:45.299688+0000","last_active":"2023-12-02T01:29:46.812467+0000","last_peered":"2023-12-02T01:29:46.812467+0000","last_clean":"2023-12-02T01:29:46.812467+0000","last_became_active":"2023-12-02T01:29:45.299362+0000","last_became_peered":"2023-12-02T01:29:45.299362+0000","last_unstale":"2023-12-02T01:29:46.812467+0000","last_undegraded":"2023-12-02T01:29:46.812467+0000","last_fullsized":"2023-12-02T01:29:46.812467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:13:58.565887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862789+0000","last_change":"2023-12-02T01:29:45.294653+0000","last_active":"2023-12-02T01:29:46.862789+0000","last_peered":"2023-12-02T01:29:46.862789+0000","last_clean":"2023-12-02T01:29:46.862789+0000","last_became_active":"2023-12-02T01:29:45.294403+0000","last_became_peered":"2023-12-02T01:29:45.294403+0000","last_unstale":"2023-12-02T01:29:46.862789+0000","last_undegraded":"2023-12-02T01:29:46.862789+0000","last_fullsized":"2023-12-02T01:29:46.862789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862586+0000","last_change":"2023-12-02T01:29:45.296336+0000","last_active":"2023-12-02T01:29:46.862586+0000","last_peered":"2023-12-02T01:29:46.862586+0000","last_clean":"2023-12-02T01:29:46.862586+0000","last_became_active":"2023-12-02T01:29:45.296065+0000","last_became_peered":"2023-12-02T01:29:45.296065+0000","last_unstale":"2023-12-02T01:29:46.862586+0000","last_undegraded":"2023-12-02T01:29:46.862586+0000","last_fullsized":"2023-12-02T01:29:46.862586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279488+0000","last_change":"2023-12-02T01:29:45.289558+0000","last_active":"2023-12-02T01:29:46.279488+0000","last_peered":"2023-12-02T01:29:46.279488+0000","last_clean":"2023-12-02T01:29:46.279488+0000","last_became_active":"2023-12-02T01:29:45.289116+0000","last_became_peered":"2023-12-02T01:29:45.289116+0000","last_unstale":"2023-12-02T01:29:46.279488+0000","last_undegraded":"2023-12-02T01:29:46.279488+0000","last_fullsized":"2023-12-02T01:29:46.279488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:28.529390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862143+0000","last_change":"2023-12-02T01:29:45.288300+0000","last_active":"2023-12-02T01:29:46.862143+0000","last_peered":"2023-12-02T01:29:46.862143+0000","last_clean":"2023-12-02T01:29:46.862143+0000","last_became_active":"2023-12-02T01:29:45.288019+0000","last_became_peered":"2023-12-02T01:29:45.288019+0000","last_unstale":"2023-12-02T01:29:46.862143+0000","last_undegraded":"2023-12-02T01:29:46.862143+0000","last_fullsized":"2023-12-02T01:29:46.862143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504355+0000","last_change":"2023-12-02T01:29:45.288371+0000","last_active":"2023-12-02T01:29:46.504355+0000","last_peered":"2023-12-02T01:29:46.504355+0000","last_clean":"2023-12-02T01:29:46.504355+0000","last_became_active":"2023-12-02T01:29:45.288048+0000","last_became_peered":"2023-12-02T01:29:45.288048+0000","last_unstale":"2023-12-02T01:29:46.504355+0000","last_undegraded":"2023-12-02T01:29:46.504355+0000","last_fullsized":"2023-12-02T01:29:46.504355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278590+0000","last_change":"2023-12-02T01:29:45.297919+0000","last_active":"2023-12-02T01:29:46.278590+0000","last_peered":"2023-12-02T01:29:46.278590+0000","last_clean":"2023-12-02T01:29:46.278590+0000","last_became_active":"2023-12-02T01:29:45.297629+0000","last_became_peered":"2023-12-02T01:29:45.297629+0000","last_unstale":"2023-12-02T01:29:46.278590+0000","last_undegraded":"2023-12-02T01:29:46.278590+0000","last_fullsized":"2023-12-02T01:29:46.278590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862149+0000","last_change":"2023-12-02T01:29:45.291354+0000","last_active":"2023-12-02T01:29:46.862149+0000","last_peered":"2023-12-02T01:29:46.862149+0000","last_clean":"2023-12-02T01:29:46.862149+0000","last_became_active":"2023-12-02T01:29:45.290958+0000","last_became_peered":"2023-12-02T01:29:45.290958+0000","last_unstale":"2023-12-02T01:29:46.862149+0000","last_undegraded":"2023-12-02T01:29:46.862149+0000","last_fullsized":"2023-12-02T01:29:46.862149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863341+0000","last_change":"2023-12-02T01:29:45.299054+0000","last_active":"2023-12-02T01:29:46.863341+0000","last_peered":"2023-12-02T01:29:46.863341+0000","last_clean":"2023-12-02T01:29:46.863341+0000","last_became_active":"2023-12-02T01:29:45.298788+0000","last_became_peered":"2023-12-02T01:29:45.298788+0000","last_unstale":"2023-12-02T01:29:46.863341+0000","last_undegraded":"2023-12-02T01:29:46.863341+0000","last_fullsized":"2023-12-02T01:29:46.863341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:13:58.565887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277543+0000","last_change":"2023-12-02T01:29:45.285978+0000","last_active":"2023-12-02T01:29:46.277543+0000","last_peered":"2023-12-02T01:29:46.277543+0000","last_clean":"2023-12-02T01:29:46.277543+0000","last_became_active":"2023-12-02T01:29:45.285621+0000","last_became_peered":"2023-12-02T01:29:45.285621+0000","last_unstale":"2023-12-02T01:29:46.277543+0000","last_undegraded":"2023-12-02T01:29:46.277543+0000","last_fullsized":"2023-12-02T01:29:46.277543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:15.348786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812431+0000","last_change":"2023-12-02T01:29:45.293553+0000","last_active":"2023-12-02T01:29:46.812431+0000","last_peered":"2023-12-02T01:29:46.812431+0000","last_clean":"2023-12-02T01:29:46.812431+0000","last_became_active":"2023-12-02T01:29:45.292966+0000","last_became_peered":"2023-12-02T01:29:45.292966+0000","last_unstale":"2023-12-02T01:29:46.812431+0000","last_undegraded":"2023-12-02T01:29:46.812431+0000","last_fullsized":"2023-12-02T01:29:46.812431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:01:53.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862689+0000","last_change":"2023-12-02T01:29:45.291596+0000","last_active":"2023-12-02T01:29:46.862689+0000","last_peered":"2023-12-02T01:29:46.862689+0000","last_clean":"2023-12-02T01:29:46.862689+0000","last_became_active":"2023-12-02T01:29:45.291340+0000","last_became_peered":"2023-12-02T01:29:45.291340+0000","last_unstale":"2023-12-02T01:29:46.862689+0000","last_undegraded":"2023-12-02T01:29:46.862689+0000","last_fullsized":"2023-12-02T01:29:46.862689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504467+0000","last_change":"2023-12-02T01:29:45.289467+0000","last_active":"2023-12-02T01:29:46.504467+0000","last_peered":"2023-12-02T01:29:46.504467+0000","last_clean":"2023-12-02T01:29:46.504467+0000","last_became_active":"2023-12-02T01:29:45.289182+0000","last_became_peered":"2023-12-02T01:29:45.289182+0000","last_unstale":"2023-12-02T01:29:46.504467+0000","last_undegraded":"2023-12-02T01:29:46.504467+0000","last_fullsized":"2023-12-02T01:29:46.504467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862498+0000","last_change":"2023-12-02T01:29:45.300021+0000","last_active":"2023-12-02T01:29:46.862498+0000","last_peered":"2023-12-02T01:29:46.862498+0000","last_clean":"2023-12-02T01:29:46.862498+0000","last_became_active":"2023-12-02T01:29:45.299751+0000","last_became_peered":"2023-12-02T01:29:45.299751+0000","last_unstale":"2023-12-02T01:29:46.862498+0000","last_undegraded":"2023-12-02T01:29:46.862498+0000","last_fullsized":"2023-12-02T01:29:46.862498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861844+0000","last_change":"2023-12-02T01:29:45.292603+0000","last_active":"2023-12-02T01:29:46.861844+0000","last_peered":"2023-12-02T01:29:46.861844+0000","last_clean":"2023-12-02T01:29:46.861844+0000","last_became_active":"2023-12-02T01:29:45.292325+0000","last_became_peered":"2023-12-02T01:29:45.292325+0000","last_unstale":"2023-12-02T01:29:46.861844+0000","last_undegraded":"2023-12-02T01:29:46.861844+0000","last_fullsized":"2023-12-02T01:29:46.861844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862254+0000","last_change":"2023-12-02T01:29:45.294653+0000","last_active":"2023-12-02T01:29:46.862254+0000","last_peered":"2023-12-02T01:29:46.862254+0000","last_clean":"2023-12-02T01:29:46.862254+0000","last_became_active":"2023-12-02T01:29:45.294371+0000","last_became_peered":"2023-12-02T01:29:45.294371+0000","last_unstale":"2023-12-02T01:29:46.862254+0000","last_undegraded":"2023-12-02T01:29:46.862254+0000","last_fullsized":"2023-12-02T01:29:46.862254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862338+0000","last_change":"2023-12-02T01:29:45.292542+0000","last_active":"2023-12-02T01:29:46.862338+0000","last_peered":"2023-12-02T01:29:46.862338+0000","last_clean":"2023-12-02T01:29:46.862338+0000","last_became_active":"2023-12-02T01:29:45.292250+0000","last_became_peered":"2023-12-02T01:29:45.292250+0000","last_unstale":"2023-12-02T01:29:46.862338+0000","last_undegraded":"2023-12-02T01:29:46.862338+0000","last_fullsized":"2023-12-02T01:29:46.862338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862942+0000","last_change":"2023-12-02T01:29:45.290121+0000","last_active":"2023-12-02T01:29:46.862942+0000","last_peered":"2023-12-02T01:29:46.862942+0000","last_clean":"2023-12-02T01:29:46.862942+0000","last_became_active":"2023-12-02T01:29:45.289862+0000","last_became_peered":"2023-12-02T01:29:45.289862+0000","last_unstale":"2023-12-02T01:29:46.862942+0000","last_undegraded":"2023-12-02T01:29:46.862942+0000","last_fullsized":"2023-12-02T01:29:46.862942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278875+0000","last_change":"2023-12-02T01:29:45.295312+0000","last_active":"2023-12-02T01:29:46.278875+0000","last_peered":"2023-12-02T01:29:46.278875+0000","last_clean":"2023-12-02T01:29:46.278875+0000","last_became_active":"2023-12-02T01:29:45.295007+0000","last_became_peered":"2023-12-02T01:29:45.295007+0000","last_unstale":"2023-12-02T01:29:46.278875+0000","last_undegraded":"2023-12-02T01:29:46.278875+0000","last_fullsized":"2023-12-02T01:29:46.278875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862182+0000","last_change":"2023-12-02T01:29:45.294208+0000","last_active":"2023-12-02T01:29:46.862182+0000","last_peered":"2023-12-02T01:29:46.862182+0000","last_clean":"2023-12-02T01:29:46.862182+0000","last_became_active":"2023-12-02T01:29:45.293819+0000","last_became_peered":"2023-12-02T01:29:45.293819+0000","last_unstale":"2023-12-02T01:29:46.862182+0000","last_undegraded":"2023-12-02T01:29:46.862182+0000","last_fullsized":"2023-12-02T01:29:46.862182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:57.933190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504519+0000","last_change":"2023-12-02T01:29:45.293594+0000","last_active":"2023-12-02T01:29:46.504519+0000","last_peered":"2023-12-02T01:29:46.504519+0000","last_clean":"2023-12-02T01:29:46.504519+0000","last_became_active":"2023-12-02T01:29:45.293292+0000","last_became_peered":"2023-12-02T01:29:45.293292+0000","last_unstale":"2023-12-02T01:29:46.504519+0000","last_undegraded":"2023-12-02T01:29:46.504519+0000","last_fullsized":"2023-12-02T01:29:46.504519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862565+0000","last_change":"2023-12-02T01:29:45.293967+0000","last_active":"2023-12-02T01:29:46.862565+0000","last_peered":"2023-12-02T01:29:46.862565+0000","last_clean":"2023-12-02T01:29:46.862565+0000","last_became_active":"2023-12-02T01:29:45.293685+0000","last_became_peered":"2023-12-02T01:29:45.293685+0000","last_unstale":"2023-12-02T01:29:46.862565+0000","last_undegraded":"2023-12-02T01:29:46.862565+0000","last_fullsized":"2023-12-02T01:29:46.862565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277375+0000","last_change":"2023-12-02T01:29:45.286671+0000","last_active":"2023-12-02T01:29:46.277375+0000","last_peered":"2023-12-02T01:29:46.277375+0000","last_clean":"2023-12-02T01:29:46.277375+0000","last_became_active":"2023-12-02T01:29:45.286387+0000","last_became_peered":"2023-12-02T01:29:45.286387+0000","last_unstale":"2023-12-02T01:29:46.277375+0000","last_undegraded":"2023-12-02T01:29:46.277375+0000","last_fullsized":"2023-12-02T01:29:46.277375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862239+0000","last_change":"2023-12-02T01:29:45.287262+0000","last_active":"2023-12-02T01:29:46.862239+0000","last_peered":"2023-12-02T01:29:46.862239+0000","last_clean":"2023-12-02T01:29:46.862239+0000","last_became_active":"2023-12-02T01:29:45.286609+0000","last_became_peered":"2023-12-02T01:29:45.286609+0000","last_unstale":"2023-12-02T01:29:46.862239+0000","last_undegraded":"2023-12-02T01:29:46.862239+0000","last_fullsized":"2023-12-02T01:29:46.862239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:43:48.121326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279008+0000","last_change":"2023-12-02T01:29:45.290257+0000","last_active":"2023-12-02T01:29:46.279008+0000","last_peered":"2023-12-02T01:29:46.279008+0000","last_clean":"2023-12-02T01:29:46.279008+0000","last_became_active":"2023-12-02T01:29:45.289574+0000","last_became_peered":"2023-12-02T01:29:45.289574+0000","last_unstale":"2023-12-02T01:29:46.279008+0000","last_undegraded":"2023-12-02T01:29:46.279008+0000","last_fullsized":"2023-12-02T01:29:46.279008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:55.160149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.657985+0000","last_change":"2023-12-02T01:29:44.349543+0000","last_active":"2023-12-02T01:29:46.657985+0000","last_peered":"2023-12-02T01:29:46.657985+0000","last_clean":"2023-12-02T01:29:46.657985+0000","last_became_active":"2023-12-02T01:29:44.349239+0000","last_became_peered":"2023-12-02T01:29:44.349239+0000","last_unstale":"2023-12-02T01:29:46.657985+0000","last_undegraded":"2023-12-02T01:29:46.657985+0000","last_fullsized":"2023-12-02T01:29:46.657985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504676+0000","last_change":"2023-12-02T01:29:45.290443+0000","last_active":"2023-12-02T01:29:46.504676+0000","last_peered":"2023-12-02T01:29:46.504676+0000","last_clean":"2023-12-02T01:29:46.504676+0000","last_became_active":"2023-12-02T01:29:45.290132+0000","last_became_peered":"2023-12-02T01:29:45.290132+0000","last_unstale":"2023-12-02T01:29:46.504676+0000","last_undegraded":"2023-12-02T01:29:46.504676+0000","last_fullsized":"2023-12-02T01:29:46.504676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651553+0000","last_change":"2023-12-02T01:29:44.347904+0000","last_active":"2023-12-02T01:29:46.651553+0000","last_peered":"2023-12-02T01:29:46.651553+0000","last_clean":"2023-12-02T01:29:46.651553+0000","last_became_active":"2023-12-02T01:29:44.347621+0000","last_became_peered":"2023-12-02T01:29:44.347621+0000","last_unstale":"2023-12-02T01:29:46.651553+0000","last_undegraded":"2023-12-02T01:29:46.651553+0000","last_fullsized":"2023-12-02T01:29:46.651553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:28.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.657929+0000","last_change":"2023-12-02T01:29:44.347813+0000","last_active":"2023-12-02T01:29:46.657929+0000","last_peered":"2023-12-02T01:29:46.657929+0000","last_clean":"2023-12-02T01:29:46.657929+0000","last_became_active":"2023-12-02T01:29:44.347529+0000","last_became_peered":"2023-12-02T01:29:44.347529+0000","last_unstale":"2023-12-02T01:29:46.657929+0000","last_undegraded":"2023-12-02T01:29:46.657929+0000","last_fullsized":"2023-12-02T01:29:46.657929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861829+0000","last_change":"2023-12-02T01:29:45.291020+0000","last_active":"2023-12-02T01:29:46.861829+0000","last_peered":"2023-12-02T01:29:46.861829+0000","last_clean":"2023-12-02T01:29:46.861829+0000","last_became_active":"2023-12-02T01:29:45.290736+0000","last_became_peered":"2023-12-02T01:29:45.290736+0000","last_unstale":"2023-12-02T01:29:46.861829+0000","last_undegraded":"2023-12-02T01:29:46.861829+0000","last_fullsized":"2023-12-02T01:29:46.861829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:07.658204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.653948+0000","last_change":"2023-12-02T01:29:44.345129+0000","last_active":"2023-12-02T01:29:46.653948+0000","last_peered":"2023-12-02T01:29:46.653948+0000","last_clean":"2023-12-02T01:29:46.653948+0000","last_became_active":"2023-12-02T01:29:44.344808+0000","last_became_peered":"2023-12-02T01:29:44.344808+0000","last_unstale":"2023-12-02T01:29:46.653948+0000","last_undegraded":"2023-12-02T01:29:46.653948+0000","last_fullsized":"2023-12-02T01:29:46.653948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278811+0000","last_change":"2023-12-02T01:29:45.294374+0000","last_active":"2023-12-02T01:29:46.278811+0000","last_peered":"2023-12-02T01:29:46.278811+0000","last_clean":"2023-12-02T01:29:46.278811+0000","last_became_active":"2023-12-02T01:29:45.294104+0000","last_became_peered":"2023-12-02T01:29:45.294104+0000","last_unstale":"2023-12-02T01:29:46.278811+0000","last_undegraded":"2023-12-02T01:29:46.278811+0000","last_fullsized":"2023-12-02T01:29:46.278811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651627+0000","last_change":"2023-12-02T01:29:44.350703+0000","last_active":"2023-12-02T01:29:46.651627+0000","last_peered":"2023-12-02T01:29:46.651627+0000","last_clean":"2023-12-02T01:29:46.651627+0000","last_became_active":"2023-12-02T01:29:44.350399+0000","last_became_peered":"2023-12-02T01:29:44.350399+0000","last_unstale":"2023-12-02T01:29:46.651627+0000","last_undegraded":"2023-12-02T01:29:46.651627+0000","last_fullsized":"2023-12-02T01:29:46.651627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:01.723991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863127+0000","last_change":"2023-12-02T01:29:45.294483+0000","last_active":"2023-12-02T01:29:46.863127+0000","last_peered":"2023-12-02T01:29:46.863127+0000","last_clean":"2023-12-02T01:29:46.863127+0000","last_became_active":"2023-12-02T01:29:45.294221+0000","last_became_peered":"2023-12-02T01:29:45.294221+0000","last_unstale":"2023-12-02T01:29:46.863127+0000","last_undegraded":"2023-12-02T01:29:46.863127+0000","last_fullsized":"2023-12-02T01:29:46.863127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:29:54.906793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654232+0000","last_change":"2023-12-02T01:29:44.348206+0000","last_active":"2023-12-02T01:29:46.654232+0000","last_peered":"2023-12-02T01:29:46.654232+0000","last_clean":"2023-12-02T01:29:46.654232+0000","last_became_active":"2023-12-02T01:29:44.347824+0000","last_became_peered":"2023-12-02T01:29:44.347824+0000","last_unstale":"2023-12-02T01:29:46.654232+0000","last_undegraded":"2023-12-02T01:29:46.654232+0000","last_fullsized":"2023-12-02T01:29:46.654232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504691+0000","last_change":"2023-12-02T01:29:45.290778+0000","last_active":"2023-12-02T01:29:46.504691+0000","last_peered":"2023-12-02T01:29:46.504691+0000","last_clean":"2023-12-02T01:29:46.504691+0000","last_became_active":"2023-12-02T01:29:45.290465+0000","last_became_peered":"2023-12-02T01:29:45.290465+0000","last_unstale":"2023-12-02T01:29:46.504691+0000","last_undegraded":"2023-12-02T01:29:46.504691+0000","last_fullsized":"2023-12-02T01:29:46.504691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278661+0000","last_change":"2023-12-02T01:29:44.354772+0000","last_active":"2023-12-02T01:29:46.278661+0000","last_peered":"2023-12-02T01:29:46.278661+0000","last_clean":"2023-12-02T01:29:46.278661+0000","last_became_active":"2023-12-02T01:29:44.354324+0000","last_became_peered":"2023-12-02T01:29:44.354324+0000","last_unstale":"2023-12-02T01:29:46.278661+0000","last_undegraded":"2023-12-02T01:29:46.278661+0000","last_fullsized":"2023-12-02T01:29:46.278661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:13.495997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279468+0000","last_change":"2023-12-02T01:29:45.290328+0000","last_active":"2023-12-02T01:29:46.279468+0000","last_peered":"2023-12-02T01:29:46.279468+0000","last_clean":"2023-12-02T01:29:46.279468+0000","last_became_active":"2023-12-02T01:29:45.290057+0000","last_became_peered":"2023-12-02T01:29:45.290057+0000","last_unstale":"2023-12-02T01:29:46.279468+0000","last_undegraded":"2023-12-02T01:29:46.279468+0000","last_fullsized":"2023-12-02T01:29:46.279468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:21.086467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651577+0000","last_change":"2023-12-02T01:29:44.349532+0000","last_active":"2023-12-02T01:29:46.651577+0000","last_peered":"2023-12-02T01:29:46.651577+0000","last_clean":"2023-12-02T01:29:46.651577+0000","last_became_active":"2023-12-02T01:29:44.349218+0000","last_became_peered":"2023-12-02T01:29:44.349218+0000","last_unstale":"2023-12-02T01:29:46.651577+0000","last_undegraded":"2023-12-02T01:29:46.651577+0000","last_fullsized":"2023-12-02T01:29:46.651577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:06.651434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812215+0000","last_change":"2023-12-02T01:29:45.293735+0000","last_active":"2023-12-02T01:29:46.812215+0000","last_peered":"2023-12-02T01:29:46.812215+0000","last_clean":"2023-12-02T01:29:46.812215+0000","last_became_active":"2023-12-02T01:29:45.293291+0000","last_became_peered":"2023-12-02T01:29:45.293291+0000","last_unstale":"2023-12-02T01:29:46.812215+0000","last_undegraded":"2023-12-02T01:29:46.812215+0000","last_fullsized":"2023-12-02T01:29:46.812215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:29:54.906793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504662+0000","last_change":"2023-12-02T01:29:44.354982+0000","last_active":"2023-12-02T01:29:46.504662+0000","last_peered":"2023-12-02T01:29:46.504662+0000","last_clean":"2023-12-02T01:29:46.504662+0000","last_became_active":"2023-12-02T01:29:44.354668+0000","last_became_peered":"2023-12-02T01:29:44.354668+0000","last_unstale":"2023-12-02T01:29:46.504662+0000","last_undegraded":"2023-12-02T01:29:46.504662+0000","last_fullsized":"2023-12-02T01:29:46.504662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504397+0000","last_change":"2023-12-02T01:29:45.288825+0000","last_active":"2023-12-02T01:29:46.504397+0000","last_peered":"2023-12-02T01:29:46.504397+0000","last_clean":"2023-12-02T01:29:46.504397+0000","last_became_active":"2023-12-02T01:29:45.288301+0000","last_became_peered":"2023-12-02T01:29:45.288301+0000","last_unstale":"2023-12-02T01:29:46.504397+0000","last_undegraded":"2023-12-02T01:29:46.504397+0000","last_fullsized":"2023-12-02T01:29:46.504397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654040+0000","last_change":"2023-12-02T01:29:44.351474+0000","last_active":"2023-12-02T01:29:46.654040+0000","last_peered":"2023-12-02T01:29:46.654040+0000","last_clean":"2023-12-02T01:29:46.654040+0000","last_became_active":"2023-12-02T01:29:44.351168+0000","last_became_peered":"2023-12-02T01:29:44.351168+0000","last_unstale":"2023-12-02T01:29:46.654040+0000","last_undegraded":"2023-12-02T01:29:46.654040+0000","last_fullsized":"2023-12-02T01:29:46.654040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:27.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812094+0000","last_change":"2023-12-02T01:29:45.297986+0000","last_active":"2023-12-02T01:29:46.812094+0000","last_peered":"2023-12-02T01:29:46.812094+0000","last_clean":"2023-12-02T01:29:46.812094+0000","last_became_active":"2023-12-02T01:29:45.297733+0000","last_became_peered":"2023-12-02T01:29:45.297733+0000","last_unstale":"2023-12-02T01:29:46.812094+0000","last_undegraded":"2023-12-02T01:29:46.812094+0000","last_fullsized":"2023-12-02T01:29:46.812094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:42:36.390155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651523+0000","last_change":"2023-12-02T01:29:44.347247+0000","last_active":"2023-12-02T01:29:46.651523+0000","last_peered":"2023-12-02T01:29:46.651523+0000","last_clean":"2023-12-02T01:29:46.651523+0000","last_became_active":"2023-12-02T01:29:44.346905+0000","last_became_peered":"2023-12-02T01:29:44.346905+0000","last_unstale":"2023-12-02T01:29:46.651523+0000","last_undegraded":"2023-12-02T01:29:46.651523+0000","last_fullsized":"2023-12-02T01:29:46.651523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862358+0000","last_change":"2023-12-02T01:29:45.287422+0000","last_active":"2023-12-02T01:29:46.862358+0000","last_peered":"2023-12-02T01:29:46.862358+0000","last_clean":"2023-12-02T01:29:46.862358+0000","last_became_active":"2023-12-02T01:29:45.286995+0000","last_became_peered":"2023-12-02T01:29:45.286995+0000","last_unstale":"2023-12-02T01:29:46.862358+0000","last_undegraded":"2023-12-02T01:29:46.862358+0000","last_fullsized":"2023-12-02T01:29:46.862358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277352+0000","last_change":"2023-12-02T01:29:44.348128+0000","last_active":"2023-12-02T01:29:46.277352+0000","last_peered":"2023-12-02T01:29:46.277352+0000","last_clean":"2023-12-02T01:29:46.277352+0000","last_became_active":"2023-12-02T01:29:44.347814+0000","last_became_peered":"2023-12-02T01:29:44.347814+0000","last_unstale":"2023-12-02T01:29:46.277352+0000","last_undegraded":"2023-12-02T01:29:46.277352+0000","last_fullsized":"2023-12-02T01:29:46.277352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.811993+0000","last_change":"2023-12-02T01:29:45.297889+0000","last_active":"2023-12-02T01:29:46.811993+0000","last_peered":"2023-12-02T01:29:46.811993+0000","last_clean":"2023-12-02T01:29:46.811993+0000","last_became_active":"2023-12-02T01:29:45.297639+0000","last_became_peered":"2023-12-02T01:29:45.297639+0000","last_unstale":"2023-12-02T01:29:46.811993+0000","last_undegraded":"2023-12-02T01:29:46.811993+0000","last_fullsized":"2023-12-02T01:29:46.811993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279286+0000","last_change":"2023-12-02T01:29:44.348659+0000","last_active":"2023-12-02T01:29:46.279286+0000","last_peered":"2023-12-02T01:29:46.279286+0000","last_clean":"2023-12-02T01:29:46.279286+0000","last_became_active":"2023-12-02T01:29:44.348107+0000","last_became_peered":"2023-12-02T01:29:44.348107+0000","last_unstale":"2023-12-02T01:29:46.279286+0000","last_undegraded":"2023-12-02T01:29:46.279286+0000","last_fullsized":"2023-12-02T01:29:46.279286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812370+0000","last_change":"2023-12-02T01:29:45.296461+0000","last_active":"2023-12-02T01:29:46.812370+0000","last_peered":"2023-12-02T01:29:46.812370+0000","last_clean":"2023-12-02T01:29:46.812370+0000","last_became_active":"2023-12-02T01:29:45.296220+0000","last_became_peered":"2023-12-02T01:29:45.296220+0000","last_unstale":"2023-12-02T01:29:46.812370+0000","last_undegraded":"2023-12-02T01:29:46.812370+0000","last_fullsized":"2023-12-02T01:29:46.812370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:43.782344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277634+0000","last_change":"2023-12-02T01:29:44.349307+0000","last_active":"2023-12-02T01:29:46.277634+0000","last_peered":"2023-12-02T01:29:46.277634+0000","last_clean":"2023-12-02T01:29:46.277634+0000","last_became_active":"2023-12-02T01:29:44.349025+0000","last_became_peered":"2023-12-02T01:29:44.349025+0000","last_unstale":"2023-12-02T01:29:46.277634+0000","last_undegraded":"2023-12-02T01:29:46.277634+0000","last_fullsized":"2023-12-02T01:29:46.277634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:54.153379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812564+0000","last_change":"2023-12-02T01:29:45.297278+0000","last_active":"2023-12-02T01:29:46.812564+0000","last_peered":"2023-12-02T01:29:46.812564+0000","last_clean":"2023-12-02T01:29:46.812564+0000","last_became_active":"2023-12-02T01:29:45.297012+0000","last_became_peered":"2023-12-02T01:29:45.297012+0000","last_unstale":"2023-12-02T01:29:46.812564+0000","last_undegraded":"2023-12-02T01:29:46.812564+0000","last_fullsized":"2023-12-02T01:29:46.812564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:57:41.631704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278766+0000","last_change":"2023-12-02T01:29:44.350480+0000","last_active":"2023-12-02T01:29:46.278766+0000","last_peered":"2023-12-02T01:29:46.278766+0000","last_clean":"2023-12-02T01:29:46.278766+0000","last_became_active":"2023-12-02T01:29:44.350151+0000","last_became_peered":"2023-12-02T01:29:44.350151+0000","last_unstale":"2023-12-02T01:29:46.278766+0000","last_undegraded":"2023-12-02T01:29:46.278766+0000","last_fullsized":"2023-12-02T01:29:46.278766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863103+0000","last_change":"2023-12-02T01:29:45.295690+0000","last_active":"2023-12-02T01:29:46.863103+0000","last_peered":"2023-12-02T01:29:46.863103+0000","last_clean":"2023-12-02T01:29:46.863103+0000","last_became_active":"2023-12-02T01:29:45.295369+0000","last_became_peered":"2023-12-02T01:29:45.295369+0000","last_unstale":"2023-12-02T01:29:46.863103+0000","last_undegraded":"2023-12-02T01:29:46.863103+0000","last_fullsized":"2023-12-02T01:29:46.863103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:40:06.285555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277571+0000","last_change":"2023-12-02T01:29:44.345332+0000","last_active":"2023-12-02T01:29:46.277571+0000","last_peered":"2023-12-02T01:29:46.277571+0000","last_clean":"2023-12-02T01:29:46.277571+0000","last_became_active":"2023-12-02T01:29:44.344979+0000","last_became_peered":"2023-12-02T01:29:44.344979+0000","last_unstale":"2023-12-02T01:29:46.277571+0000","last_undegraded":"2023-12-02T01:29:46.277571+0000","last_fullsized":"2023-12-02T01:29:46.277571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:56:20.601142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.812247+0000","last_change":"2023-12-02T01:29:45.298734+0000","last_active":"2023-12-02T01:29:46.812247+0000","last_peered":"2023-12-02T01:29:46.812247+0000","last_clean":"2023-12-02T01:29:46.812247+0000","last_became_active":"2023-12-02T01:29:45.298413+0000","last_became_peered":"2023-12-02T01:29:45.298413+0000","last_unstale":"2023-12-02T01:29:46.812247+0000","last_undegraded":"2023-12-02T01:29:46.812247+0000","last_fullsized":"2023-12-02T01:29:46.812247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:40:06.285555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:45.281966+0000","last_change":"2023-12-02T01:29:33.915833+0000","last_active":"2023-12-02T01:29:45.281966+0000","last_peered":"2023-12-02T01:29:45.281966+0000","last_clean":"2023-12-02T01:29:45.281966+0000","last_became_active":"2023-12-02T01:29:33.915012+0000","last_became_peered":"2023-12-02T01:29:33.915012+0000","last_unstale":"2023-12-02T01:29:45.281966+0000","last_undegraded":"2023-12-02T01:29:45.281966+0000","last_fullsized":"2023-12-02T01:29:45.281966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_clean_scrub_stamp":"2023-12-02T01:29:32.688531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:25:40.082821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654093+0000","last_change":"2023-12-02T01:29:44.348495+0000","last_active":"2023-12-02T01:29:46.654093+0000","last_peered":"2023-12-02T01:29:46.654093+0000","last_clean":"2023-12-02T01:29:46.654093+0000","last_became_active":"2023-12-02T01:29:44.347921+0000","last_became_peered":"2023-12-02T01:29:44.347921+0000","last_unstale":"2023-12-02T01:29:46.654093+0000","last_undegraded":"2023-12-02T01:29:46.654093+0000","last_fullsized":"2023-12-02T01:29:46.654093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862033+0000","last_change":"2023-12-02T01:29:45.298682+0000","last_active":"2023-12-02T01:29:46.862033+0000","last_peered":"2023-12-02T01:29:46.862033+0000","last_clean":"2023-12-02T01:29:46.862033+0000","last_became_active":"2023-12-02T01:29:45.298430+0000","last_became_peered":"2023-12-02T01:29:45.298430+0000","last_unstale":"2023-12-02T01:29:46.862033+0000","last_undegraded":"2023-12-02T01:29:46.862033+0000","last_fullsized":"2023-12-02T01:29:46.862033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654022+0000","last_change":"2023-12-02T01:29:44.356428+0000","last_active":"2023-12-02T01:29:46.654022+0000","last_peered":"2023-12-02T01:29:46.654022+0000","last_clean":"2023-12-02T01:29:46.654022+0000","last_became_active":"2023-12-02T01:29:44.356144+0000","last_became_peered":"2023-12-02T01:29:44.356144+0000","last_unstale":"2023-12-02T01:29:46.654022+0000","last_undegraded":"2023-12-02T01:29:46.654022+0000","last_fullsized":"2023-12-02T01:29:46.654022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:47:54.153379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504303+0000","last_change":"2023-12-02T01:29:45.291319+0000","last_active":"2023-12-02T01:29:46.504303+0000","last_peered":"2023-12-02T01:29:46.504303+0000","last_clean":"2023-12-02T01:29:46.504303+0000","last_became_active":"2023-12-02T01:29:45.291009+0000","last_became_peered":"2023-12-02T01:29:45.291009+0000","last_unstale":"2023-12-02T01:29:46.504303+0000","last_undegraded":"2023-12-02T01:29:46.504303+0000","last_fullsized":"2023-12-02T01:29:46.504303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:38:07.658204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.277465+0000","last_change":"2023-12-02T01:29:44.344424+0000","last_active":"2023-12-02T01:29:46.277465+0000","last_peered":"2023-12-02T01:29:46.277465+0000","last_clean":"2023-12-02T01:29:46.277465+0000","last_became_active":"2023-12-02T01:29:44.344133+0000","last_became_peered":"2023-12-02T01:29:44.344133+0000","last_unstale":"2023-12-02T01:29:46.277465+0000","last_undegraded":"2023-12-02T01:29:46.277465+0000","last_fullsized":"2023-12-02T01:29:46.277465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:59:58.483054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278607+0000","last_change":"2023-12-02T01:29:45.287869+0000","last_active":"2023-12-02T01:29:46.278607+0000","last_peered":"2023-12-02T01:29:46.278607+0000","last_clean":"2023-12-02T01:29:46.278607+0000","last_became_active":"2023-12-02T01:29:45.287600+0000","last_became_peered":"2023-12-02T01:29:45.287600+0000","last_unstale":"2023-12-02T01:29:46.278607+0000","last_undegraded":"2023-12-02T01:29:46.278607+0000","last_fullsized":"2023-12-02T01:29:46.278607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654073+0000","last_change":"2023-12-02T01:29:44.349176+0000","last_active":"2023-12-02T01:29:46.654073+0000","last_peered":"2023-12-02T01:29:46.654073+0000","last_clean":"2023-12-02T01:29:46.654073+0000","last_became_active":"2023-12-02T01:29:44.347726+0000","last_became_peered":"2023-12-02T01:29:44.347726+0000","last_unstale":"2023-12-02T01:29:46.654073+0000","last_undegraded":"2023-12-02T01:29:46.654073+0000","last_fullsized":"2023-12-02T01:29:46.654073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:31:13.495997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279304+0000","last_change":"2023-12-02T01:29:45.290437+0000","last_active":"2023-12-02T01:29:46.279304+0000","last_peered":"2023-12-02T01:29:46.279304+0000","last_clean":"2023-12-02T01:29:46.279304+0000","last_became_active":"2023-12-02T01:29:45.290093+0000","last_became_peered":"2023-12-02T01:29:45.290093+0000","last_unstale":"2023-12-02T01:29:46.279304+0000","last_undegraded":"2023-12-02T01:29:46.279304+0000","last_fullsized":"2023-12-02T01:29:46.279304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:15.348786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278769+0000","last_change":"2023-12-02T01:29:44.348440+0000","last_active":"2023-12-02T01:29:46.278769+0000","last_peered":"2023-12-02T01:29:46.278769+0000","last_clean":"2023-12-02T01:29:46.278769+0000","last_became_active":"2023-12-02T01:29:44.348165+0000","last_became_peered":"2023-12-02T01:29:44.348165+0000","last_unstale":"2023-12-02T01:29:46.278769+0000","last_undegraded":"2023-12-02T01:29:46.278769+0000","last_fullsized":"2023-12-02T01:29:46.278769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:20.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863332+0000","last_change":"2023-12-02T01:29:45.295551+0000","last_active":"2023-12-02T01:29:46.863332+0000","last_peered":"2023-12-02T01:29:46.863332+0000","last_clean":"2023-12-02T01:29:46.863332+0000","last_became_active":"2023-12-02T01:29:45.295164+0000","last_became_peered":"2023-12-02T01:29:45.295164+0000","last_unstale":"2023-12-02T01:29:46.863332+0000","last_undegraded":"2023-12-02T01:29:46.863332+0000","last_fullsized":"2023-12-02T01:29:46.863332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:01:53.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654273+0000","last_change":"2023-12-02T01:29:44.354009+0000","last_active":"2023-12-02T01:29:46.654273+0000","last_peered":"2023-12-02T01:29:46.654273+0000","last_clean":"2023-12-02T01:29:46.654273+0000","last_became_active":"2023-12-02T01:29:44.353730+0000","last_became_peered":"2023-12-02T01:29:44.353730+0000","last_unstale":"2023-12-02T01:29:46.654273+0000","last_undegraded":"2023-12-02T01:29:46.654273+0000","last_fullsized":"2023-12-02T01:29:46.654273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:09:56.926421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278706+0000","last_change":"2023-12-02T01:29:45.288340+0000","last_active":"2023-12-02T01:29:46.278706+0000","last_peered":"2023-12-02T01:29:46.278706+0000","last_clean":"2023-12-02T01:29:46.278706+0000","last_became_active":"2023-12-02T01:29:45.288025+0000","last_became_peered":"2023-12-02T01:29:45.288025+0000","last_unstale":"2023-12-02T01:29:46.278706+0000","last_undegraded":"2023-12-02T01:29:46.278706+0000","last_fullsized":"2023-12-02T01:29:46.278706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:43:42.685461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.650260+0000","last_change":"2023-12-02T01:29:44.356197+0000","last_active":"2023-12-02T01:29:46.650260+0000","last_peered":"2023-12-02T01:29:46.650260+0000","last_clean":"2023-12-02T01:29:46.650260+0000","last_became_active":"2023-12-02T01:29:44.355856+0000","last_became_peered":"2023-12-02T01:29:44.355856+0000","last_unstale":"2023-12-02T01:29:46.650260+0000","last_undegraded":"2023-12-02T01:29:46.650260+0000","last_fullsized":"2023-12-02T01:29:46.650260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862318+0000","last_change":"2023-12-02T01:29:45.295847+0000","last_active":"2023-12-02T01:29:46.862318+0000","last_peered":"2023-12-02T01:29:46.862318+0000","last_clean":"2023-12-02T01:29:46.862318+0000","last_became_active":"2023-12-02T01:29:45.293122+0000","last_became_peered":"2023-12-02T01:29:45.293122+0000","last_unstale":"2023-12-02T01:29:46.862318+0000","last_undegraded":"2023-12-02T01:29:46.862318+0000","last_fullsized":"2023-12-02T01:29:46.862318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:28.995866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.651638+0000","last_change":"2023-12-02T01:29:44.352578+0000","last_active":"2023-12-02T01:29:46.651638+0000","last_peered":"2023-12-02T01:29:46.651638+0000","last_clean":"2023-12-02T01:29:46.651638+0000","last_became_active":"2023-12-02T01:29:44.352301+0000","last_became_peered":"2023-12-02T01:29:44.352301+0000","last_unstale":"2023-12-02T01:29:46.651638+0000","last_undegraded":"2023-12-02T01:29:46.651638+0000","last_fullsized":"2023-12-02T01:29:46.651638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504710+0000","last_change":"2023-12-02T01:29:45.289358+0000","last_active":"2023-12-02T01:29:46.504710+0000","last_peered":"2023-12-02T01:29:46.504710+0000","last_clean":"2023-12-02T01:29:46.504710+0000","last_became_active":"2023-12-02T01:29:45.288764+0000","last_became_peered":"2023-12-02T01:29:45.288764+0000","last_unstale":"2023-12-02T01:29:46.504710+0000","last_undegraded":"2023-12-02T01:29:46.504710+0000","last_fullsized":"2023-12-02T01:29:46.504710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:01:02.267077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654001+0000","last_change":"2023-12-02T01:29:44.353622+0000","last_active":"2023-12-02T01:29:46.654001+0000","last_peered":"2023-12-02T01:29:46.654001+0000","last_clean":"2023-12-02T01:29:46.654001+0000","last_became_active":"2023-12-02T01:29:44.353356+0000","last_became_peered":"2023-12-02T01:29:44.353356+0000","last_unstale":"2023-12-02T01:29:46.654001+0000","last_undegraded":"2023-12-02T01:29:46.654001+0000","last_fullsized":"2023-12-02T01:29:46.654001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:38:56.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.279022+0000","last_change":"2023-12-02T01:29:45.289816+0000","last_active":"2023-12-02T01:29:46.279022+0000","last_peered":"2023-12-02T01:29:46.279022+0000","last_clean":"2023-12-02T01:29:46.279022+0000","last_became_active":"2023-12-02T01:29:45.289305+0000","last_became_peered":"2023-12-02T01:29:45.289305+0000","last_unstale":"2023-12-02T01:29:46.279022+0000","last_undegraded":"2023-12-02T01:29:46.279022+0000","last_fullsized":"2023-12-02T01:29:46.279022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:33:02.730761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278678+0000","last_change":"2023-12-02T01:29:44.356341+0000","last_active":"2023-12-02T01:29:46.278678+0000","last_peered":"2023-12-02T01:29:46.278678+0000","last_clean":"2023-12-02T01:29:46.278678+0000","last_became_active":"2023-12-02T01:29:44.355976+0000","last_became_peered":"2023-12-02T01:29:44.355976+0000","last_unstale":"2023-12-02T01:29:46.278678+0000","last_undegraded":"2023-12-02T01:29:46.278678+0000","last_fullsized":"2023-12-02T01:29:46.278678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:25:28.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.861932+0000","last_change":"2023-12-02T01:29:45.293848+0000","last_active":"2023-12-02T01:29:46.861932+0000","last_peered":"2023-12-02T01:29:46.861932+0000","last_clean":"2023-12-02T01:29:46.861932+0000","last_became_active":"2023-12-02T01:29:45.293579+0000","last_became_peered":"2023-12-02T01:29:45.293579+0000","last_unstale":"2023-12-02T01:29:46.861932+0000","last_undegraded":"2023-12-02T01:29:46.861932+0000","last_fullsized":"2023-12-02T01:29:46.861932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.278841+0000","last_change":"2023-12-02T01:29:44.353369+0000","last_active":"2023-12-02T01:29:46.278841+0000","last_peered":"2023-12-02T01:29:46.278841+0000","last_clean":"2023-12-02T01:29:46.278841+0000","last_became_active":"2023-12-02T01:29:44.352947+0000","last_became_peered":"2023-12-02T01:29:44.352947+0000","last_unstale":"2023-12-02T01:29:46.278841+0000","last_undegraded":"2023-12-02T01:29:46.278841+0000","last_fullsized":"2023-12-02T01:29:46.278841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:59:27.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862112+0000","last_change":"2023-12-02T01:29:45.285988+0000","last_active":"2023-12-02T01:29:46.862112+0000","last_peered":"2023-12-02T01:29:46.862112+0000","last_clean":"2023-12-02T01:29:46.862112+0000","last_became_active":"2023-12-02T01:29:45.285710+0000","last_became_peered":"2023-12-02T01:29:45.285710+0000","last_unstale":"2023-12-02T01:29:46.862112+0000","last_undegraded":"2023-12-02T01:29:46.862112+0000","last_fullsized":"2023-12-02T01:29:46.862112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:26:30.525933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654144+0000","last_change":"2023-12-02T01:29:44.351734+0000","last_active":"2023-12-02T01:29:46.654144+0000","last_peered":"2023-12-02T01:29:46.654144+0000","last_clean":"2023-12-02T01:29:46.654144+0000","last_became_active":"2023-12-02T01:29:44.351459+0000","last_became_peered":"2023-12-02T01:29:44.351459+0000","last_unstale":"2023-12-02T01:29:46.654144+0000","last_undegraded":"2023-12-02T01:29:46.654144+0000","last_fullsized":"2023-12-02T01:29:46.654144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:20:35.264962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862270+0000","last_change":"2023-12-02T01:29:45.292288+0000","last_active":"2023-12-02T01:29:46.862270+0000","last_peered":"2023-12-02T01:29:46.862270+0000","last_clean":"2023-12-02T01:29:46.862270+0000","last_became_active":"2023-12-02T01:29:45.291969+0000","last_became_peered":"2023-12-02T01:29:45.291969+0000","last_unstale":"2023-12-02T01:29:46.862270+0000","last_undegraded":"2023-12-02T01:29:46.862270+0000","last_fullsized":"2023-12-02T01:29:46.862270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.743006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863256+0000","last_change":"2023-12-02T01:29:45.297737+0000","last_active":"2023-12-02T01:29:46.863256+0000","last_peered":"2023-12-02T01:29:46.863256+0000","last_clean":"2023-12-02T01:29:46.863256+0000","last_became_active":"2023-12-02T01:29:45.297288+0000","last_became_peered":"2023-12-02T01:29:45.297288+0000","last_unstale":"2023-12-02T01:29:46.863256+0000","last_undegraded":"2023-12-02T01:29:46.863256+0000","last_fullsized":"2023-12-02T01:29:46.863256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:43.782344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654165+0000","last_change":"2023-12-02T01:29:44.351702+0000","last_active":"2023-12-02T01:29:46.654165+0000","last_peered":"2023-12-02T01:29:46.654165+0000","last_clean":"2023-12-02T01:29:46.654165+0000","last_became_active":"2023-12-02T01:29:44.351340+0000","last_became_peered":"2023-12-02T01:29:44.351340+0000","last_unstale":"2023-12-02T01:29:46.654165+0000","last_undegraded":"2023-12-02T01:29:46.654165+0000","last_fullsized":"2023-12-02T01:29:46.654165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:38:20.079698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.863072+0000","last_change":"2023-12-02T01:29:45.296949+0000","last_active":"2023-12-02T01:29:46.863072+0000","last_peered":"2023-12-02T01:29:46.863072+0000","last_clean":"2023-12-02T01:29:46.863072+0000","last_became_active":"2023-12-02T01:29:45.296653+0000","last_became_peered":"2023-12-02T01:29:45.296653+0000","last_unstale":"2023-12-02T01:29:46.863072+0000","last_undegraded":"2023-12-02T01:29:46.863072+0000","last_fullsized":"2023-12-02T01:29:46.863072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:42:36.390155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.654224+0000","last_change":"2023-12-02T01:29:44.354118+0000","last_active":"2023-12-02T01:29:46.654224+0000","last_peered":"2023-12-02T01:29:46.654224+0000","last_clean":"2023-12-02T01:29:46.654224+0000","last_became_active":"2023-12-02T01:29:44.353835+0000","last_became_peered":"2023-12-02T01:29:44.353835+0000","last_unstale":"2023-12-02T01:29:46.654224+0000","last_undegraded":"2023-12-02T01:29:46.654224+0000","last_fullsized":"2023-12-02T01:29:46.654224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504573+0000","last_change":"2023-12-02T01:29:45.295870+0000","last_active":"2023-12-02T01:29:46.504573+0000","last_peered":"2023-12-02T01:29:46.504573+0000","last_clean":"2023-12-02T01:29:46.504573+0000","last_became_active":"2023-12-02T01:29:45.295589+0000","last_became_peered":"2023-12-02T01:29:45.295589+0000","last_unstale":"2023-12-02T01:29:46.504573+0000","last_undegraded":"2023-12-02T01:29:46.504573+0000","last_fullsized":"2023-12-02T01:29:46.504573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:08:00.721857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.658014+0000","last_change":"2023-12-02T01:29:44.352609+0000","last_active":"2023-12-02T01:29:46.658014+0000","last_peered":"2023-12-02T01:29:46.658014+0000","last_clean":"2023-12-02T01:29:46.658014+0000","last_became_active":"2023-12-02T01:29:44.352295+0000","last_became_peered":"2023-12-02T01:29:44.352295+0000","last_unstale":"2023-12-02T01:29:46.658014+0000","last_undegraded":"2023-12-02T01:29:46.658014+0000","last_fullsized":"2023-12-02T01:29:46.658014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:45:58.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.862220+0000","last_change":"2023-12-02T01:29:45.287684+0000","last_active":"2023-12-02T01:29:46.862220+0000","last_peered":"2023-12-02T01:29:46.862220+0000","last_clean":"2023-12-02T01:29:46.862220+0000","last_became_active":"2023-12-02T01:29:45.287406+0000","last_became_peered":"2023-12-02T01:29:45.287406+0000","last_unstale":"2023-12-02T01:29:46.862220+0000","last_undegraded":"2023-12-02T01:29:46.862220+0000","last_fullsized":"2023-12-02T01:29:46.862220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:44.328813+0000","last_clean_scrub_stamp":"2023-12-02T01:29:44.328813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:49:49.983849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-02T01:29:46.504719+0000","last_change":"2023-12-02T01:29:44.354342+0000","last_active":"2023-12-02T01:29:46.504719+0000","last_peered":"2023-12-02T01:29:46.504719+0000","last_clean":"2023-12-02T01:29:46.504719+0000","last_became_active":"2023-12-02T01:29:44.353999+0000","last_became_peered":"2023-12-02T01:29:44.353999+0000","last_unstale":"2023-12-02T01:29:46.504719+0000","last_undegraded":"2023-12-02T01:29:46.504719+0000","last_fullsized":"2023-12-02T01:29:46.504719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:43.322043+0000","last_clean_scrub_stamp":"2023-12-02T01:29:43.322043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:48:14.342016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-02T01:29:53.102 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-02T01:29:53.102 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-02T01:29:53.102 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-02T01:29:53.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-02T01:29:53.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.242+0000 7f125be48640 1 Processor -- start 2023-12-02T01:29:53.244 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.242+0000 7f125be48640 1 -- start start 2023-12-02T01:29:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f125be48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 0x7f12540b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f125be48640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12540b4aa0 con 0x7f12540b4640 2023-12-02T01:29:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f125be48640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125406de80 con 0x7f125415bf60 2023-12-02T01:29:53.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f125be48640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125415c3d0 con 0x7f125413e2d0 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f12593e3640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f12540b4640 0x7f125415b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47312/0 (socket says 172.21.15.1:47312) 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f12593e3640 1 -- 172.21.15.1:0/2428719591 learned_addr learned my addr 172.21.15.1:0/2428719591 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1259be4640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 0x7f12540b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004661308 0 0) 0x7f12540b4aa0 con 0x7f12540b4640 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1240003520 con 0x7f12540b4640 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248643445 0 0) 0x7f125406de80 con 0x7f125415bf60 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12540b4aa0 con 0x7f125415bf60 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2998993934 0 0) 0x7f1240003520 con 0x7f12540b4640 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 msgr2=0x7f12540b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 0x7f12540b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.243+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 >> v1:172.21.15.167:6789/0 conn(0x7f125415bf60 legacy=0x7f12540cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125406d5c0 con 0x7f12540b4640 2023-12-02T01:29:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f1244001670 con 0x7f12540b4640 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1259be4640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 0x7f12540b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 >> v1:172.21.15.1:6789/0 conn(0x7f12540b4640 legacy=0x7f125415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1240003b30 0x7f1240003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 0x7f12400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240004d00 0x7f1240005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125415c3d0 con 0x7f1240003b30 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124000ba30 con 0x7f1240004d00 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124000bb70 con 0x7f125413e2d0 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1259be4640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1240003b30 0x7f1240003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f12593e3640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 0x7f12400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f125a3e5640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240004d00 0x7f1240005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1259be4640 1 -- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 msgr2=0x7f12400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1259be4640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f125413e2d0 0x7f12400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1259be4640 1 -- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240004d00 msgr2=0x7f1240005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1259be4640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240004d00 0x7f1240005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f1259be4640 1 -- 172.21.15.1:0/2428719591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250009400 con 0x7f1240003b30 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.244+0000 7f125a3e5640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240004d00 0x7f1240005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f1259be4640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1240003b30 0x7f1240003f30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1250009cc0 tx=0x7f12400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e83b013955f810 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125002c8f0 con 0x7f1240003b30 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125002ca50 con 0x7f1240003b30 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f1258be2640 1 -- 172.21.15.1:0/2428719591 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125002ce00 con 0x7f1240003b30 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f125be48640 1 -- 172.21.15.1:0/2428719591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1240003b30 msgr2=0x7f1240003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f125be48640 1 --2- 172.21.15.1:0/2428719591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1240003b30 0x7f1240003f30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1250009cc0 tx=0x7f12400057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f125a3e5640 1 -- 172.21.15.1:0/2428719591 reap_dead start 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f125be48640 1 -- 172.21.15.1:0/2428719591 shutdown_connections 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.245+0000 7f125be48640 1 -- 172.21.15.1:0/2428719591 >> 172.21.15.1:0/2428719591 conn(0x7f12540b0af0 msgr2=0x7f12540b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.246+0000 7f125be48640 1 -- 172.21.15.1:0/2428719591 shutdown_connections 2023-12-02T01:29:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.246+0000 7f125be48640 1 -- 172.21.15.1:0/2428719591 wait complete. 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 Processor -- start 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 -- start start 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240003b30 0x7f1254155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1254156bc0 0x7f12541f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12541f45b0 0x7f12541535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f4a60 con 0x7f12541f45b0 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254152880 con 0x7f1240003b30 2023-12-02T01:29:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.247+0000 7f125be48640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1254152af0 con 0x7f1254156bc0 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12541f45b0 0x7f12541535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12541f45b0 0x7f12541535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59554/0 (socket says 172.21.15.1:59554) 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 -- 172.21.15.1:0/1609066778 learned_addr learned my addr 172.21.15.1:0/1609066778 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f1259be4640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240003b30 0x7f1254155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f12593e3640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1254156bc0 0x7f12541f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 -- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1254156bc0 msgr2=0x7f12541f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1254156bc0 0x7f12541f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 -- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240003b30 msgr2=0x7f1254155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240003b30 0x7f1254155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 -- 172.21.15.1:0/1609066778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254152dd0 con 0x7f12541f45b0 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f12593e3640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1254156bc0 0x7f12541f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f1259be4640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240003b30 0x7f1254155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:53.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125a3e5640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12541f45b0 0x7f12541535d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1254159290 tx=0x7f124c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f124a7fc640 1 -- 172.21.15.1:0/1609066778 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c017070 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f124a7fc640 1 -- 172.21.15.1:0/1609066778 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c00ee50 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12541530b0 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f124a7fc640 1 -- 172.21.15.1:0/1609066778 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c003b80 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.248+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1254157320 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.249+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1254067420 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.250+0000 7f124a7fc640 1 -- 172.21.15.1:0/1609066778 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f124c003ce0 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.250+0000 7f124a7fc640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f123806ae40 0x7f123806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.250+0000 7f124a7fc640 1 -- 172.21.15.1:0/1609066778 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f124c088ba0 con 0x7f12541f45b0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.250+0000 7f1259be4640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f123806ae40 0x7f123806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.255 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.251+0000 7f1259be4640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f123806ae40 0x7f123806d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1250036000 tx=0x7f1250030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.256 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.254+0000 7f124a7fc640 1 -- 172.21.15.1:0/1609066778 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f124c0576e0 con 0x7f12541f45b0 2023-12-02T01:29:53.474 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.473+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f12540b1750 con 0x7f12541f45b0 2023-12-02T01:29:53.475 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.473+0000 7f124a7fc640 1 -- 172.21.15.1:0/1609066778 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f124c057270 con 0x7f12541f45b0 2023-12-02T01:29:53.475 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:53.475 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-02T01:29:53.476 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f123806ae40 msgr2=0x7f123806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f123806ae40 0x7f123806d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1250036000 tx=0x7f1250030000 comp rx=0 tx=0).stop 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12541f45b0 msgr2=0x7f12541535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12541f45b0 0x7f12541535d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1254159290 tx=0x7f124c00ec00 comp rx=0 tx=0).stop 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 shutdown_connections 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12541f45b0 0x7f12541535d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1254156bc0 0x7f12541f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f123806ae40 0x7f123806d300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 --2- 172.21.15.1:0/1609066778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240003b30 0x7f1254155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 >> 172.21.15.1:0/1609066778 conn(0x7f12540b0af0 msgr2=0x7f12540aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 shutdown_connections 2023-12-02T01:29:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.475+0000 7f125be48640 1 -- 172.21.15.1:0/1609066778 wait complete. 2023-12-02T01:29:53.487 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-02T01:29:53.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:53.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.591+0000 7f0d38bf5640 1 Processor -- start 2023-12-02T01:29:53.593 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.591+0000 7f0d38bf5640 1 -- start start 2023-12-02T01:29:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d38bf5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d3415d3e0 0x7f0d340ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d38bf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340ced30 0x7f0d340d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d38bf5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340b5f90 con 0x7f0d340d1c60 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d38bf5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340cf170 con 0x7f0d3415d3e0 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d38bf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340d20f0 con 0x7f0d340ced30 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d3259c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d3415d3e0 0x7f0d340ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d3259c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0d3415d3e0 0x7f0d340ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59570/0 (socket says 172.21.15.1:59570) 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d32d9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0d340d1c60 0x7f0d340b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47314/0 (socket says 172.21.15.1:47314) 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.592+0000 7f0d3259c640 1 -- 172.21.15.1:0/3466167218 learned_addr learned my addr 172.21.15.1:0/3466167218 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.593+0000 7f0d31d9b640 1 --2- 172.21.15.1:0/3466167218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340ced30 0x7f0d340d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.593+0000 7f0d3259c640 1 -- 172.21.15.1:0/3466167218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340ced30 msgr2=0x7f0d340d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.593+0000 7f0d3259c640 1 --2- 172.21.15.1:0/3466167218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340ced30 0x7f0d340d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.593+0000 7f0d3259c640 1 -- 172.21.15.1:0/3466167218 >> v1:172.21.15.1:6789/0 conn(0x7f0d340d1c60 legacy=0x7f0d340b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.593+0000 7f0d3159a640 1 -- 172.21.15.1:0/3466167218 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478719462 0 0) 0x7f0d340b5f90 con 0x7f0d340d1c60 2023-12-02T01:29:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.593+0000 7f0d3259c640 1 -- 172.21.15.1:0/3466167218 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340b61e0 con 0x7f0d3415d3e0 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.593+0000 7f0d3259c640 1 --2- 172.21.15.1:0/3466167218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340ce7f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c2143b647776e server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d3159a640 1 -- 172.21.15.1:0/3466167218 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c030840 con 0x7f0d3415d3e0 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d3159a640 1 -- 172.21.15.1:0/3466167218 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0309a0 con 0x7f0d3415d3e0 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d3159a640 1 -- 172.21.15.1:0/3466167218 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c030d30 con 0x7f0d3415d3e0 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 -- 172.21.15.1:0/3466167218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 msgr2=0x7f0d340ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/3466167218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340ce7f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009870 tx=0x7f0d2c02b980 comp rx=0 tx=0).stop 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 -- 172.21.15.1:0/3466167218 shutdown_connections 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/3466167218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340ced30 0x7f0d340d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/3466167218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340ce7f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 -- 172.21.15.1:0/3466167218 >> 172.21.15.1:0/3466167218 conn(0x7f0d3409c480 msgr2=0x7f0d340d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:53.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 -- 172.21.15.1:0/3466167218 shutdown_connections 2023-12-02T01:29:53.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.594+0000 7f0d38bf5640 1 -- 172.21.15.1:0/3466167218 wait complete. 2023-12-02T01:29:53.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 Processor -- start 2023-12-02T01:29:53.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 -- start start 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d340ced30 0x7f0d3414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340d1c60 0x7f0d3414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3414c810 con 0x7f0d3415d3e0 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3414faa0 con 0x7f0d340ced30 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d38bf5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340a0bd0 con 0x7f0d340d1c60 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d32d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d32d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59582/0 (socket says 172.21.15.1:59582) 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.596+0000 7f0d32d9d640 1 -- 172.21.15.1:0/583978143 learned_addr learned my addr 172.21.15.1:0/583978143 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d3259c640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d340ced30 0x7f0d3414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d31d9b640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340d1c60 0x7f0d3414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d32d9d640 1 -- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340d1c60 msgr2=0x7f0d3414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d32d9d640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340d1c60 0x7f0d3414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d32d9d640 1 -- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d340ced30 msgr2=0x7f0d3414c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d32d9d640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d340ced30 0x7f0d3414c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d32d9d640 1 -- 172.21.15.1:0/583978143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0094d0 con 0x7f0d3415d3e0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d3259c640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d340ced30 0x7f0d3414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d32d9d640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340cb6a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c7e0 tx=0x7f0d2400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d2affd640 1 -- 172.21.15.1:0/583978143 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400a640 con 0x7f0d3415d3e0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d2affd640 1 -- 172.21.15.1:0/583978143 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400a7c0 con 0x7f0d3415d3e0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d340a0eb0 con 0x7f0d3415d3e0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d2affd640 1 -- 172.21.15.1:0/583978143 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400ab70 con 0x7f0d3415d3e0 2023-12-02T01:29:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.597+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3414ce80 con 0x7f0d3415d3e0 2023-12-02T01:29:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.598+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d34067420 con 0x7f0d3415d3e0 2023-12-02T01:29:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.598+0000 7f0d2affd640 1 -- 172.21.15.1:0/583978143 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d2400acd0 con 0x7f0d3415d3e0 2023-12-02T01:29:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.599+0000 7f0d2affd640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0d1406ae70 0x7f0d1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.599+0000 7f0d2affd640 1 -- 172.21.15.1:0/583978143 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d24088ae0 con 0x7f0d3415d3e0 2023-12-02T01:29:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.599+0000 7f0d3259c640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0d1406ae70 0x7f0d1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.600+0000 7f0d3259c640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0d1406ae70 0x7f0d1406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c036000 tx=0x7f0d2c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.605 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.603+0000 7f0d2affd640 1 -- 172.21.15.1:0/583978143 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d24053b10 con 0x7f0d3415d3e0 2023-12-02T01:29:53.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.779+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d340d2350 con 0x7f0d3415d3e0 2023-12-02T01:29:53.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.781+0000 7f0d2affd640 1 -- 172.21.15.1:0/583978143 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f0d24057130 con 0x7f0d3415d3e0 2023-12-02T01:29:53.782 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:53.783 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:53.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0d1406ae70 msgr2=0x7f0d1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0d1406ae70 0x7f0d1406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c036000 tx=0x7f0d2c03b040 comp rx=0 tx=0).stop 2023-12-02T01:29:53.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 msgr2=0x7f0d340cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340cb6a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c7e0 tx=0x7f0d2400cca0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 shutdown_connections 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d3415d3e0 0x7f0d340cb6a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d340d1c60 0x7f0d3414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0d1406ae70 0x7f0d1406d330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.782+0000 7f0d38bf5640 1 --2- 172.21.15.1:0/583978143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d340ced30 0x7f0d3414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.783+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 >> 172.21.15.1:0/583978143 conn(0x7f0d3409c480 msgr2=0x7f0d3406c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.783+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 shutdown_connections 2023-12-02T01:29:53.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.783+0000 7f0d38bf5640 1 -- 172.21.15.1:0/583978143 wait complete. 2023-12-02T01:29:53.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:29:53.796 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:29:53.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.902+0000 7f3185a75640 1 Processor -- start 2023-12-02T01:29:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.902+0000 7f3185a75640 1 -- start start 2023-12-02T01:29:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f3185a75640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31800d1570 0x7f31800b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f3185a75640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f31800cef00 0x7f3180161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f3185a75640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31800ce360 con 0x7f3180160b70 2023-12-02T01:29:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f3185a75640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31800d19f0 con 0x7f31800cef00 2023-12-02T01:29:53.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f3185a75640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31800cdd50 con 0x7f31800d1570 2023-12-02T01:29:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f317ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f31800cef00 0x7f3180161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f317f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3180160b70 0x7f31800ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47326/0 (socket says 172.21.15.1:47326) 2023-12-02T01:29:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.903+0000 7f317f7fe640 1 -- 172.21.15.1:0/1719010618 learned_addr learned my addr 172.21.15.1:0/1719010618 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317ffff640 1 -- 172.21.15.1:0/1719010618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31800d1570 msgr2=0x7f31800b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317effd640 1 --2- 172.21.15.1:0/1719010618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31800d1570 0x7f31800b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317e7fc640 1 -- 172.21.15.1:0/1719010618 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444077362 0 0) 0x7f31800ce360 con 0x7f3180160b70 2023-12-02T01:29:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317ffff640 1 --2- 172.21.15.1:0/1719010618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31800d1570 0x7f31800b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317ffff640 1 -- 172.21.15.1:0/1719010618 >> v1:172.21.15.1:6789/0 conn(0x7f3180160b70 legacy=0x7f31800ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317ffff640 1 -- 172.21.15.1:0/1719010618 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800d1c70 con 0x7f31800cef00 2023-12-02T01:29:53.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317ffff640 1 --2- 172.21.15.1:0/1719010618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800cef00 0x7f3180161230 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3178009d90 tx=0x7f317802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f70234738788d8a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.915 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317e7fc640 1 -- 172.21.15.1:0/1719010618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317802cc50 con 0x7f31800cef00 2023-12-02T01:29:53.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317e7fc640 1 -- 172.21.15.1:0/1719010618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317802cdb0 con 0x7f31800cef00 2023-12-02T01:29:53.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.904+0000 7f317e7fc640 1 -- 172.21.15.1:0/1719010618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3178034660 con 0x7f31800cef00 2023-12-02T01:29:53.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 -- 172.21.15.1:0/1719010618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800cef00 msgr2=0x7f3180161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 --2- 172.21.15.1:0/1719010618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800cef00 0x7f3180161230 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3178009d90 tx=0x7f317802bea0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.916 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 -- 172.21.15.1:0/1719010618 shutdown_connections 2023-12-02T01:29:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 --2- 172.21.15.1:0/1719010618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31800d1570 0x7f31800b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 --2- 172.21.15.1:0/1719010618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800cef00 0x7f3180161230 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 -- 172.21.15.1:0/1719010618 >> 172.21.15.1:0/1719010618 conn(0x7f318009c470 msgr2=0x7f31800d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 -- 172.21.15.1:0/1719010618 shutdown_connections 2023-12-02T01:29:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.905+0000 7f3185a75640 1 -- 172.21.15.1:0/1719010618 wait complete. 2023-12-02T01:29:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.906+0000 7f3185a75640 1 Processor -- start 2023-12-02T01:29:53.917 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.906+0000 7f3185a75640 1 -- start start 2023-12-02T01:29:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f3185a75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31800cef00 0x7f31801595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f3185a75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800d1570 0x7f318015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f3185a75640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3180160b70 0x7f31801f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f3185a75640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31801f7bf0 con 0x7f31800d1570 2023-12-02T01:29:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f3185a75640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31801f7630 con 0x7f31800cef00 2023-12-02T01:29:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f3185a75640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31801f7910 con 0x7f3180160b70 2023-12-02T01:29:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800d1570 0x7f318015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800d1570 0x7f318015eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59614/0 (socket says 172.21.15.1:59614) 2023-12-02T01:29:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 -- 172.21.15.1:0/1235456812 learned_addr learned my addr 172.21.15.1:0/1235456812 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317ffff640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3180160b70 0x7f31801f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317f7fe640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31800cef00 0x7f31801595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 -- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3180160b70 msgr2=0x7f31801f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3180160b70 0x7f31801f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 -- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31800cef00 msgr2=0x7f31801595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31800cef00 0x7f31801595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:53.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317effd640 1 -- 172.21.15.1:0/1235456812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178009a70 con 0x7f31800d1570 2023-12-02T01:29:53.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317ffff640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3180160b70 0x7f31801f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:53.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.907+0000 7f317f7fe640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31800cef00 0x7f31801595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:53.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.908+0000 7f317effd640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800d1570 0x7f318015eca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f317400c7f0 tx=0x7f317400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.908+0000 7f3167fff640 1 -- 172.21.15.1:0/1235456812 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174004220 con 0x7f31800d1570 2023-12-02T01:29:53.922 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.908+0000 7f3167fff640 1 -- 172.21.15.1:0/1235456812 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3174004380 con 0x7f31800d1570 2023-12-02T01:29:53.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.908+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318009d6e0 con 0x7f31800d1570 2023-12-02T01:29:53.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.908+0000 7f3167fff640 1 -- 172.21.15.1:0/1235456812 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174007840 con 0x7f31800d1570 2023-12-02T01:29:53.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.908+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318015f1e0 con 0x7f31800d1570 2023-12-02T01:29:53.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.909+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318015f400 con 0x7f31800d1570 2023-12-02T01:29:53.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.909+0000 7f3167fff640 1 -- 172.21.15.1:0/1235456812 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3174007bb0 con 0x7f31800d1570 2023-12-02T01:29:53.923 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.910+0000 7f3167fff640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f316c06ae40 0x7f316c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:53.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.910+0000 7f3167fff640 1 -- 172.21.15.1:0/1235456812 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3174089510 con 0x7f31800d1570 2023-12-02T01:29:53.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.910+0000 7f317f7fe640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f316c06ae40 0x7f316c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:53.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.910+0000 7f317f7fe640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f316c06ae40 0x7f316c06d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3170000f60 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:53.924 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:53.914+0000 7f3167fff640 1 -- 172.21.15.1:0/1235456812 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f318015f400 con 0x7f31800d1570 2023-12-02T01:29:54.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.088+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f318009d540 con 0x7f31800d1570 2023-12-02T01:29:54.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.088+0000 7f3167fff640 1 -- 172.21.15.1:0/1235456812 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f317401e020 con 0x7f31800d1570 2023-12-02T01:29:54.090 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f316c06ae40 msgr2=0x7f316c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f316c06ae40 0x7f316c06d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3170000f60 tx=0x7f3170009040 comp rx=0 tx=0).stop 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800d1570 msgr2=0x7f318015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800d1570 0x7f318015eca0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f317400c7f0 tx=0x7f317400ccb0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 shutdown_connections 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3180160b70 0x7f31801f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31800d1570 0x7f318015eca0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f316c06ae40 0x7f316c06d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 --2- 172.21.15.1:0/1235456812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31800cef00 0x7f31801595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 >> 172.21.15.1:0/1235456812 conn(0x7f318009c470 msgr2=0x7f318006c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:54.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 shutdown_connections 2023-12-02T01:29:54.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.090+0000 7f3185a75640 1 -- 172.21.15.1:0/1235456812 wait complete. 2023-12-02T01:29:54.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:29:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.210+0000 7fecbafec640 1 Processor -- start 2023-12-02T01:29:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.210+0000 7fecbafec640 1 -- start start 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecbafec640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fecb406ec60 0x7fecb415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecbafec640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb409a720 con 0x7fecb415d690 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecbafec640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb4099b10 con 0x7fecb406e460 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecbafec640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb415e9d0 con 0x7fecb406ec60 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecb8d88640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fecb406ec60 0x7fecb415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecb8d88640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fecb406ec60 0x7fecb415e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59618/0 (socket says 172.21.15.1:59618) 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecb8d88640 1 -- 172.21.15.1:0/130653490 learned_addr learned my addr 172.21.15.1:0/130653490 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecb8d88640 1 -- 172.21.15.1:0/130653490 >> v1:172.21.15.167:6789/0 conn(0x7fecb406e460 legacy=0x7fecb40cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecb8d88640 1 -- 172.21.15.1:0/130653490 >> v1:172.21.15.1:6789/0 conn(0x7fecb415d690 legacy=0x7fecb406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecb8d88640 1 -- 172.21.15.1:0/130653490 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4099df0 con 0x7fecb406ec60 2023-12-02T01:29:54.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.211+0000 7fecab7fe640 1 -- 172.21.15.1:0/130653490 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914828022 0 0) 0x7fecb409a720 con 0x7fecb415d690 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.212+0000 7fecb8d88640 1 --2- 172.21.15.1:0/130653490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb415e490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009870 tx=0x7fecb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f6fff734646adc server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.212+0000 7fecab7fe640 1 -- 172.21.15.1:0/130653490 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0031870 con 0x7fecb406ec60 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.212+0000 7fecab7fe640 1 -- 172.21.15.1:0/130653490 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb00319d0 con 0x7fecb406ec60 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.212+0000 7fecab7fe640 1 -- 172.21.15.1:0/130653490 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0031d60 con 0x7fecb406ec60 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.213+0000 7fecbafec640 1 -- 172.21.15.1:0/130653490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 msgr2=0x7fecb415e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.213+0000 7fecbafec640 1 --2- 172.21.15.1:0/130653490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb415e490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009870 tx=0x7fecb002b910 comp rx=0 tx=0).stop 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.213+0000 7fecbafec640 1 -- 172.21.15.1:0/130653490 shutdown_connections 2023-12-02T01:29:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.213+0000 7fecbafec640 1 --2- 172.21.15.1:0/130653490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb415e490 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.213+0000 7fecbafec640 1 -- 172.21.15.1:0/130653490 >> 172.21.15.1:0/130653490 conn(0x7fecb40b2a20 msgr2=0x7fecb40b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.213+0000 7fecbafec640 1 -- 172.21.15.1:0/130653490 shutdown_connections 2023-12-02T01:29:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.213+0000 7fecbafec640 1 -- 172.21.15.1:0/130653490 wait complete. 2023-12-02T01:29:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.214+0000 7fecbafec640 1 Processor -- start 2023-12-02T01:29:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.214+0000 7fecbafec640 1 -- start start 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecbafec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e460 0x7fecb40c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecbafec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb40c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecbafec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb4154be0 0x7fecb40c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecbafec640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415eb40 con 0x7fecb406ec60 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecbafec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40b6540 con 0x7fecb406e460 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecbafec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40b6820 con 0x7fecb4154be0 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb40c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb40c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59632/0 (socket says 172.21.15.1:59632) 2023-12-02T01:29:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 -- 172.21.15.1:0/3450807912 learned_addr learned my addr 172.21.15.1:0/3450807912 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecb9589640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb4154be0 0x7fecb40c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecb8d88640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e460 0x7fecb40c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 -- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb4154be0 msgr2=0x7fecb40c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb4154be0 0x7fecb40c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 -- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e460 msgr2=0x7fecb40c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e460 0x7fecb40c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 -- 172.21.15.1:0/3450807912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb00094d0 con 0x7fecb406ec60 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecabfff640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb40c5220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feca400c3e0 tx=0x7feca400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7feca97fa640 1 -- 172.21.15.1:0/3450807912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40035f0 con 0x7fecb406ec60 2023-12-02T01:29:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7feca97fa640 1 -- 172.21.15.1:0/3450807912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4003750 con 0x7fecb406ec60 2023-12-02T01:29:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb40b6b00 con 0x7fecb406ec60 2023-12-02T01:29:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.215+0000 7feca97fa640 1 -- 172.21.15.1:0/3450807912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4003b20 con 0x7fecb406ec60 2023-12-02T01:29:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.216+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb4155700 con 0x7fecb406ec60 2023-12-02T01:29:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.217+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb415efd0 con 0x7fecb406ec60 2023-12-02T01:29:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.217+0000 7feca97fa640 1 -- 172.21.15.1:0/3450807912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feca4003c80 con 0x7fecb406ec60 2023-12-02T01:29:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.217+0000 7feca97fa640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7feca006ae40 0x7feca006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.217+0000 7feca97fa640 1 -- 172.21.15.1:0/3450807912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feca4088d40 con 0x7fecb406ec60 2023-12-02T01:29:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.217+0000 7fecb8d88640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7feca006ae40 0x7feca006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.218+0000 7fecb8d88640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7feca006ae40 0x7feca006d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fecb0036000 tx=0x7fecb003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.222+0000 7feca97fa640 1 -- 172.21.15.1:0/3450807912 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feca4053cd0 con 0x7fecb406ec60 2023-12-02T01:29:54.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.398+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fecb40b6c90 con 0x7fecb406ec60 2023-12-02T01:29:54.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.398+0000 7feca97fa640 1 -- 172.21.15.1:0/3450807912 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7feca40572f0 con 0x7fecb406ec60 2023-12-02T01:29:54.400 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7feca006ae40 msgr2=0x7feca006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7feca006ae40 0x7feca006d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fecb0036000 tx=0x7fecb003c040 comp rx=0 tx=0).stop 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 msgr2=0x7fecb40c5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb40c5220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feca400c3e0 tx=0x7feca400c8a0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 shutdown_connections 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb4154be0 0x7fecb40c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb406ec60 0x7fecb40c5220 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7feca006ae40 0x7feca006d300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 --2- 172.21.15.1:0/3450807912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e460 0x7fecb40c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 >> 172.21.15.1:0/3450807912 conn(0x7fecb40b2a20 msgr2=0x7fecb40ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:54.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 shutdown_connections 2023-12-02T01:29:54.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.400+0000 7fecbafec640 1 -- 172.21.15.1:0/3450807912 wait complete. 2023-12-02T01:29:54.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:29:54.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.521+0000 7fc8074d7640 1 Processor -- start 2023-12-02T01:29:54.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.521+0000 7fc8074d7640 1 -- start start 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc8074d7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc80015d690 0x7fc80015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc8074d7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc80006e460 0x7fc8000cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc8074d7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80009a720 con 0x7fc80006ec60 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc8074d7640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80015e9d0 con 0x7fc80006e460 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc8074d7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc800099b10 con 0x7fc80015d690 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc805a74640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc80006e460 0x7fc8000cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc805a74640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc80006e460 0x7fc8000cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59638/0 (socket says 172.21.15.1:59638) 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc805a74640 1 -- 172.21.15.1:0/899444566 learned_addr learned my addr 172.21.15.1:0/899444566 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc804a72640 1 --2- 172.21.15.1:0/899444566 >> v2:172.21.15.167:3300/0 conn(0x7fc80015d690 0x7fc80015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc805a74640 1 -- 172.21.15.1:0/899444566 >> v2:172.21.15.167:3300/0 conn(0x7fc80015d690 msgr2=0x7fc80015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:54.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc805a74640 1 --2- 172.21.15.1:0/899444566 >> v2:172.21.15.167:3300/0 conn(0x7fc80015d690 0x7fc80015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc805a74640 1 -- 172.21.15.1:0/899444566 >> v1:172.21.15.167:6789/0 conn(0x7fc80006ec60 legacy=0x7fc80006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.525 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.522+0000 7fc805a74640 1 -- 172.21.15.1:0/899444566 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800099df0 con 0x7fc80006e460 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.523+0000 7fc805a74640 1 --2- 172.21.15.1:0/899444566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc80006e460 0x7fc8000cf480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc800071e10 tx=0x7fc7f802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309d4e268c77418 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.523+0000 7fc7f7fff640 1 -- 172.21.15.1:0/899444566 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f802ca80 con 0x7fc80006e460 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.523+0000 7fc7f7fff640 1 -- 172.21.15.1:0/899444566 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f802cbe0 con 0x7fc80006e460 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.523+0000 7fc7f7fff640 1 -- 172.21.15.1:0/899444566 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80343f0 con 0x7fc80006e460 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 -- 172.21.15.1:0/899444566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc80006e460 msgr2=0x7fc8000cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 --2- 172.21.15.1:0/899444566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc80006e460 0x7fc8000cf480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc800071e10 tx=0x7fc7f802bee0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 -- 172.21.15.1:0/899444566 shutdown_connections 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 --2- 172.21.15.1:0/899444566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc80006e460 0x7fc8000cf480 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 --2- 172.21.15.1:0/899444566 >> v2:172.21.15.167:3300/0 conn(0x7fc80015d690 0x7fc80015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 -- 172.21.15.1:0/899444566 >> 172.21.15.1:0/899444566 conn(0x7fc8000b2a20 msgr2=0x7fc8000b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:54.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 -- 172.21.15.1:0/899444566 shutdown_connections 2023-12-02T01:29:54.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.524+0000 7fc8074d7640 1 -- 172.21.15.1:0/899444566 wait complete. 2023-12-02T01:29:54.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.525+0000 7fc8074d7640 1 Processor -- start 2023-12-02T01:29:54.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.525+0000 7fc8074d7640 1 -- start start 2023-12-02T01:29:54.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc8074d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc80006e460 0x7fc800154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc8074d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc80006ec60 0x7fc8000c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc8074d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8001616b0 0x7fc8000c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc8074d7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000c67e0 con 0x7fc8001616b0 2023-12-02T01:29:54.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc8074d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc800160400 con 0x7fc80006e460 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc8074d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8000b3bf0 con 0x7fc80006ec60 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8001616b0 0x7fc8000c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8001616b0 0x7fc8000c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59654/0 (socket says 172.21.15.1:59654) 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 -- 172.21.15.1:0/3869969614 learned_addr learned my addr 172.21.15.1:0/3869969614 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805273640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc80006e460 0x7fc800154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc804a72640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc80006ec60 0x7fc8000c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 -- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc80006ec60 msgr2=0x7fc8000c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc80006ec60 0x7fc8000c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 -- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc80006e460 msgr2=0x7fc800154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc80006e460 0x7fc800154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 -- 172.21.15.1:0/3869969614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009b30 con 0x7fc8001616b0 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc805a74640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8001616b0 0x7fc8000c62a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8036040 tx=0x7fc7f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/3869969614 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8009510 con 0x7fc8001616b0 2023-12-02T01:29:54.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/3869969614 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f803e450 con 0x7fc8001616b0 2023-12-02T01:29:54.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.526+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8000b3ed0 con 0x7fc8001616b0 2023-12-02T01:29:54.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.527+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/3869969614 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f803e800 con 0x7fc8001616b0 2023-12-02T01:29:54.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.527+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8000b4490 con 0x7fc8001616b0 2023-12-02T01:29:54.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.528+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8000b4680 con 0x7fc8001616b0 2023-12-02T01:29:54.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.528+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/3869969614 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7f802cd50 con 0x7fc8001616b0 2023-12-02T01:29:54.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.529+0000 7fc7f5ffb640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7e406ae40 0x7fc7e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.529+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/3869969614 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7f80abfd0 con 0x7fc8001616b0 2023-12-02T01:29:54.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.529+0000 7fc805273640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7e406ae40 0x7fc7e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.529+0000 7fc805273640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7e406ae40 0x7fc7e406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000f60 tx=0x7fc7fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.533+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/3869969614 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7f8077130 con 0x7fc8001616b0 2023-12-02T01:29:54.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.708+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc80009f040 con 0x7fc8001616b0 2023-12-02T01:29:54.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.709+0000 7fc7f5ffb640 1 -- 172.21.15.1:0/3869969614 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7f807a750 con 0x7fc8001616b0 2023-12-02T01:29:54.711 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7e406ae40 msgr2=0x7fc7e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7e406ae40 0x7fc7e406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000f60 tx=0x7fc7fc009040 comp rx=0 tx=0).stop 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8001616b0 msgr2=0x7fc8000c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8001616b0 0x7fc8000c62a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8036040 tx=0x7fc7f8004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 shutdown_connections 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8001616b0 0x7fc8000c62a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc80006ec60 0x7fc8000c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7e406ae40 0x7fc7e406d300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 --2- 172.21.15.1:0/3869969614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc80006e460 0x7fc800154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 >> 172.21.15.1:0/3869969614 conn(0x7fc8000b2a20 msgr2=0x7fc80006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 shutdown_connections 2023-12-02T01:29:54.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.711+0000 7fc8074d7640 1 -- 172.21.15.1:0/3869969614 wait complete. 2023-12-02T01:29:54.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:29:54.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.828+0000 7f8041925640 1 Processor -- start 2023-12-02T01:29:54.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.828+0000 7f8041925640 1 -- start start 2023-12-02T01:29:54.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f8041925640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f803c0cce70 0x7f803c099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f8041925640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d1c50 0x7f803c099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f8041925640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0d03a0 con 0x7f803c0d0ab0 2023-12-02T01:29:54.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f8041925640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c06bfa0 con 0x7f803c0cce70 2023-12-02T01:29:54.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f8041925640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c06f9d0 con 0x7f803c0d1c50 2023-12-02T01:29:54.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f803c0cce70 0x7f803c099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f803c0cce70 0x7f803c099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59666/0 (socket says 172.21.15.1:59666) 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803affd640 1 -- 172.21.15.1:0/1313238913 learned_addr learned my addr 172.21.15.1:0/1313238913 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803b7fe640 1 --2- 172.21.15.1:0/1313238913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d1c50 0x7f803c099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803affd640 1 -- 172.21.15.1:0/1313238913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d1c50 msgr2=0x7f803c099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803affd640 1 --2- 172.21.15.1:0/1313238913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d1c50 0x7f803c099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803affd640 1 -- 172.21.15.1:0/1313238913 >> v1:172.21.15.167:6789/0 conn(0x7f803c0d0ab0 legacy=0x7f803c06e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.829+0000 7f803affd640 1 -- 172.21.15.1:0/1313238913 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c06c190 con 0x7f803c0cce70 2023-12-02T01:29:54.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.830+0000 7f803affd640 1 --2- 172.21.15.1:0/1313238913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0cce70 0x7f803c099970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f802c009870 tx=0x7f802c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524e8a4c7b7a7aa3 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.830+0000 7f803a7fc640 1 -- 172.21.15.1:0/1313238913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c030840 con 0x7f803c0cce70 2023-12-02T01:29:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.830+0000 7f803a7fc640 1 -- 172.21.15.1:0/1313238913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c0309a0 con 0x7f803c0cce70 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.830+0000 7f803a7fc640 1 -- 172.21.15.1:0/1313238913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c030d30 con 0x7f803c0cce70 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 -- 172.21.15.1:0/1313238913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0cce70 msgr2=0x7f803c099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 --2- 172.21.15.1:0/1313238913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0cce70 0x7f803c099970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f802c009870 tx=0x7f802c02b980 comp rx=0 tx=0).stop 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 -- 172.21.15.1:0/1313238913 shutdown_connections 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 --2- 172.21.15.1:0/1313238913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d1c50 0x7f803c099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 --2- 172.21.15.1:0/1313238913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0cce70 0x7f803c099970 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 -- 172.21.15.1:0/1313238913 >> 172.21.15.1:0/1313238913 conn(0x7f803c0d0f20 msgr2=0x7f803c0d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 -- 172.21.15.1:0/1313238913 shutdown_connections 2023-12-02T01:29:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.831+0000 7f8041925640 1 -- 172.21.15.1:0/1313238913 wait complete. 2023-12-02T01:29:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.832+0000 7f8041925640 1 Processor -- start 2023-12-02T01:29:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.832+0000 7f8041925640 1 -- start start 2023-12-02T01:29:54.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f8041925640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c0cce70 0x7f803c155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f8041925640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d0ab0 0x7f803c0c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f8041925640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0d1c50 0x7f803c0c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f8041925640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0c7920 con 0x7f803c0d1c50 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f8041925640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0c9c20 con 0x7f803c0cce70 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f8041925640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0c9f00 con 0x7f803c0d0ab0 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0d1c50 0x7f803c0c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0d1c50 0x7f803c0c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59672/0 (socket says 172.21.15.1:59672) 2023-12-02T01:29:54.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 -- 172.21.15.1:0/902731244 learned_addr learned my addr 172.21.15.1:0/902731244 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803affd640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c0cce70 0x7f803c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f8033fff640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d0ab0 0x7f803c0c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 -- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d0ab0 msgr2=0x7f803c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d0ab0 0x7f803c0c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 -- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c0cce70 msgr2=0x7f803c155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c0cce70 0x7f803c155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 -- 172.21.15.1:0/902731244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0094d0 con 0x7f803c0d1c50 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.833+0000 7f803b7fe640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0d1c50 0x7f803c0c6fe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f803400efc0 tx=0x7f803400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.834+0000 7f8038ff9640 1 -- 172.21.15.1:0/902731244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034009b20 con 0x7f803c0d1c50 2023-12-02T01:29:54.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.834+0000 7f8038ff9640 1 -- 172.21.15.1:0/902731244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803400f040 con 0x7f803c0d1c50 2023-12-02T01:29:54.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.834+0000 7f8038ff9640 1 -- 172.21.15.1:0/902731244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340146c0 con 0x7f803c0d1c50 2023-12-02T01:29:54.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.834+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c0ca1e0 con 0x7f803c0d1c50 2023-12-02T01:29:54.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.834+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c0ca7a0 con 0x7f803c0d1c50 2023-12-02T01:29:54.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.835+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c0ca9c0 con 0x7f803c0d1c50 2023-12-02T01:29:54.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.835+0000 7f8038ff9640 1 -- 172.21.15.1:0/902731244 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8034014820 con 0x7f803c0d1c50 2023-12-02T01:29:54.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.835+0000 7f8038ff9640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f801c06ae40 0x7f801c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:54.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.836+0000 7f8038ff9640 1 -- 172.21.15.1:0/902731244 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f803408a250 con 0x7f803c0d1c50 2023-12-02T01:29:54.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.836+0000 7f803affd640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f801c06ae40 0x7f801c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:54.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.836+0000 7f803affd640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f801c06ae40 0x7f801c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f802c036000 tx=0x7f802c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:54.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:54.840+0000 7f8038ff9640 1 -- 172.21.15.1:0/902731244 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80340553b0 con 0x7f803c0d1c50 2023-12-02T01:29:55.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.050+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f803c067420 con 0x7f803c0d1c50 2023-12-02T01:29:55.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.051+0000 7f8038ff9640 1 -- 172.21.15.1:0/902731244 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f8034009e60 con 0x7f803c0d1c50 2023-12-02T01:29:55.052 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:55.052 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:29:55.053 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:29:55.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f801c06ae40 msgr2=0x7f801c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f801c06ae40 0x7f801c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f802c036000 tx=0x7f802c008030 comp rx=0 tx=0).stop 2023-12-02T01:29:55.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0d1c50 msgr2=0x7f803c0c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0d1c50 0x7f803c0c6fe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f803400efc0 tx=0x7f803400c490 comp rx=0 tx=0).stop 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 shutdown_connections 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803c0d1c50 0x7f803c0c6fe0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c0d0ab0 0x7f803c0c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f801c06ae40 0x7f801c06d300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 --2- 172.21.15.1:0/902731244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c0cce70 0x7f803c155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.052+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 >> 172.21.15.1:0/902731244 conn(0x7f803c0d0f20 msgr2=0x7f803c0cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.053+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 shutdown_connections 2023-12-02T01:29:55.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.053+0000 7f8041925640 1 -- 172.21.15.1:0/902731244 wait complete. 2023-12-02T01:29:55.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:55.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.170+0000 7fd9d69f5640 1 Processor -- start 2023-12-02T01:29:55.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.170+0000 7fd9d69f5640 1 -- start start 2023-12-02T01:29:55.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.170+0000 7fd9d69f5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd9d00b4810 0x7fd9d015b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.170+0000 7fd9d69f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d00cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.170+0000 7fd9d69f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d006de80 con 0x7fd9d013e2d0 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.170+0000 7fd9d69f5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d015fc60 con 0x7fd9d00b4810 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.170+0000 7fd9d69f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d006d5c0 con 0x7fd9d015bd90 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9cf7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd9d00b4810 0x7fd9d015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9cf7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd9d00b4810 0x7fd9d015b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59686/0 (socket says 172.21.15.1:59686) 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2076295388 learned_addr learned my addr 172.21.15.1:0/2076295388 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9d4f92640 1 --2- 172.21.15.1:0/2076295388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d00cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2076295388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 msgr2=0x7fd9d00cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9cf7fe640 1 --2- 172.21.15.1:0/2076295388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d00cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2076295388 >> v1:172.21.15.167:6789/0 conn(0x7fd9d013e2d0 legacy=0x7fd9d00b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:55.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.171+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2076295388 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d006d830 con 0x7fd9d00b4810 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9cf7fe640 1 --2- 172.21.15.1:0/2076295388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d00b4810 0x7fd9d015b850 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009870 tx=0x7fd9c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a079e68344345caa server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9ceffd640 1 -- 172.21.15.1:0/2076295388 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0031640 con 0x7fd9d00b4810 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9ceffd640 1 -- 172.21.15.1:0/2076295388 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c00317a0 con 0x7fd9d00b4810 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9ceffd640 1 -- 172.21.15.1:0/2076295388 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0031b30 con 0x7fd9d00b4810 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2076295388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d00b4810 msgr2=0x7fd9d015b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2076295388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d00b4810 0x7fd9d015b850 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009870 tx=0x7fd9c002b8f0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2076295388 shutdown_connections 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2076295388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d00cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2076295388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d00b4810 0x7fd9d015b850 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2076295388 >> 172.21.15.1:0/2076295388 conn(0x7fd9d00b0af0 msgr2=0x7fd9d00b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:55.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2076295388 shutdown_connections 2023-12-02T01:29:55.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.172+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2076295388 wait complete. 2023-12-02T01:29:55.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.173+0000 7fd9d69f5640 1 Processor -- start 2023-12-02T01:29:55.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9d69f5640 1 -- start start 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9d69f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9d00b4810 0x7fd9d0153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9d69f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d013e2d0 0x7fd9d0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9d69f5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d0155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9d69f5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b3aa0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9d69f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b2ba0 con 0x7fd9d00b4810 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9d69f5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b3ec0 con 0x7fd9d015bd90 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d013e2d0 0x7fd9d0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d013e2d0 0x7fd9d0154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59688/0 (socket says 172.21.15.1:59688) 2023-12-02T01:29:55.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.174+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2909809337 learned_addr learned my addr 172.21.15.1:0/2909809337 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9d4f92640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d0155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9cffff640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9d00b4810 0x7fd9d0153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 msgr2=0x7fd9d0155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9cf7fe640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d0155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9d00b4810 msgr2=0x7fd9d0153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9cf7fe640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9d00b4810 0x7fd9d0153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9cf7fe640 1 -- 172.21.15.1:0/2909809337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00094d0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9cf7fe640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d013e2d0 0x7fd9d0154b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009870 tx=0x7fd9c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9ccff9640 1 -- 172.21.15.1:0/2909809337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c003ac60 con 0x7fd9d013e2d0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9ccff9640 1 -- 172.21.15.1:0/2909809337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c003adc0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d006e490 con 0x7fd9d013e2d0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9ccff9640 1 -- 172.21.15.1:0/2909809337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0044630 con 0x7fd9d013e2d0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.175+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d00b3100 con 0x7fd9d013e2d0 2023-12-02T01:29:55.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.176+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d006e2f0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.176+0000 7fd9ccff9640 1 -- 172.21.15.1:0/2909809337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9c002f050 con 0x7fd9d013e2d0 2023-12-02T01:29:55.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.177+0000 7fd9ccff9640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd9bc06ae40 0x7fd9bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.177+0000 7fd9ccff9640 1 -- 172.21.15.1:0/2909809337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9c00ab2b0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.177+0000 7fd9cffff640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd9bc06ae40 0x7fd9bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.177+0000 7fd9cffff640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd9bc06ae40 0x7fd9bc06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4004f60 tx=0x7fd9c4007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.181+0000 7fd9ccff9640 1 -- 172.21.15.1:0/2909809337 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9d006e2f0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.359+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d00b3be0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.360+0000 7fd9ccff9640 1 -- 172.21.15.1:0/2909809337 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fd9d00b3be0 con 0x7fd9d013e2d0 2023-12-02T01:29:55.362 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:55.362 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:55.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd9bc06ae40 msgr2=0x7fd9bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd9bc06ae40 0x7fd9bc06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4004f60 tx=0x7fd9c4007e30 comp rx=0 tx=0).stop 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d013e2d0 msgr2=0x7fd9d0154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d013e2d0 0x7fd9d0154b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009870 tx=0x7fd9c00046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 shutdown_connections 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9d015bd90 0x7fd9d0155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9d013e2d0 0x7fd9d0154b10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd9bc06ae40 0x7fd9bc06d300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 --2- 172.21.15.1:0/2909809337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9d00b4810 0x7fd9d0153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 >> 172.21.15.1:0/2909809337 conn(0x7fd9d00b0af0 msgr2=0x7fd9d015b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 shutdown_connections 2023-12-02T01:29:55.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.362+0000 7fd9d69f5640 1 -- 172.21.15.1:0/2909809337 wait complete. 2023-12-02T01:29:55.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:29:55.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:29:55.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.483+0000 7fdc4edb0640 1 Processor -- start 2023-12-02T01:29:55.484 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.483+0000 7fdc4edb0640 1 -- start start 2023-12-02T01:29:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.483+0000 7fdc4edb0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc4813f750 0x7fdc4815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4edb0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdc48070630 0x7fdc48070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4edb0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc480ce060 con 0x7fdc4813fb30 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4edb0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480cec70 con 0x7fdc48070630 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4edb0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480ce340 con 0x7fdc4813f750 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4d34d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdc48070630 0x7fdc48070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4d34d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdc48070630 0x7fdc48070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59702/0 (socket says 172.21.15.1:59702) 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3107543434 learned_addr learned my addr 172.21.15.1:0/3107543434 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc47fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdc4813fb30 0x7fdc480cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47338/0 (socket says 172.21.15.1:47338) 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4cb4c640 1 --2- 172.21.15.1:0/3107543434 >> v2:172.21.15.167:3300/0 conn(0x7fdc4813f750 0x7fdc4815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3107543434 >> v2:172.21.15.167:3300/0 conn(0x7fdc4813f750 msgr2=0x7fdc4815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4d34d640 1 --2- 172.21.15.1:0/3107543434 >> v2:172.21.15.167:3300/0 conn(0x7fdc4813f750 0x7fdc4815b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3107543434 >> v1:172.21.15.1:6789/0 conn(0x7fdc4813fb30 legacy=0x7fdc480cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3107543434 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480ce620 con 0x7fdc48070630 2023-12-02T01:29:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.484+0000 7fdc477fe640 1 -- 172.21.15.1:0/3107543434 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005650020 0 0) 0x7fdc480ce060 con 0x7fdc4813fb30 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc4d34d640 1 --2- 172.21.15.1:0/3107543434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc48070630 0x7fdc48070ac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc48071f40 tx=0x7fdc4002e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27f2a7a8b81aac8 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc477fe640 1 -- 172.21.15.1:0/3107543434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000b0d0 con 0x7fdc48070630 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc477fe640 1 -- 172.21.15.1:0/3107543434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000b230 con 0x7fdc48070630 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc477fe640 1 -- 172.21.15.1:0/3107543434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40009600 con 0x7fdc48070630 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3107543434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc48070630 msgr2=0x7fdc48070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3107543434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc48070630 0x7fdc48070ac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc48071f40 tx=0x7fdc4002e180 comp rx=0 tx=0).stop 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3107543434 shutdown_connections 2023-12-02T01:29:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3107543434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc48070630 0x7fdc48070ac0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3107543434 >> v2:172.21.15.167:3300/0 conn(0x7fdc4813f750 0x7fdc4815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.485+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3107543434 >> 172.21.15.1:0/3107543434 conn(0x7fdc4806a8f0 msgr2=0x7fdc4806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:55.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.486+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3107543434 shutdown_connections 2023-12-02T01:29:55.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.486+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3107543434 wait complete. 2023-12-02T01:29:55.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.487+0000 7fdc4edb0640 1 Processor -- start 2023-12-02T01:29:55.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.487+0000 7fdc4edb0640 1 -- start start 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc48070630 0x7fdc4812f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4813f750 0x7fdc48156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc4813fb30 0x7fdc480ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4815d360 con 0x7fdc4813fb30 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4815d640 con 0x7fdc4813f750 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4815d920 con 0x7fdc48070630 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc4813fb30 0x7fdc480ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc4813fb30 0x7fdc480ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59712/0 (socket says 172.21.15.1:59712) 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3040437439 learned_addr learned my addr 172.21.15.1:0/3040437439 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4cb4c640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc48070630 0x7fdc4812f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc47fff640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4813f750 0x7fdc48156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc48070630 msgr2=0x7fdc4812f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc48070630 0x7fdc4812f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4813f750 msgr2=0x7fdc48156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4813f750 0x7fdc48156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 -- 172.21.15.1:0/3040437439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4000bd40 con 0x7fdc4813fb30 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4d34d640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc4813fb30 0x7fdc480ad6f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc40038040 tx=0x7fdc40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc457fa640 1 -- 172.21.15.1:0/3040437439 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000b0d0 con 0x7fdc4813fb30 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc457fa640 1 -- 172.21.15.1:0/3040437439 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40036800 con 0x7fdc4813fb30 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc457fa640 1 -- 172.21.15.1:0/3040437439 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40036bb0 con 0x7fdc4813fb30 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4815ac50 con 0x7fdc4813fb30 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.488+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4813c6a0 con 0x7fdc4813fb30 2023-12-02T01:29:55.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.489+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc48072ae0 con 0x7fdc4813fb30 2023-12-02T01:29:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.490+0000 7fdc457fa640 1 -- 172.21.15.1:0/3040437439 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc40036d10 con 0x7fdc4813fb30 2023-12-02T01:29:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.490+0000 7fdc457fa640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdc2c06ae40 0x7fdc2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.490+0000 7fdc457fa640 1 -- 172.21.15.1:0/3040437439 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc400ac900 con 0x7fdc4813fb30 2023-12-02T01:29:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.490+0000 7fdc4cb4c640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdc2c06ae40 0x7fdc2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.491+0000 7fdc4cb4c640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdc2c06ae40 0x7fdc2c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c006fd0 tx=0x7fdc3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.495+0000 7fdc457fa640 1 -- 172.21.15.1:0/3040437439 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc40077920 con 0x7fdc4813fb30 2023-12-02T01:29:55.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.671+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc4804e920 con 0x7fdc4813fb30 2023-12-02T01:29:55.673 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.672+0000 7fdc457fa640 1 -- 172.21.15.1:0/3040437439 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc4000b720 con 0x7fdc4813fb30 2023-12-02T01:29:55.674 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdc2c06ae40 msgr2=0x7fdc2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdc2c06ae40 0x7fdc2c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c006fd0 tx=0x7fdc3c008040 comp rx=0 tx=0).stop 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc4813fb30 msgr2=0x7fdc480ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc4813fb30 0x7fdc480ad6f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc40038040 tx=0x7fdc40004a40 comp rx=0 tx=0).stop 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 shutdown_connections 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc4813fb30 0x7fdc480ad6f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdc2c06ae40 0x7fdc2c06d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc4813f750 0x7fdc48156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 --2- 172.21.15.1:0/3040437439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc48070630 0x7fdc4812f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 >> 172.21.15.1:0/3040437439 conn(0x7fdc4806a8f0 msgr2=0x7fdc48070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:55.676 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 shutdown_connections 2023-12-02T01:29:55.677 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.674+0000 7fdc4edb0640 1 -- 172.21.15.1:0/3040437439 wait complete. 2023-12-02T01:29:55.686 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:29:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.793+0000 7fd8800e5640 1 Processor -- start 2023-12-02T01:29:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.793+0000 7fd8800e5640 1 -- start start 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd8800e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd87815d7b0 0x7fd8780cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd8800e5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd8780d0050 0x7fd8780b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd8800e5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd8780b0ea0 0x7fd8780b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd8800e5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8780d04d0 con 0x7fd8780d0050 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd8800e5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8780b04d0 con 0x7fd8780b0ea0 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd8800e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780d1e40 con 0x7fd87815d7b0 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd8780d0050 0x7fd8780b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd8780d0050 0x7fd8780b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59724/0 (socket says 172.21.15.1:59724) 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 -- 172.21.15.1:0/193190419 learned_addr learned my addr 172.21.15.1:0/193190419 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87de81640 1 --2- 172.21.15.1:0/193190419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd87815d7b0 0x7fd8780cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 -- 172.21.15.1:0/193190419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd87815d7b0 msgr2=0x7fd8780cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87e682640 1 --2- 172.21.15.1:0/193190419 >> v2:172.21.15.167:3300/0 conn(0x7fd8780b0ea0 0x7fd8780b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 --2- 172.21.15.1:0/193190419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd87815d7b0 0x7fd8780cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 -- 172.21.15.1:0/193190419 >> v2:172.21.15.167:3300/0 conn(0x7fd8780b0ea0 msgr2=0x7fd8780b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 --2- 172.21.15.1:0/193190419 >> v2:172.21.15.167:3300/0 conn(0x7fd8780b0ea0 0x7fd8780b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.794+0000 7fd87d680640 1 -- 172.21.15.1:0/193190419 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780afe80 con 0x7fd8780d0050 2023-12-02T01:29:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.795+0000 7fd87d680640 1 --2- 172.21.15.1:0/193190419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8780d0050 0x7fd8780b0960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd8780d07f0 tx=0x7fd87402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dafda2a11792fe4 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.795+0000 7fd87ce7f640 1 -- 172.21.15.1:0/193190419 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874031870 con 0x7fd8780d0050 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.795+0000 7fd87ce7f640 1 -- 172.21.15.1:0/193190419 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8740319d0 con 0x7fd8780d0050 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.795+0000 7fd87ce7f640 1 -- 172.21.15.1:0/193190419 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874031d60 con 0x7fd8780d0050 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 -- 172.21.15.1:0/193190419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8780d0050 msgr2=0x7fd8780b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 --2- 172.21.15.1:0/193190419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8780d0050 0x7fd8780b0960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd8780d07f0 tx=0x7fd87402b910 comp rx=0 tx=0).stop 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 -- 172.21.15.1:0/193190419 shutdown_connections 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 --2- 172.21.15.1:0/193190419 >> v2:172.21.15.167:3300/0 conn(0x7fd8780b0ea0 0x7fd8780b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 --2- 172.21.15.1:0/193190419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8780d0050 0x7fd8780b0960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 --2- 172.21.15.1:0/193190419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd87815d7b0 0x7fd8780cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 -- 172.21.15.1:0/193190419 >> 172.21.15.1:0/193190419 conn(0x7fd87809c480 msgr2=0x7fd8780d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 -- 172.21.15.1:0/193190419 shutdown_connections 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.796+0000 7fd8800e5640 1 -- 172.21.15.1:0/193190419 wait complete. 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.797+0000 7fd8800e5640 1 Processor -- start 2023-12-02T01:29:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.797+0000 7fd8800e5640 1 -- start start 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd8800e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8780b0ea0 0x7fd878156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd8800e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8780d0050 0x7fd8780cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd8800e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87815d7b0 0x7fd87815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd8800e5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781573d0 con 0x7fd87815d7b0 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd8800e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780cd6d0 con 0x7fd8780d0050 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd8800e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd878159a90 con 0x7fd8780b0ea0 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87815d7b0 0x7fd87815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87815d7b0 0x7fd87815b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59734/0 (socket says 172.21.15.1:59734) 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 -- 172.21.15.1:0/152742251 learned_addr learned my addr 172.21.15.1:0/152742251 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:55.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87d680640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8780d0050 0x7fd8780cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87de81640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8780b0ea0 0x7fd878156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 -- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8780b0ea0 msgr2=0x7fd878156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8780b0ea0 0x7fd878156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 -- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8780d0050 msgr2=0x7fd8780cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8780d0050 0x7fd8780cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87e682640 1 -- 172.21.15.1:0/152742251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740094d0 con 0x7fd87815d7b0 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.798+0000 7fd87d680640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8780d0050 0x7fd8780cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.799+0000 7fd87e682640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87815d7b0 0x7fd87815b3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd87000ccf0 tx=0x7fd87000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.799+0000 7fd86a7fc640 1 -- 172.21.15.1:0/152742251 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870003b90 con 0x7fd87815d7b0 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.799+0000 7fd86a7fc640 1 -- 172.21.15.1:0/152742251 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd870003cf0 con 0x7fd87815d7b0 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.799+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8780cd3f0 con 0x7fd87815d7b0 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.799+0000 7fd86a7fc640 1 -- 172.21.15.1:0/152742251 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870004240 con 0x7fd87815d7b0 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.799+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd878159720 con 0x7fd87815d7b0 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.800+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd878159c00 con 0x7fd87815d7b0 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.800+0000 7fd86a7fc640 1 -- 172.21.15.1:0/152742251 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8700043a0 con 0x7fd87815d7b0 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.800+0000 7fd86a7fc640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd85c06ae40 0x7fd85c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:55.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.801+0000 7fd86a7fc640 1 -- 172.21.15.1:0/152742251 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd870012070 con 0x7fd87815d7b0 2023-12-02T01:29:55.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.801+0000 7fd87de81640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd85c06ae40 0x7fd85c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:55.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.801+0000 7fd87de81640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd85c06ae40 0x7fd85c06d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd86c006fd0 tx=0x7fd86c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:55.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.805+0000 7fd86a7fc640 1 -- 172.21.15.1:0/152742251 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd870055010 con 0x7fd87815d7b0 2023-12-02T01:29:55.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.981+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8780a1160 con 0x7fd87815d7b0 2023-12-02T01:29:55.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.981+0000 7fd86a7fc640 1 -- 172.21.15.1:0/152742251 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd870058630 con 0x7fd87815d7b0 2023-12-02T01:29:55.983 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:29:55.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd85c06ae40 msgr2=0x7fd85c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd85c06ae40 0x7fd85c06d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd86c006fd0 tx=0x7fd86c008040 comp rx=0 tx=0).stop 2023-12-02T01:29:55.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87815d7b0 msgr2=0x7fd87815b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:55.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87815d7b0 0x7fd87815b3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd87000ccf0 tx=0x7fd87000a660 comp rx=0 tx=0).stop 2023-12-02T01:29:55.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 shutdown_connections 2023-12-02T01:29:55.986 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd87815d7b0 0x7fd87815b3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd85c06ae40 0x7fd85c06d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8780d0050 0x7fd8780cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 --2- 172.21.15.1:0/152742251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8780b0ea0 0x7fd878156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:55.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 >> 172.21.15.1:0/152742251 conn(0x7fd87809c480 msgr2=0x7fd8780b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:55.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 shutdown_connections 2023-12-02T01:29:55.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:55.983+0000 7fd8800e5640 1 -- 172.21.15.1:0/152742251 wait complete. 2023-12-02T01:29:55.995 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:29:56.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.102+0000 7f63fb997640 1 Processor -- start 2023-12-02T01:29:56.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63fb997640 1 -- start start 2023-12-02T01:29:56.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63fb997640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f63f4144310 0x7f63f4144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63fb997640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f40ce7e0 0x7f63f40b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63fb997640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f63f406c890 0x7f63f406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63fb997640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40b3980 con 0x7f63f4144310 2023-12-02T01:29:56.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63fb997640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40cec60 con 0x7f63f406c890 2023-12-02T01:29:56.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63fb997640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f406d240 con 0x7f63f40ce7e0 2023-12-02T01:29:56.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63f9733640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f63f4144310 0x7f63f4144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63f9733640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f63f4144310 0x7f63f4144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59742/0 (socket says 172.21.15.1:59742) 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.103+0000 7f63f9733640 1 -- 172.21.15.1:0/114411624 learned_addr learned my addr 172.21.15.1:0/114411624 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f8f32640 1 --2- 172.21.15.1:0/114411624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f40ce7e0 0x7f63f40b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9f34640 1 --2- 172.21.15.1:0/114411624 >> v2:172.21.15.167:3300/0 conn(0x7f63f406c890 0x7f63f406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9733640 1 -- 172.21.15.1:0/114411624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f40ce7e0 msgr2=0x7f63f40b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9733640 1 --2- 172.21.15.1:0/114411624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f40ce7e0 0x7f63f40b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9733640 1 -- 172.21.15.1:0/114411624 >> v2:172.21.15.167:3300/0 conn(0x7f63f406c890 msgr2=0x7f63f406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9733640 1 --2- 172.21.15.1:0/114411624 >> v2:172.21.15.167:3300/0 conn(0x7f63f406c890 0x7f63f406cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9733640 1 -- 172.21.15.1:0/114411624 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f41446f0 con 0x7f63f4144310 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f8f32640 1 --2- 172.21.15.1:0/114411624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f40ce7e0 0x7f63f40b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9f34640 1 --2- 172.21.15.1:0/114411624 >> v2:172.21.15.167:3300/0 conn(0x7f63f406c890 0x7f63f406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.104+0000 7f63f9733640 1 --2- 172.21.15.1:0/114411624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4144310 0x7f63f4144950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63f40700a0 tx=0x7f63ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2a71c4087df436 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63f3fff640 1 -- 172.21.15.1:0/114411624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec031640 con 0x7f63f4144310 2023-12-02T01:29:56.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63f3fff640 1 -- 172.21.15.1:0/114411624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec0317a0 con 0x7f63f4144310 2023-12-02T01:29:56.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63f3fff640 1 -- 172.21.15.1:0/114411624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec031b30 con 0x7f63f4144310 2023-12-02T01:29:56.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 -- 172.21.15.1:0/114411624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4144310 msgr2=0x7f63f4144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 --2- 172.21.15.1:0/114411624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4144310 0x7f63f4144950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63f40700a0 tx=0x7f63ec02b8f0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 -- 172.21.15.1:0/114411624 shutdown_connections 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 --2- 172.21.15.1:0/114411624 >> v2:172.21.15.167:3300/0 conn(0x7f63f406c890 0x7f63f406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 --2- 172.21.15.1:0/114411624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f40ce7e0 0x7f63f40b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 --2- 172.21.15.1:0/114411624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f4144310 0x7f63f4144950 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 -- 172.21.15.1:0/114411624 >> 172.21.15.1:0/114411624 conn(0x7f63f406a8f0 msgr2=0x7f63f406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 -- 172.21.15.1:0/114411624 shutdown_connections 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.105+0000 7f63fb997640 1 -- 172.21.15.1:0/114411624 wait complete. 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.106+0000 7f63fb997640 1 Processor -- start 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.106+0000 7f63fb997640 1 -- start start 2023-12-02T01:29:56.111 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63fb997640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f406c890 0x7f63f4071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63fb997640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f40ce7e0 0x7f63f41531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63fb997640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f4144310 0x7f63f414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63fb997640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41f36a0 con 0x7f63f406c890 2023-12-02T01:29:56.112 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63fb997640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4153730 con 0x7f63f40ce7e0 2023-12-02T01:29:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63fb997640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40ad040 con 0x7f63f4144310 2023-12-02T01:29:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63f9733640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f406c890 0x7f63f4071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63f9733640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f406c890 0x7f63f4071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59754/0 (socket says 172.21.15.1:59754) 2023-12-02T01:29:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63f9733640 1 -- 172.21.15.1:0/2657189733 learned_addr learned my addr 172.21.15.1:0/2657189733 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.107+0000 7f63f9f34640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f4144310 0x7f63f414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.113 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f8f32640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f40ce7e0 0x7f63f41531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f9733640 1 -- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f4144310 msgr2=0x7f63f414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f9733640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f4144310 0x7f63f414d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f9733640 1 -- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f40ce7e0 msgr2=0x7f63f41531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f9733640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f40ce7e0 0x7f63f41531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f9733640 1 -- 172.21.15.1:0/2657189733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0094d0 con 0x7f63f406c890 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f9f34640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f4144310 0x7f63f414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f8f32640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f40ce7e0 0x7f63f41531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f9733640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f406c890 0x7f63f4071c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63ec000c00 tx=0x7f63ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f1ffb640 1 -- 172.21.15.1:0/2657189733 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec03ac60 con 0x7f63f406c890 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f1ffb640 1 -- 172.21.15.1:0/2657189733 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec03adc0 con 0x7f63f406c890 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f40ac750 con 0x7f63f406c890 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63f1ffb640 1 -- 172.21.15.1:0/2657189733 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec044630 con 0x7f63f406c890 2023-12-02T01:29:56.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.108+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f40accd0 con 0x7f63f406c890 2023-12-02T01:29:56.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.109+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f4072ae0 con 0x7f63f406c890 2023-12-02T01:29:56.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.109+0000 7f63f1ffb640 1 -- 172.21.15.1:0/2657189733 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63ec02f050 con 0x7f63f406c890 2023-12-02T01:29:56.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.110+0000 7f63f1ffb640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f63e006ae40 0x7f63e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.110+0000 7f63f1ffb640 1 -- 172.21.15.1:0/2657189733 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63ec0ab4c0 con 0x7f63f406c890 2023-12-02T01:29:56.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.110+0000 7f63f8f32640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f63e006ae40 0x7f63e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.111+0000 7f63f8f32640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f63e006ae40 0x7f63e006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e8006fd0 tx=0x7f63e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.114+0000 7f63f1ffb640 1 -- 172.21.15.1:0/2657189733 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63ec076570 con 0x7f63f406c890 2023-12-02T01:29:56.294 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.293+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63f40b3660 con 0x7f63f406c890 2023-12-02T01:29:56.295 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.293+0000 7f63f1ffb640 1 -- 172.21.15.1:0/2657189733 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63ec031e60 con 0x7f63f406c890 2023-12-02T01:29:56.295 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f63e006ae40 msgr2=0x7f63e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f63e006ae40 0x7f63e006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e8006fd0 tx=0x7f63e8008040 comp rx=0 tx=0).stop 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f406c890 msgr2=0x7f63f4071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f406c890 0x7f63f4071c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63ec000c00 tx=0x7f63ec0046c0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 shutdown_connections 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63f4144310 0x7f63f414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f63e006ae40 0x7f63e006d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f40ce7e0 0x7f63f41531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 --2- 172.21.15.1:0/2657189733 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63f406c890 0x7f63f4071c40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 >> 172.21.15.1:0/2657189733 conn(0x7f63f406a8f0 msgr2=0x7f63f415d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 shutdown_connections 2023-12-02T01:29:56.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.295+0000 7f63fb997640 1 -- 172.21.15.1:0/2657189733 wait complete. 2023-12-02T01:29:56.308 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:29:56.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.412+0000 7fc7bc7be640 1 Processor -- start 2023-12-02T01:29:56.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.412+0000 7fc7bc7be640 1 -- start start 2023-12-02T01:29:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7bc7be640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc7b413e2d0 0x7fc7b40b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7bc7be640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc7b40b4640 0x7fc7b415b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7bc7be640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b406de80 con 0x7fc7b415bd90 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7bc7be640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b40b4ad0 con 0x7fc7b413e2d0 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7bc7be640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b415fc60 con 0x7fc7b40b4640 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7ba55a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc7b413e2d0 0x7fc7b40b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7ba55a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc7b413e2d0 0x7fc7b40b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59766/0 (socket says 172.21.15.1:59766) 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7ba55a640 1 -- 172.21.15.1:0/556439477 learned_addr learned my addr 172.21.15.1:0/556439477 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7b9d59640 1 --2- 172.21.15.1:0/556439477 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40b4640 0x7fc7b415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7ba55a640 1 -- 172.21.15.1:0/556439477 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40b4640 msgr2=0x7fc7b415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7ba55a640 1 --2- 172.21.15.1:0/556439477 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40b4640 0x7fc7b415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7ba55a640 1 -- 172.21.15.1:0/556439477 >> v1:172.21.15.167:6789/0 conn(0x7fc7b415bd90 legacy=0x7fc7b4140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7ba55a640 1 -- 172.21.15.1:0/556439477 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b406d5c0 con 0x7fc7b413e2d0 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.413+0000 7fc7b9d59640 1 --2- 172.21.15.1:0/556439477 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40b4640 0x7fc7b415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.414+0000 7fc7ba55a640 1 --2- 172.21.15.1:0/556439477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40b4100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40b1b90 tx=0x7fc7ac02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d909991eaa766 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.414+0000 7fc7b9558640 1 -- 172.21.15.1:0/556439477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac02cb20 con 0x7fc7b413e2d0 2023-12-02T01:29:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.414+0000 7fc7b9558640 1 -- 172.21.15.1:0/556439477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac02cc80 con 0x7fc7b413e2d0 2023-12-02T01:29:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.414+0000 7fc7b9558640 1 -- 172.21.15.1:0/556439477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0343f0 con 0x7fc7b413e2d0 2023-12-02T01:29:56.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 -- 172.21.15.1:0/556439477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b413e2d0 msgr2=0x7fc7b40b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/556439477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40b4100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40b1b90 tx=0x7fc7ac02bf80 comp rx=0 tx=0).stop 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 -- 172.21.15.1:0/556439477 shutdown_connections 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/556439477 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40b4640 0x7fc7b415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/556439477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40b4100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 -- 172.21.15.1:0/556439477 >> 172.21.15.1:0/556439477 conn(0x7fc7b40b0af0 msgr2=0x7fc7b40b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 -- 172.21.15.1:0/556439477 shutdown_connections 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.415+0000 7fc7bc7be640 1 -- 172.21.15.1:0/556439477 wait complete. 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.416+0000 7fc7bc7be640 1 Processor -- start 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.416+0000 7fc7bc7be640 1 -- start start 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bc7be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b40b4640 0x7fc7b413d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bc7be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bc7be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b415bd90 0x7fc7b40ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bc7be640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40a9340 con 0x7fc7b415bd90 2023-12-02T01:29:56.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bc7be640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b415a980 con 0x7fc7b413e2d0 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bc7be640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40a89a0 con 0x7fc7b40b4640 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b415bd90 0x7fc7b40ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b415bd90 0x7fc7b40ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59780/0 (socket says 172.21.15.1:59780) 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 -- 172.21.15.1:0/1647096017 learned_addr learned my addr 172.21.15.1:0/1647096017 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7ba55a640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b40b4640 0x7fc7b413d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7b9d59640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 -- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b40b4640 msgr2=0x7fc7b413d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b40b4640 0x7fc7b413d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 -- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b413e2d0 msgr2=0x7fc7b40ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 -- 172.21.15.1:0/1647096017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac009b30 con 0x7fc7b415bd90 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7ba55a640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b40b4640 0x7fc7b413d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:56.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7b9d59640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7bad5b640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b415bd90 0x7fc7b40ab8d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4001eb0 tx=0x7fc7a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7b2ffd640 1 -- 172.21.15.1:0/1647096017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40052d0 con 0x7fc7b415bd90 2023-12-02T01:29:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.417+0000 7fc7b2ffd640 1 -- 172.21.15.1:0/1647096017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4005430 con 0x7fc7b415bd90 2023-12-02T01:29:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.418+0000 7fc7b2ffd640 1 -- 172.21.15.1:0/1647096017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4003810 con 0x7fc7b415bd90 2023-12-02T01:29:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.418+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b40a8c80 con 0x7fc7b415bd90 2023-12-02T01:29:56.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.418+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b413dd70 con 0x7fc7b415bd90 2023-12-02T01:29:56.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.418+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b40a9480 con 0x7fc7b415bd90 2023-12-02T01:29:56.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.419+0000 7fc7b2ffd640 1 -- 172.21.15.1:0/1647096017 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7a4003970 con 0x7fc7b415bd90 2023-12-02T01:29:56.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.419+0000 7fc7b2ffd640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7a006ae40 0x7fc7a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.419+0000 7fc7b2ffd640 1 -- 172.21.15.1:0/1647096017 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7a4088b90 con 0x7fc7b415bd90 2023-12-02T01:29:56.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.419+0000 7fc7ba55a640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7a006ae40 0x7fc7a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.420+0000 7fc7ba55a640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7a006ae40 0x7fc7a006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac035000 tx=0x7fc7ac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.424+0000 7fc7b2ffd640 1 -- 172.21.15.1:0/1647096017 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7b40a9480 con 0x7fc7b415bd90 2023-12-02T01:29:56.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.634+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7b40a9480 con 0x7fc7b415bd90 2023-12-02T01:29:56.635 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.634+0000 7fc7b2ffd640 1 -- 172.21.15.1:0/1647096017 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fc7b40a9480 con 0x7fc7b415bd90 2023-12-02T01:29:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:56.636 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:29:56.636 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:29:56.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.636+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7a006ae40 msgr2=0x7fc7a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.636+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7a006ae40 0x7fc7a006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac035000 tx=0x7fc7ac030000 comp rx=0 tx=0).stop 2023-12-02T01:29:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.636+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b415bd90 msgr2=0x7fc7b40ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.636+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b415bd90 0x7fc7b40ab8d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4001eb0 tx=0x7fc7a400c890 comp rx=0 tx=0).stop 2023-12-02T01:29:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.636+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 shutdown_connections 2023-12-02T01:29:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.636+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7b415bd90 0x7fc7b40ab8d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.637+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc7a006ae40 0x7fc7a006d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.637+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b413e2d0 0x7fc7b40ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.637+0000 7fc7bc7be640 1 --2- 172.21.15.1:0/1647096017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b40b4640 0x7fc7b413d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.637+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 >> 172.21.15.1:0/1647096017 conn(0x7fc7b40b0af0 msgr2=0x7fc7b415cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:56.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.637+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 shutdown_connections 2023-12-02T01:29:56.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.637+0000 7fc7bc7be640 1 -- 172.21.15.1:0/1647096017 wait complete. 2023-12-02T01:29:56.649 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:29:56.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.754+0000 7f62b5f5a640 1 Processor -- start 2023-12-02T01:29:56.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.754+0000 7f62b5f5a640 1 -- start start 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62b5f5a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f62b009a080 0x7f62b00b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62b5f5a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b00b0660 con 0x7f62b015d900 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62b5f5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b006c900 con 0x7f62b00b2610 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62b5f5a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b006cbe0 con 0x7f62b009a080 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62aeffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f62b009a080 0x7f62b00b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62af7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f62b015d900 0x7f62b0099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47348/0 (socket says 172.21.15.1:47348) 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62aeffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f62b009a080 0x7f62b00b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59784/0 (socket says 172.21.15.1:59784) 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62af7fe640 1 -- 172.21.15.1:0/1385329529 learned_addr learned my addr 172.21.15.1:0/1385329529 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62aeffd640 1 -- 172.21.15.1:0/1385329529 >> v1:172.21.15.167:6789/0 conn(0x7f62b00b2610 legacy=0x7f62b00b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62aeffd640 1 -- 172.21.15.1:0/1385329529 >> v1:172.21.15.1:6789/0 conn(0x7f62b015d900 legacy=0x7f62b0099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62aeffd640 1 -- 172.21.15.1:0/1385329529 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b006cec0 con 0x7f62b009a080 2023-12-02T01:29:56.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.755+0000 7f62ae7fc640 1 -- 172.21.15.1:0/1385329529 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687716643 0 0) 0x7f62b00b0660 con 0x7f62b015d900 2023-12-02T01:29:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.756+0000 7f62aeffd640 1 --2- 172.21.15.1:0/1385329529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b00b0dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097a0 tx=0x7f62a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a584398e01af0404 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.756+0000 7f62ae7fc640 1 -- 172.21.15.1:0/1385329529 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4030610 con 0x7f62b009a080 2023-12-02T01:29:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.756+0000 7f62ae7fc640 1 -- 172.21.15.1:0/1385329529 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4030770 con 0x7f62b009a080 2023-12-02T01:29:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.756+0000 7f62ae7fc640 1 -- 172.21.15.1:0/1385329529 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4030b00 con 0x7f62b009a080 2023-12-02T01:29:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.757+0000 7f62b5f5a640 1 -- 172.21.15.1:0/1385329529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 msgr2=0x7f62b00b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.757+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/1385329529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b00b0dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097a0 tx=0x7f62a402b960 comp rx=0 tx=0).stop 2023-12-02T01:29:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.757+0000 7f62b5f5a640 1 -- 172.21.15.1:0/1385329529 shutdown_connections 2023-12-02T01:29:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.757+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/1385329529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b00b0dd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.757+0000 7f62b5f5a640 1 -- 172.21.15.1:0/1385329529 >> 172.21.15.1:0/1385329529 conn(0x7f62b00b2a70 msgr2=0x7f62b00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.757+0000 7f62b5f5a640 1 -- 172.21.15.1:0/1385329529 shutdown_connections 2023-12-02T01:29:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.757+0000 7f62b5f5a640 1 -- 172.21.15.1:0/1385329529 wait complete. 2023-12-02T01:29:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.758+0000 7f62b5f5a640 1 Processor -- start 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.758+0000 7f62b5f5a640 1 -- start start 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62b5f5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b01f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62b5f5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b00b2610 0x7f62b0150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62b5f5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b015d900 0x7f62b00aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62b5f5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00c5eb0 con 0x7f62b009a080 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62b5f5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00c7a10 con 0x7f62b015d900 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62b5f5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b01f7370 con 0x7f62b00b2610 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b01f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b01f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59794/0 (socket says 172.21.15.1:59794) 2023-12-02T01:29:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 -- 172.21.15.1:0/3743405861 learned_addr learned my addr 172.21.15.1:0/3743405861 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62aeffd640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b00b2610 0x7f62b0150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 -- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b00b2610 msgr2=0x7f62b0150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b00b2610 0x7f62b0150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 -- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b015d900 msgr2=0x7f62b00aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62affff640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b015d900 0x7f62b00aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b015d900 0x7f62b00aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 -- 172.21.15.1:0/3743405861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4009400 con 0x7f62b009a080 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.759+0000 7f62af7fe640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b01f6e30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f62a000c4d0 tx=0x7f62a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.760+0000 7f6297fff640 1 -- 172.21.15.1:0/3743405861 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a00074e0 con 0x7f62b009a080 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.760+0000 7f6297fff640 1 -- 172.21.15.1:0/3743405861 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a0007640 con 0x7f62b009a080 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.760+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b00c5230 con 0x7f62b009a080 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.760+0000 7f6297fff640 1 -- 172.21.15.1:0/3743405861 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0004a20 con 0x7f62b009a080 2023-12-02T01:29:56.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.760+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b00c57f0 con 0x7f62b009a080 2023-12-02T01:29:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.761+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b0067420 con 0x7f62b009a080 2023-12-02T01:29:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.761+0000 7f6297fff640 1 -- 172.21.15.1:0/3743405861 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62a0004b80 con 0x7f62b009a080 2023-12-02T01:29:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.761+0000 7f6297fff640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f629c06ae40 0x7f629c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.761+0000 7f6297fff640 1 -- 172.21.15.1:0/3743405861 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62a0088a40 con 0x7f62b009a080 2023-12-02T01:29:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.761+0000 7f62aeffd640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f629c06ae40 0x7f629c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.762+0000 7f62aeffd640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f629c06ae40 0x7f629c06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62a4036000 tx=0x7f62a403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:56.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.766+0000 7f6297fff640 1 -- 172.21.15.1:0/3743405861 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62a008ae60 con 0x7f62b009a080 2023-12-02T01:29:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.943+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62b006d440 con 0x7f62b009a080 2023-12-02T01:29:56.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.944+0000 7f6297fff640 1 -- 172.21.15.1:0/3743405861 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f62a0018020 con 0x7f62b009a080 2023-12-02T01:29:56.946 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:56.946 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f629c06ae40 msgr2=0x7f629c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f629c06ae40 0x7f629c06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62a4036000 tx=0x7f62a403b040 comp rx=0 tx=0).stop 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 msgr2=0x7f62b01f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b01f6e30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f62a000c4d0 tx=0x7f62a000c990 comp rx=0 tx=0).stop 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 shutdown_connections 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f629c06ae40 0x7f629c06d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62b015d900 0x7f62b00aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62b00b2610 0x7f62b0150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 --2- 172.21.15.1:0/3743405861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62b009a080 0x7f62b01f6e30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 >> 172.21.15.1:0/3743405861 conn(0x7f62b00b2a70 msgr2=0x7f62b015a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:56.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 shutdown_connections 2023-12-02T01:29:56.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:56.946+0000 7f62b5f5a640 1 -- 172.21.15.1:0/3743405861 wait complete. 2023-12-02T01:29:56.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:29:57.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.063+0000 7fb846832640 1 Processor -- start 2023-12-02T01:29:57.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.063+0000 7fb846832640 1 -- start start 2023-12-02T01:29:57.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb846832640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb84015d900 0x7fb840099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb846832640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8400b2610 0x7fb840099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.068 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb846832640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400b0660 con 0x7fb8400b00c0 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb846832640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84006c900 con 0x7fb8400b2610 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb846832640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84006cbe0 con 0x7fb84015d900 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb844dcf640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb8400b00c0 0x7fb8400cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47352/0 (socket says 172.21.15.1:47352) 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb844dcf640 1 -- 172.21.15.1:0/4154105409 learned_addr learned my addr 172.21.15.1:0/4154105409 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb83f7fe640 1 --2- 172.21.15.1:0/4154105409 >> v2:172.21.15.167:3300/0 conn(0x7fb8400b2610 0x7fb840099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb84015d900 0x7fb840099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37132802 0 0) 0x7fb8400b0660 con 0x7fb8400b00c0 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.064+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c003520 con 0x7fb8400b00c0 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4166810404 0 0) 0x7fb82c003520 con 0x7fb8400b00c0 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb84015d900 msgr2=0x7fb840099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb84015d900 0x7fb840099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 >> v2:172.21.15.167:3300/0 conn(0x7fb8400b2610 msgr2=0x7fb840099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 --2- 172.21.15.1:0/4154105409 >> v2:172.21.15.167:3300/0 conn(0x7fb8400b2610 0x7fb840099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84006cec0 con 0x7fb8400b00c0 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fb8380019f0 con 0x7fb8400b00c0 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 >> v1:172.21.15.1:6789/0 conn(0x7fb8400b00c0 legacy=0x7fb8400cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c003970 0x7fb82c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c0047c0 0x7fb82c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82c005180 0x7fb82c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84006c900 con 0x7fb82c003970 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84006cbe0 con 0x7fb82c005180 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c00bec0 con 0x7fb82c0047c0 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83f7fe640 1 --2- 172.21.15.1:0/4154105409 >> v2:172.21.15.167:3300/0 conn(0x7fb8400b2610 0x7fb840099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb84015d900 0x7fb840099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c003970 0x7fb82c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb844dcf640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82c005180 0x7fb82c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83f7fe640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c0047c0 0x7fb82c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83ffff640 1 -- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c0047c0 msgr2=0x7fb82c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c0047c0 0x7fb82c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83ffff640 1 -- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82c005180 msgr2=0x7fb82c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb82c005180 0x7fb82c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.065+0000 7fb83ffff640 1 -- 172.21.15.1:0/4154105409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c003520 con 0x7fb82c003970 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.066+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c003970 0x7fb82c003d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb828009b00 tx=0x7fb82c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0663d43eeea95da server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.066+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828004030 con 0x7fb82c003970 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.066+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828004190 con 0x7fb82c003970 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.066+0000 7fb83effd640 1 -- 172.21.15.1:0/4154105409 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828004520 con 0x7fb82c003970 2023-12-02T01:29:57.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.067+0000 7fb846832640 1 -- 172.21.15.1:0/4154105409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c003970 msgr2=0x7fb82c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.067+0000 7fb846832640 1 --2- 172.21.15.1:0/4154105409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb82c003970 0x7fb82c003d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb828009b00 tx=0x7fb82c0057f0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.067+0000 7fb844dcf640 1 -- 172.21.15.1:0/4154105409 reap_dead start 2023-12-02T01:29:57.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.067+0000 7fb846832640 1 -- 172.21.15.1:0/4154105409 shutdown_connections 2023-12-02T01:29:57.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.067+0000 7fb846832640 1 -- 172.21.15.1:0/4154105409 >> 172.21.15.1:0/4154105409 conn(0x7fb8400b2a70 msgr2=0x7fb8400b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.067+0000 7fb846832640 1 -- 172.21.15.1:0/4154105409 shutdown_connections 2023-12-02T01:29:57.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.067+0000 7fb846832640 1 -- 172.21.15.1:0/4154105409 wait complete. 2023-12-02T01:29:57.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.068+0000 7fb846832640 1 Processor -- start 2023-12-02T01:29:57.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.068+0000 7fb846832640 1 -- start start 2023-12-02T01:29:57.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb846832640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c003970 0x7fb84015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb846832640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8401f6770 0x7fb8400b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb846832640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8400b4940 0x7fb840099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb846832640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84015ae60 con 0x7fb8401f6770 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb846832640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8401f6cc0 con 0x7fb8400b4940 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb846832640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8401f6fa0 con 0x7fb82c003970 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8401f6770 0x7fb8400b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8401f6770 0x7fb8400b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59808/0 (socket says 172.21.15.1:59808) 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 -- 172.21.15.1:0/4149607173 learned_addr learned my addr 172.21.15.1:0/4149607173 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb844dcf640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8400b4940 0x7fb840099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c003970 0x7fb84015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 -- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c003970 msgr2=0x7fb84015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c003970 0x7fb84015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 -- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8400b4940 msgr2=0x7fb840099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8400b4940 0x7fb840099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 -- 172.21.15.1:0/4149607173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8401f7280 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c003970 0x7fb84015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb844dcf640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8400b4940 0x7fb840099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.069+0000 7fb83f7fe640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8401f6770 0x7fb8400b4400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb830011ca0 tx=0x7fb83000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.070+0000 7fb83cff9640 1 -- 172.21.15.1:0/4149607173 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000fd20 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.070+0000 7fb83cff9640 1 -- 172.21.15.1:0/4149607173 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83000fe80 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.070+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8401f7560 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.070+0000 7fb83cff9640 1 -- 172.21.15.1:0/4149607173 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830004250 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.070+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8401577a0 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.071+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84015afa0 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.071+0000 7fb83cff9640 1 -- 172.21.15.1:0/4149607173 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8300043b0 con 0x7fb8401f6770 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.071+0000 7fb83cff9640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb82006ae40 0x7fb82006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.072+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb82006ae40 0x7fb82006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.072+0000 7fb83cff9640 1 -- 172.21.15.1:0/4149607173 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb830089d50 con 0x7fb8401f6770 2023-12-02T01:29:57.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.072+0000 7fb83ffff640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb82006ae40 0x7fb82006d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb828035000 tx=0x7fb828030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.076+0000 7fb83cff9640 1 -- 172.21.15.1:0/4149607173 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb84015afa0 con 0x7fb8401f6770 2023-12-02T01:29:57.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.287+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb84015afa0 con 0x7fb8401f6770 2023-12-02T01:29:57.289 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.288+0000 7fb83cff9640 1 -- 172.21.15.1:0/4149607173 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fb84015afa0 con 0x7fb8401f6770 2023-12-02T01:29:57.290 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:29:57.290 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:29:57.290 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:29:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb82006ae40 msgr2=0x7fb82006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb82006ae40 0x7fb82006d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb828035000 tx=0x7fb828030000 comp rx=0 tx=0).stop 2023-12-02T01:29:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8401f6770 msgr2=0x7fb8400b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8401f6770 0x7fb8400b4400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb830011ca0 tx=0x7fb83000f610 comp rx=0 tx=0).stop 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 shutdown_connections 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb82006ae40 0x7fb82006d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8400b4940 0x7fb840099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8401f6770 0x7fb8400b4400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 --2- 172.21.15.1:0/4149607173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb82c003970 0x7fb84015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 >> 172.21.15.1:0/4149607173 conn(0x7fb8400b2a70 msgr2=0x7fb8400cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 shutdown_connections 2023-12-02T01:29:57.292 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.290+0000 7fb846832640 1 -- 172.21.15.1:0/4149607173 wait complete. 2023-12-02T01:29:57.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-02T01:29:44.704158+0000', 'modified': '2023-12-02T01:29:46.693986+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6836/4222783213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6834', 'nonce': 4222783213}, {'type': 'v1', 'addr': '172.21.15.1:6836', 'nonce': 4222783213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-02T01:29:57.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-02T01:29:57.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-02T01:29:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.818+0000 7fdb52b8a640 1 Processor -- start 2023-12-02T01:29:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb52b8a640 1 -- start start 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb52b8a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdb4c0cf950 0x7fdb4c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb52b8a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c15ee60 con 0x7fdb4c0afee0 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb52b8a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c0cef60 con 0x7fdb4c15ea80 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb52b8a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c099a10 con 0x7fdb4c0cf950 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb51127640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdb4c0cf950 0x7fdb4c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb4bfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdb4c0afee0 0x7fdb4c0b07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47356/0 (socket says 172.21.15.1:47356) 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb51127640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdb4c0cf950 0x7fdb4c0b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59822/0 (socket says 172.21.15.1:59822) 2023-12-02T01:29:57.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.819+0000 7fdb4bfff640 1 -- 172.21.15.1:0/688626319 learned_addr learned my addr 172.21.15.1:0/688626319 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:29:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.820+0000 7fdb51127640 1 -- 172.21.15.1:0/688626319 >> v1:172.21.15.167:6789/0 conn(0x7fdb4c15ea80 legacy=0x7fdb4c0cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.820+0000 7fdb51127640 1 -- 172.21.15.1:0/688626319 >> v1:172.21.15.1:6789/0 conn(0x7fdb4c0afee0 legacy=0x7fdb4c0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.820+0000 7fdb51127640 1 -- 172.21.15.1:0/688626319 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c099cf0 con 0x7fdb4c0cf950 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb51127640 1 --2- 172.21.15.1:0/688626319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c0b0f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0097a0 tx=0x7fdb3c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b586e8e08397d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb4b7fe640 1 -- 172.21.15.1:0/688626319 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c030610 con 0x7fdb4c0cf950 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb4b7fe640 1 -- 172.21.15.1:0/688626319 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c030770 con 0x7fdb4c0cf950 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb4b7fe640 1 -- 172.21.15.1:0/688626319 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c030b00 con 0x7fdb4c0cf950 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb52b8a640 1 -- 172.21.15.1:0/688626319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0cf950 msgr2=0x7fdb4c0b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/688626319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c0b0f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0097a0 tx=0x7fdb3c02b960 comp rx=0 tx=0).stop 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb52b8a640 1 -- 172.21.15.1:0/688626319 shutdown_connections 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/688626319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c0b0f00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb52b8a640 1 -- 172.21.15.1:0/688626319 >> 172.21.15.1:0/688626319 conn(0x7fdb4c0b2ab0 msgr2=0x7fdb4c0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb52b8a640 1 -- 172.21.15.1:0/688626319 shutdown_connections 2023-12-02T01:29:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.821+0000 7fdb52b8a640 1 -- 172.21.15.1:0/688626319 wait complete. 2023-12-02T01:29:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.822+0000 7fdb52b8a640 1 Processor -- start 2023-12-02T01:29:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.822+0000 7fdb52b8a640 1 -- start start 2023-12-02T01:29:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb52b8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0afee0 0x7fdb4c0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb52b8a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb52b8a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb4c15ea80 0x7fdb4c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb52b8a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b0640 con 0x7fdb4c0afee0 2023-12-02T01:29:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb52b8a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b0920 con 0x7fdb4c0cf950 2023-12-02T01:29:57.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb52b8a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b0c00 con 0x7fdb4c15ea80 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb50926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0afee0 0x7fdb4c0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb50926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0afee0 0x7fdb4c0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59826/0 (socket says 172.21.15.1:59826) 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.823+0000 7fdb50926640 1 -- 172.21.15.1:0/4046652498 learned_addr learned my addr 172.21.15.1:0/4046652498 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb51127640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb4c15ea80 0x7fdb4c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb50926640 1 -- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb4c15ea80 msgr2=0x7fdb4c0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb50926640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb4c15ea80 0x7fdb4c0b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb50926640 1 -- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb4c0cf950 msgr2=0x7fdb4c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb50926640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.829 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb50926640 1 -- 172.21.15.1:0/4046652498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c009400 con 0x7fdb4c0afee0 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb51127640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb4c15ea80 0x7fdb4c0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb50926640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0afee0 0x7fdb4c0c7530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c870 tx=0x7fdb4400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb497fa640 1 -- 172.21.15.1:0/4046652498 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44003b70 con 0x7fdb4c0afee0 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb497fa640 1 -- 172.21.15.1:0/4046652498 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44003cf0 con 0x7fdb4c0afee0 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c0b0ee0 con 0x7fdb4c0afee0 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb497fa640 1 -- 172.21.15.1:0/4046652498 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400aa90 con 0x7fdb4c0afee0 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.824+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c0b14a0 con 0x7fdb4c0afee0 2023-12-02T01:29:57.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.826+0000 7fdb497fa640 1 -- 172.21.15.1:0/4046652498 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb4400abf0 con 0x7fdb4c0afee0 2023-12-02T01:29:57.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.826+0000 7fdb497fa640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdb3806ae70 0x7fdb3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.826+0000 7fdb497fa640 1 -- 172.21.15.1:0/4046652498 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb44089410 con 0x7fdb4c0afee0 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.826+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdb3806ae70 0x7fdb3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.827+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdb3806ae70 0x7fdb3806d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0d0630 tx=0x7fdb40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.827+0000 7fdb557f0740 1 Processor -- start 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.827+0000 7fdb557f0740 1 -- start start 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485967bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485968130 0x55b485997f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb557f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b485928980 con 0x55b485968130 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4858dab90 con 0x55b485994c50 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4858d8280 con 0x55b485995030 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485968130 0x55b485997f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485968130 0x55b485997f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59830/0 (socket says 172.21.15.1:59830) 2023-12-02T01:29:57.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 -- 172.21.15.1:0/3437059048 learned_addr learned my addr 172.21.15.1:0/3437059048 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb50926640 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485967bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 -- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 msgr2=0x55b4859979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 -- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 msgr2=0x55b485967bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485967bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb51127640 1 -- 172.21.15.1:0/3437059048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b485899500 con 0x55b485968130 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.828+0000 7fdb50926640 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485967bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb51127640 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485968130 0x55b485997f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009890 tx=0x7fdb3c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4992aa2e517c0d5c server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb327fc640 1 -- 172.21.15.1:0/3437059048 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c030b60 con 0x55b485968130 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb327fc640 1 -- 172.21.15.1:0/3437059048 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c030cc0 con 0x55b485968130 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb327fc640 1 -- 172.21.15.1:0/3437059048 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c039650 con 0x55b485968130 2023-12-02T01:29:57.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 -- 172.21.15.1:0/3437059048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485968130 msgr2=0x55b485997f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485968130 0x55b485997f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009890 tx=0x7fdb3c030000 comp rx=0 tx=0).stop 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 -- 172.21.15.1:0/3437059048 shutdown_connections 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485968130 0x55b485997f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 --2- 172.21.15.1:0/3437059048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485967bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 -- 172.21.15.1:0/3437059048 >> 172.21.15.1:0/3437059048 conn(0x55b485969e60 msgr2=0x55b4859b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 -- 172.21.15.1:0/3437059048 shutdown_connections 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.829+0000 7fdb557f0740 1 -- 172.21.15.1:0/3437059048 wait complete. 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.830+0000 7fdb557f0740 1 -- start start 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.830+0000 7fdb557f0740 1 Processor -- start 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485994c50 0x55b48599ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485995f00 0x55b485996380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb557f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4858d3b70 con 0x55b485994c50 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48588de00 con 0x55b485995f00 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b48588daa0 con 0x55b485995030 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb557f0740 10 client.0 _ll_register_callbacks cb 0x55b4855e5ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485994c50 0x55b48599ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485994c50 0x55b48599ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59832/0 (socket says 172.21.15.1:59832) 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 -- 172.21.15.1:0/119691356 learned_addr learned my addr 172.21.15.1:0/119691356 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb51127640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485995f00 0x55b485996380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 -- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 msgr2=0x55b4859c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 -- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485995f00 msgr2=0x55b485996380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485995f00 0x55b485996380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 -- 172.21.15.1:0/119691356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c099cf0 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb51127640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485995f00 0x55b485996380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb50926640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485994c50 0x55b48599ab70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c840 tx=0x7fdb440589d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee2fb8fb45aed27 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.831+0000 7fdb2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/119691356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4406f070 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/119691356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb44060510 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4858ccb50 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/119691356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb4405c170 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 10 client.4728 fetch_fsmap learned FSMap version 6 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55b4858d21f0 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/119691356 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b4858ccb50 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/119691356 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb44019020 con 0x55b485994c50 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 10 client.4728 fetch_fsmap finished waiting for FSMap version 6 2023-12-02T01:29:57.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 10 client.4728 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 20 client.4728 populate_metadata read hostname 'smithi001' 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b4859c6890 0x55b4859a9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 4 client.4728 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 --> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4858cc870 con 0x55b4859c6890 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b4859c6890 0x55b4859a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b4859c6890 0x55b4859a9500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1199ef28dedcdc server_cookie=f291ccdf39ff620f in_seq=0 out_seq=0 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.832+0000 7fdb2b7fe640 10 client.4728 ms_handle_connect on v2:172.21.15.1:6834/4222783213 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/119691356 <== mds.0 v2:172.21.15.1:6834/4222783213 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b4858cc870 con 0x55b4859c6890 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb2b7fe640 10 client.4728 handle_command_reply: tid=0 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 client.4728 shutdown 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485994c50 msgr2=0x55b48599ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485994c50 0x55b48599ab70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c840 tx=0x7fdb440589d0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 shutdown_connections 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b4859c6890 0x55b4859a9500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485995f00 0x55b485996380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995030 0x55b4859c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 --2- 172.21.15.1:0/119691356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485994c50 0x55b48599ab70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb2b7fe640 0 client.4728 ms_handle_reset on v2:172.21.15.1:6834/4222783213 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 >> 172.21.15.1:0/119691356 conn(0x55b485968130 msgr2=0x55b4859b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 shutdown_connections 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.833+0000 7fdb557f0740 1 -- 172.21.15.1:0/119691356 wait complete. 2023-12-02T01:29:57.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.834+0000 7fdb557f0740 20 client.4728 trim_cache size 0 max 16384 2023-12-02T01:29:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.849+0000 7fdb557f0740 1 Processor -- start 2023-12-02T01:29:57.851 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.849+0000 7fdb557f0740 1 -- start start 2023-12-02T01:29:57.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b4859c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b4859b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.853 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb557f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b485853270 con 0x55b485995030 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4859aa5f0 con 0x55b485994c50 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b485990040 con 0x55b485995f00 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b4859b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b4859b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59834/0 (socket says 172.21.15.1:59834) 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 -- 172.21.15.1:0/2368953163 learned_addr learned my addr 172.21.15.1:0/2368953163 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb51127640 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb50926640 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b4859c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 -- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 msgr2=0x55b4859b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 -- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 msgr2=0x55b4859c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b4859c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 -- 172.21.15.1:0/2368953163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b48586fd00 con 0x55b485995030 2023-12-02T01:29:57.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb50926640 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b4859c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.850+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b4859b5100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c06d7c0 tx=0x7fdb40012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0bf2c7e4b144a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb32ffd640 1 -- 172.21.15.1:0/2368953163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40005c70 con 0x55b485995030 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb32ffd640 1 -- 172.21.15.1:0/2368953163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40005dd0 con 0x55b485995030 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb32ffd640 1 -- 172.21.15.1:0/2368953163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40007560 con 0x55b485995030 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 -- 172.21.15.1:0/2368953163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 msgr2=0x55b4859b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b4859b5100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c06d7c0 tx=0x7fdb40012000 comp rx=0 tx=0).stop 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 -- 172.21.15.1:0/2368953163 shutdown_connections 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b4859b5100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 --2- 172.21.15.1:0/2368953163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b4859c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 -- 172.21.15.1:0/2368953163 >> 172.21.15.1:0/2368953163 conn(0x55b485968130 msgr2=0x55b4859d5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 -- 172.21.15.1:0/2368953163 shutdown_connections 2023-12-02T01:29:57.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.851+0000 7fdb557f0740 1 -- 172.21.15.1:0/2368953163 wait complete. 2023-12-02T01:29:57.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.852+0000 7fdb557f0740 1 -- start start 2023-12-02T01:29:57.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.852+0000 7fdb557f0740 1 Processor -- start 2023-12-02T01:29:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485a069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.859 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b485a1d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b485a1dd90 con 0x55b485995030 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4859b53e0 con 0x55b485994c50 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b48599aba0 con 0x55b485995f00 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 10 client.0 _ll_register_callbacks cb 0x7fdb3c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b485a1d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b485a1d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59838/0 (socket says 172.21.15.1:59838) 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 -- 172.21.15.1:0/1035833207 learned_addr learned my addr 172.21.15.1:0/1035833207 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb50926640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485a069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb51127640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 -- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 msgr2=0x55b4859c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.860 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 -- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 msgr2=0x55b485a069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485a069a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 -- 172.21.15.1:0/1035833207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4001d040 con 0x55b485995030 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb50926640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485a069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb4bfff640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b485a1d640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009010 tx=0x7fdb40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f808fe8a4ce98ca server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/1035833207 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40007760 con 0x55b485995030 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/1035833207 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb40025430 con 0x55b485995030 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.853+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb3c030cc0 con 0x55b485995030 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/1035833207 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb4000ee90 con 0x55b485995030 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 10 client.4734 fetch_fsmap learned FSMap version 6 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55b4858954f0 con 0x55b485995030 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/1035833207 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c030cc0 con 0x55b485995030 2023-12-02T01:29:57.861 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/1035833207 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb40036030 con 0x55b485995030 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 10 client.4734 fetch_fsmap finished waiting for FSMap version 6 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 10 client.4734 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 20 client.4734 populate_metadata read hostname 'smithi001' 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b48599b1d0 0x55b48599b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 4 client.4734 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 --> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b4855d46c0 con 0x55b48599b1d0 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb50926640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b48599b1d0 0x55b48599b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb2b7fe640 10 client.4734 ms_handle_connect on v2:172.21.15.1:6834/4222783213 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb50926640 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b48599b1d0 0x55b48599b5b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b7365149c166be3 server_cookie=a23cf7c7186d2821 in_seq=0 out_seq=0 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb2b7fe640 1 -- 172.21.15.1:0/1035833207 <== mds.0 v2:172.21.15.1:6834/4222783213 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55b4855d46c0 con 0x55b48599b1d0 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb2b7fe640 10 client.4734 handle_command_reply: tid=0 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.854+0000 7fdb557f0740 1 client.4734 shutdown 2023-12-02T01:29:57.862 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 msgr2=0x55b485a1d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b485a1d640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009010 tx=0x7fdb40000ed0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 shutdown_connections 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:6834/4222783213,v1:172.21.15.1:6836/4222783213] conn(0x55b48599b1d0 0x55b48599b5b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb2b7fe640 0 client.4734 ms_handle_reset on v2:172.21.15.1:6834/4222783213 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b485995f00 0x55b4859c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b485995030 0x55b485a1d640 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 --2- 172.21.15.1:0/1035833207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b485994c50 0x55b485a069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 >> 172.21.15.1:0/1035833207 conn(0x55b485968130 msgr2=0x55b485998030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 shutdown_connections 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 1 -- 172.21.15.1:0/1035833207 wait complete. 2023-12-02T01:29:57.863 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb557f0740 20 client.4734 trim_cache size 0 max 16384 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e", 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4287, 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 12.511475193000001, 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 6, 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 20, 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 20, 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 19.546804896000001 2023-12-02T01:29:57.864 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-12-02T01:29:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdb3806ae70 msgr2=0x7fdb3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdb3806ae70 0x7fdb3806d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0d0630 tx=0x7fdb40009040 comp rx=0 tx=0).stop 2023-12-02T01:29:57.865 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0afee0 msgr2=0x7fdb4c0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0afee0 0x7fdb4c0c7530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c870 tx=0x7fdb4400cd30 comp rx=0 tx=0).stop 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 shutdown_connections 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.855+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb4c15ea80 0x7fdb4c0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.856+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdb3806ae70 0x7fdb3806d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.856+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb4c0cf950 0x7fdb4c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.856+0000 7fdb52b8a640 1 --2- 172.21.15.1:0/4046652498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb4c0afee0 0x7fdb4c0c7530 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.856+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 >> 172.21.15.1:0/4046652498 conn(0x7fdb4c0b2ab0 msgr2=0x7fdb4c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.856+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 shutdown_connections 2023-12-02T01:29:57.866 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:57.856+0000 7fdb52b8a640 1 -- 172.21.15.1:0/4046652498 wait complete. 2023-12-02T01:29:57.867 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-02T01:29:57.891 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-02T01:29:57.891 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-02T01:29:57.891 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-02T01:29:57.892 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-02T01:29:57.892 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-02T01:29:57.892 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-02T01:29:57.892 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-02T01:29:57.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:57.893 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-12-02T01:29:57.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:57.912 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2023-12-02T01:29:57.984 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2023-12-02T01:29:57.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T01:29:57.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:57.986 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-12-02T01:29:58.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:58.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2023-12-02T01:29:58.075 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2023-12-02T01:29:58.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T01:29:58.076 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-02T01:29:58.076 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-02T01:29:58.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.221+0000 7fccaba87640 1 Processor -- start 2023-12-02T01:29:58.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.221+0000 7fccaba87640 1 -- start start 2023-12-02T01:29:58.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.222+0000 7fccaba87640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcca40d30e0 0x7fcca40d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:58.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.222+0000 7fccaba87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:58.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.222+0000 7fccaba87640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca40cf260 con 0x7fcca415d460 2023-12-02T01:29:58.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.222+0000 7fccaba87640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40d3ab0 con 0x7fcca40d30e0 2023-12-02T01:29:58.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.222+0000 7fccaba87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40ceca0 con 0x7fcca40b39b0 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fccaa024640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9022640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcca40d30e0 0x7fcca40d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9022640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcca40d30e0 0x7fcca40d3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:44368/0 (socket says 172.21.15.1:44368) 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9823640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcca415d460 0x7fcca40d1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:41686/0 (socket says 172.21.15.1:41686) 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fccaa024640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:43560/0 (socket says 172.21.15.1:43560) 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9022640 1 -- 172.21.15.1:0/1143678093 learned_addr learned my addr 172.21.15.1:0/1143678093 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9022640 1 -- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 msgr2=0x7fcca40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9022640 1 --2- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9022640 1 -- 172.21.15.1:0/1143678093 >> v1:172.21.15.167:6789/0 conn(0x7fcca415d460 legacy=0x7fcca40d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fcca9022640 1 -- 172.21.15.1:0/1143678093 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40cef80 con 0x7fcca40d30e0 2023-12-02T01:29:58.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.223+0000 7fccaa024640 1 --2- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.224+0000 7fcca9022640 1 --2- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca40d3570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc980098a0 tx=0x7fcc9802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae197860dbf92ed0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.224+0000 7fcca8821640 1 -- 172.21.15.1:0/1143678093 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98030840 con 0x7fcca40d30e0 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.224+0000 7fcca8821640 1 -- 172.21.15.1:0/1143678093 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980309a0 con 0x7fcca40d30e0 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.224+0000 7fcca8821640 1 -- 172.21.15.1:0/1143678093 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98030d30 con 0x7fcca40d30e0 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 -- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 msgr2=0x7fcca40d3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 --2- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca40d3570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc980098a0 tx=0x7fcc9802b980 comp rx=0 tx=0).stop 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 -- 172.21.15.1:0/1143678093 shutdown_connections 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 --2- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 --2- 172.21.15.1:0/1143678093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca40d3570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 -- 172.21.15.1:0/1143678093 >> 172.21.15.1:0/1143678093 conn(0x7fcca408cb60 msgr2=0x7fcca409c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 -- 172.21.15.1:0/1143678093 shutdown_connections 2023-12-02T01:29:58.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.225+0000 7fccaba87640 1 -- 172.21.15.1:0/1143678093 wait complete. 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.226+0000 7fccaba87640 1 Processor -- start 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.226+0000 7fccaba87640 1 -- start start 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.226+0000 7fccaba87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaba87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca41f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaba87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca415d460 0x7fcca41f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaba87640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40cd630 con 0x7fcca415d460 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaba87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40cb880 con 0x7fcca40d30e0 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaba87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40cac70 con 0x7fcca40b39b0 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca415d460 0x7fcca41f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca415d460 0x7fcca41f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59854/0 (socket says 172.21.15.1:59854) 2023-12-02T01:29:58.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 -- 172.21.15.1:0/2372796327 learned_addr learned my addr 172.21.15.1:0/2372796327 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fcca9823640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fcca9022640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca41f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 -- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 msgr2=0x7fcca40ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 -- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 msgr2=0x7fcca41f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca41f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 -- 172.21.15.1:0/2372796327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94009a70 con 0x7fcca415d460 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fcca9022640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca41f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaa024640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca415d460 0x7fcca41f3630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400efc0 tx=0x7fcc94009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fcca27fc640 1 -- 172.21.15.1:0/2372796327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94009d70 con 0x7fcca415d460 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fcca27fc640 1 -- 172.21.15.1:0/2372796327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400f040 con 0x7fcca415d460 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc980094d0 con 0x7fcca415d460 2023-12-02T01:29:58.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fcca27fc640 1 -- 172.21.15.1:0/2372796327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94003990 con 0x7fcca415d460 2023-12-02T01:29:58.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.227+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca40cb230 con 0x7fcca415d460 2023-12-02T01:29:58.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.228+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca415dcc0 con 0x7fcca415d460 2023-12-02T01:29:58.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.229+0000 7fcca27fc640 1 -- 172.21.15.1:0/2372796327 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc940144a0 con 0x7fcca415d460 2023-12-02T01:29:58.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.229+0000 7fcca27fc640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcc9006ae40 0x7fcc9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:29:58.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.229+0000 7fcca27fc640 1 -- 172.21.15.1:0/2372796327 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc9408a1f0 con 0x7fcca415d460 2023-12-02T01:29:58.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.229+0000 7fcca9823640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcc9006ae40 0x7fcc9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:29:58.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.230+0000 7fcca9823640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcc9006ae40 0x7fcc9006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:29:58.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.234+0000 7fcca27fc640 1 -- 172.21.15.1:0/2372796327 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc94055330 con 0x7fcca415d460 2023-12-02T01:29:58.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.450+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcca40b9040 con 0x7fcca415d460 2023-12-02T01:29:58.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.451+0000 7fcca27fc640 1 -- 172.21.15.1:0/2372796327 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcc94058950 con 0x7fcca415d460 2023-12-02T01:29:58.452 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcc9006ae40 msgr2=0x7fcc9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcc9006ae40 0x7fcc9006d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c007ca0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca415d460 msgr2=0x7fcca41f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca415d460 0x7fcca41f3630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400efc0 tx=0x7fcc94009f90 comp rx=0 tx=0).stop 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 shutdown_connections 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca415d460 0x7fcca41f3630 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcc9006ae40 0x7fcc9006d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca40d30e0 0x7fcca41f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 --2- 172.21.15.1:0/2372796327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcca40b39b0 0x7fcca40ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:29:58.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 >> 172.21.15.1:0/2372796327 conn(0x7fcca408cb60 msgr2=0x7fcca406c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:29:58.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 shutdown_connections 2023-12-02T01:29:58.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:58.452+0000 7fccaba87640 1 -- 172.21.15.1:0/2372796327 wait complete. 2023-12-02T01:29:58.464 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-02T01:29:58.464 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-02T01:29:58.465 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-12-02T01:29:58.465 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-02T01:29:58.465 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-02T01:29:58.465 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-02T01:29:58.465 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-02T01:29:58.465 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-02T01:29:58.465 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-02T01:29:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:58.465 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-12-02T01:29:58.481 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:29:58.481 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:29:58.481 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:29:58.481 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-12-02T01:29:58.482 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-02T01:29:58.483 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42647sec preferred_lft 42647sec 2023-12-02T01:29:58.483 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link noprefixroute 2023-12-02T01:29:58.483 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:29:58.483 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:29:58.483 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:29:58.483 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-12-02T01:29:58.483 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-02T01:29:58.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:58.483 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:29:58.484 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:29:58.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2023-12-02T01:29:58.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2023-12-02T01:29:58.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2023-12-02T01:29:58.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-02T01:29:58.484 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:29:58.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:58.671 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-02T01:29:58.702 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-12-02T01:29:58.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:58.704 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-12-02T01:29:58.774 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-12-02T01:29:58.774 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-02T01:29:58.774 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-02T01:29:58.774 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-02T01:29:58.774 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-02T01:29:58.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:58.775 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:29:58.775 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:29:58.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-02T01:29:58.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-02T01:29:58.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-02T01:29:58.775 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:29:59.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.063 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-12-02T01:29:59.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.078 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2023-12-02T01:29:59.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.134 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:29:59.134 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:29:59.134 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:29:59.134 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-02T01:29:59.134 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:29:59.225 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-02T01:29:59.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-02T01:29:59.226 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:29:59.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.339 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:29:59.339 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:29:59.339 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-12-02T01:29:59.339 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2023-12-02T01:29:59.339 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:29:59.388 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-02T01:29:59.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:29:59.388 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-02T01:29:59.403 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-02T01:29:59.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:29:59.404 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-02T01:29:59.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2023-12-02T01:29:59.531 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2023-12-02T01:29:59.587 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2023-12-02T01:29:59.588 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2023-12-02T01:29:59.588 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2023-12-02T01:29:59.588 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2023-12-02T01:29:59.588 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2023-12-02T01:29:59.588 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:29:59.588 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2023-12-02T01:29:59.588 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2023-12-02T01:29:59.589 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2023-12-02T01:29:59.589 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2023-12-02T01:29:59.589 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2023-12-02T01:29:59.589 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2023-12-02T01:29:59.589 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:29:59.589 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:29:59.589 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:29:59.590 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:29:59.590 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2023-12-02T01:29:59.590 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2023-12-02T01:29:59.590 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2023-12-02T01:29:59.590 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2023-12-02T01:29:59.590 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2023-12-02T01:29:59.590 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2023-12-02T01:29:59.591 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2023-12-02T01:29:59.591 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:29:59.591 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:29:59.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.591 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2023-12-02T01:29:59.642 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-02T01:29:59.642 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-02T01:29:59.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2023-12-02T01:29:59.716 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:29:59.773 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2023-12-02T01:29:59.773 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2023-12-02T01:29:59.774 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2023-12-02T01:29:59.774 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2023-12-02T01:29:59.774 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2023-12-02T01:29:59.774 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2023-12-02T01:29:59.774 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2023-12-02T01:29:59.774 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2023-12-02T01:29:59.775 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2023-12-02T01:29:59.775 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2023-12-02T01:29:59.775 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2023-12-02T01:29:59.775 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2023-12-02T01:29:59.775 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:29:59.776 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2023-12-02T01:29:59.776 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2023-12-02T01:29:59.776 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2023-12-02T01:29:59.776 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2023-12-02T01:29:59.776 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2023-12-02T01:29:59.776 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2023-12-02T01:29:59.777 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:29:59.777 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:29:59.777 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:29:59.777 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:29:59.777 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2023-12-02T01:29:59.777 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2023-12-02T01:29:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2023-12-02T01:29:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2023-12-02T01:29:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2023-12-02T01:29:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2023-12-02T01:29:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2023-12-02T01:29:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:29:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:29:59.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.779 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2023-12-02T01:29:59.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:2023-12-02T01:29:59.801+0000 7f1072167480 -1 init, newargv = 0x56506e2f7230 newargc=15 2023-12-02T01:29:59.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[96976]: starting ceph client 2023-12-02T01:29:59.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[96976]: starting fuse 2023-12-02T01:29:59.819 INFO:teuthology.orchestra.run.smithi001.stdout:42 2023-12-02T01:29:59.819 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-12-02T01:29:59.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo stdin-killer -- python3 -c ' 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> import glob 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> import re 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> import os 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> import subprocess 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> def _find_admin_socket(client_name): 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> files = glob.glob(asok_path) 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> # Given a non-glob path, it better be there 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> if "*" not in asok_path: 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> assert(len(files) == 1) 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> return files[0] 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:29:59.820 DEBUG:teuthology.orchestra.run.smithi001:> for f in files: 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> contents = proc_f.read() 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> if mountpoint in contents: 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> return f 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> print(_find_admin_socket("client.0")) 2023-12-02T01:29:59.821 DEBUG:teuthology.orchestra.run.smithi001:> ' 2023-12-02T01:29:59.944 INFO:teuthology.orchestra.run.smithi001.stdout:/var/run/ceph/ceph-client.0.96976.asok 2023-12-02T01:29:59.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:29:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-02T01:29:59.955 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.96976.asok 2023-12-02T01:29:59.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:29:59.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.96976.asok status 2023-12-02T01:30:00.099 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-12-02T01:30:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": { 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_sha1": "bed7681480ccb0192b91a35e691658867e1e96b7", 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev)", 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "entity_id": "0", 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": "smithi001", 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "pid": "96976", 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "root": "/" 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_count": 0, 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_pinned_count": 0, 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4743, 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "inst": { 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": { 2023-12-02T01:30:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "client", 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "num": 4743 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1381117112 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1381117112 2023-12-02T01:30:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "inst_str": "client.4743 192.168.0.1:0/1381117112", 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "addr_str": "192.168.0.1:0/1381117112", 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "inode_count": 1, 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_epoch": 6, 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch": 20, 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch_barrier": 0, 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklisted": false, 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs" 2023-12-02T01:30:00.102 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-12-02T01:30:00.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-02T01:30:00.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.213+0000 7fa6a8f1d640 1 Processor -- start 2023-12-02T01:30:00.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.214+0000 7fa6a8f1d640 1 -- start start 2023-12-02T01:30:00.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.214+0000 7fa6a8f1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a415d900 0x7fa6a4099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.214+0000 7fa6a8f1d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa6a40b1de0 0x7fa6a4099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.214+0000 7fa6a8f1d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a40b0660 con 0x7fa6a40b2610 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.214+0000 7fa6a8f1d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a406c900 con 0x7fa6a40b1de0 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.214+0000 7fa6a8f1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a406cbe0 con 0x7fa6a415d900 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a2d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa6a40b1de0 0x7fa6a4099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a2d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa6a40b1de0 0x7fa6a4099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59866/0 (socket says 172.21.15.1:59866) 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/3064857930 learned_addr learned my addr 172.21.15.1:0/3064857930 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a1d9b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa6a40b2610 0x7fa6a40cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47358/0 (socket says 172.21.15.1:47358) 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a259c640 1 --2- 172.21.15.1:0/3064857930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a415d900 0x7fa6a4099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/3064857930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a415d900 msgr2=0x7fa6a4099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a2d9d640 1 --2- 172.21.15.1:0/3064857930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a415d900 0x7fa6a4099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/3064857930 >> v1:172.21.15.1:6789/0 conn(0x7fa6a40b2610 legacy=0x7fa6a40cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:00.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a159a640 1 -- 172.21.15.1:0/3064857930 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366687468 0 0) 0x7fa6a40b0660 con 0x7fa6a40b2610 2023-12-02T01:30:00.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.215+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/3064857930 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a406cec0 con 0x7fa6a40b1de0 2023-12-02T01:30:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.216+0000 7fa6a2d9d640 1 --2- 172.21.15.1:0/3064857930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a40b1de0 0x7fa6a4099eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009870 tx=0x7fa69c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a01eadc9fbd67a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.216+0000 7fa6a159a640 1 -- 172.21.15.1:0/3064857930 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c030840 con 0x7fa6a40b1de0 2023-12-02T01:30:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.216+0000 7fa6a159a640 1 -- 172.21.15.1:0/3064857930 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c0309a0 con 0x7fa6a40b1de0 2023-12-02T01:30:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.216+0000 7fa6a159a640 1 -- 172.21.15.1:0/3064857930 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c030d30 con 0x7fa6a40b1de0 2023-12-02T01:30:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.216+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/3064857930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a40b1de0 msgr2=0x7fa6a4099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.216+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/3064857930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a40b1de0 0x7fa6a4099eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009870 tx=0x7fa69c02b980 comp rx=0 tx=0).stop 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.217+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/3064857930 shutdown_connections 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.217+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/3064857930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a40b1de0 0x7fa6a4099eb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.217+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/3064857930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a415d900 0x7fa6a4099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.217+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/3064857930 >> 172.21.15.1:0/3064857930 conn(0x7fa6a40b2a70 msgr2=0x7fa6a40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.217+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/3064857930 shutdown_connections 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.217+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/3064857930 wait complete. 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.218+0000 7fa6a8f1d640 1 Processor -- start 2023-12-02T01:30:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.218+0000 7fa6a8f1d640 1 -- start start 2023-12-02T01:30:00.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a8f1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a40b1de0 0x7fa6a41e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:00.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a8f1d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a40b2610 0x7fa6a414c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:00.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a8f1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a415d900 0x7fa6a406e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:00.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a8f1d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a40c6300 con 0x7fa6a415d900 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a8f1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a406f4c0 con 0x7fa6a40b1de0 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a8f1d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a41e2f30 con 0x7fa6a40b2610 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a415d900 0x7fa6a406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a415d900 0x7fa6a406e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59876/0 (socket says 172.21.15.1:59876) 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/2889595513 learned_addr learned my addr 172.21.15.1:0/2889595513 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a259c640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a40b1de0 0x7fa6a41e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a1d9b640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a40b2610 0x7fa6a414c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a40b2610 msgr2=0x7fa6a414c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a40b2610 0x7fa6a414c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a40b1de0 msgr2=0x7fa6a41e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a40b1de0 0x7fa6a41e29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 -- 172.21.15.1:0/2889595513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0094d0 con 0x7fa6a415d900 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.219+0000 7fa6a2d9d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a415d900 0x7fa6a406e520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009870 tx=0x7fa69c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:00.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.220+0000 7fa69affd640 1 -- 172.21.15.1:0/2889595513 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c039c90 con 0x7fa6a415d900 2023-12-02T01:30:00.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.220+0000 7fa69affd640 1 -- 172.21.15.1:0/2889595513 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c039e10 con 0x7fa6a415d900 2023-12-02T01:30:00.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.220+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a406ef00 con 0x7fa6a415d900 2023-12-02T01:30:00.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.220+0000 7fa69affd640 1 -- 172.21.15.1:0/2889595513 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c043640 con 0x7fa6a415d900 2023-12-02T01:30:00.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.220+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a40c6510 con 0x7fa6a415d900 2023-12-02T01:30:00.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.221+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a4067420 con 0x7fa6a415d900 2023-12-02T01:30:00.224 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.221+0000 7fa69affd640 1 -- 172.21.15.1:0/2889595513 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa69c0437a0 con 0x7fa6a415d900 2023-12-02T01:30:00.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.221+0000 7fa69affd640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa68406ae70 0x7fa68406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:00.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.222+0000 7fa6a259c640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa68406ae70 0x7fa68406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:00.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.222+0000 7fa69affd640 1 -- 172.21.15.1:0/2889595513 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa69c03e070 con 0x7fa6a415d900 2023-12-02T01:30:00.225 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.222+0000 7fa6a259c640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa68406ae70 0x7fa68406d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa694011340 tx=0x7fa69400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:00.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.226+0000 7fa69affd640 1 -- 172.21.15.1:0/2889595513 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa69c077600 con 0x7fa6a415d900 2023-12-02T01:30:00.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.444+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6a415b130 con 0x7fa6a415d900 2023-12-02T01:30:00.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.444+0000 7fa69affd640 1 -- 172.21.15.1:0/2889595513 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa69c07ac20 con 0x7fa6a415d900 2023-12-02T01:30:00.446 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-02T01:30:00.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa68406ae70 msgr2=0x7fa68406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa68406ae70 0x7fa68406d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa694011340 tx=0x7fa69400b040 comp rx=0 tx=0).stop 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a415d900 msgr2=0x7fa6a406e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a415d900 0x7fa6a406e520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009870 tx=0x7fa69c004730 comp rx=0 tx=0).stop 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 shutdown_connections 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a415d900 0x7fa6a406e520 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a40b2610 0x7fa6a414c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa68406ae70 0x7fa68406d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 --2- 172.21.15.1:0/2889595513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a40b1de0 0x7fa6a41e29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 >> 172.21.15.1:0/2889595513 conn(0x7fa6a40b2a70 msgr2=0x7fa6a406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 shutdown_connections 2023-12-02T01:30:00.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:00.446+0000 7fa6a8f1d640 1 -- 172.21.15.1:0/2889595513 wait complete. 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-02T01:30:00.458 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-02T01:30:00.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.459 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-12-02T01:30:00.474 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-02T01:30:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42645sec preferred_lft 42645sec 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link noprefixroute 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 52:2a:7b:27:c2:89 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::437:4eff:fe2c:4ef6/64 scope link 2023-12-02T01:30:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.477 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-02T01:30:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 52:2a:7b:27:c2:89 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::502a:7bff:fe27:c289/64 scope link tentative 2023-12-02T01:30:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.477 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-02T01:30:00.544 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-12-02T01:30:00.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.546 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-12-02T01:30:00.603 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-12-02T01:30:00.603 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-02T01:30:00.603 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-02T01:30:00.603 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-02T01:30:00.603 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-02T01:30:00.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.604 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:30:00.604 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:30:00.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-02T01:30:00.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-02T01:30:00.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-02T01:30:00.605 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:30:00.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.711 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-12-02T01:30:00.726 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-02T01:30:00.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.727 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2023-12-02T01:30:00.782 INFO:teuthology.orchestra.run.smithi001.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-02T01:30:00.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.782 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:30:00.782 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:30:00.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:00.783 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-02T01:30:00.783 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:30:00.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.872 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-02T01:30:00.902 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.902 INFO:teuthology.orchestra.run.smithi001.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-02T01:30:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether da:95:fb:0c:4d:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-02T01:30:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-02T01:30:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::d895:fbff:fe0c:4df5/64 scope link 2023-12-02T01:30:00.903 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-02T01:30:00.974 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:00.974 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether da:95:fb:0c:4d:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::d895:fbff:fe0c:4df5/64 scope link 2023-12-02T01:30:00.975 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:00.977 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-02T01:30:00.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-02T01:30:00.977 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:30:01.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:01.119 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:30:01.119 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:30:01.119 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.1 up 2023-12-02T01:30:01.119 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.1 master ceph-brx 2023-12-02T01:30:01.119 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:30:01.168 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-02T01:30:01.168 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:01.168 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-02T01:30:01.183 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-02T01:30:01.183 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:01.183 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-02T01:30:01.238 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2023-12-02T01:30:01.311 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2023-12-02T01:30:01.368 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2023-12-02T01:30:01.369 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:01.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:01.371 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2023-12-02T01:30:01.424 INFO:teuthology.orchestra.run.smithi001.stdout:42 2023-12-02T01:30:01.424 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-12-02T01:30:01.424 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-02T01:30:01.466 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2023-12-02T01:30:01.497 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:01.553 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2023-12-02T01:30:01.553 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2023-12-02T01:30:01.553 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2023-12-02T01:30:01.553 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2023-12-02T01:30:01.554 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2023-12-02T01:30:01.555 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:01.556 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:01.556 INFO:teuthology.orchestra.run.smithi001.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:01.556 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:01.556 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:01.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:01.556 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2023-12-02T01:30:01.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi001.stderr:2023-12-02T01:30:01.558+0000 7f44df044480 -1 init, newargv = 0x55e4ed3aa410 newargc=15 2023-12-02T01:30:01.560 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi001.stderr:ceph-fuse[97454]: starting ceph client 2023-12-02T01:30:01.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi001.stderr:ceph-fuse[97454]: starting fuse 2023-12-02T01:30:01.575 INFO:teuthology.orchestra.run.smithi001.stdout:42 2023-12-02T01:30:01.575 INFO:teuthology.orchestra.run.smithi001.stdout:44 2023-12-02T01:30:01.575 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> sudo stdin-killer -- python3 -c ' 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> import glob 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> import re 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> import os 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> import subprocess 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> def _find_admin_socket(client_name): 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> files = glob.glob(asok_path) 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> # Given a non-glob path, it better be there 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> if "*" not in asok_path: 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> assert(len(files) == 1) 2023-12-02T01:30:01.576 DEBUG:teuthology.orchestra.run.smithi001:> return files[0] 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> for f in files: 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> contents = proc_f.read() 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> if mountpoint in contents: 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> return f 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> print(_find_admin_socket("client.2")) 2023-12-02T01:30:01.577 DEBUG:teuthology.orchestra.run.smithi001:> ' 2023-12-02T01:30:01.700 INFO:teuthology.orchestra.run.smithi001.stdout:/var/run/ceph/ceph-client.2.97454.asok 2023-12-02T01:30:01.703 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-02T01:30:01.710 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.97454.asok 2023-12-02T01:30:01.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:01.711 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.97454.asok status 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": { 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_sha1": "bed7681480ccb0192b91a35e691658867e1e96b7", 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev)", 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout: "entity_id": "2", 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": "smithi001", 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-02T01:30:01.853 INFO:teuthology.orchestra.run.smithi001.stdout: "pid": "97454", 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "root": "/" 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_count": 0, 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_pinned_count": 0, 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4758, 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "inst": { 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": { 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "client", 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "num": 4758 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2023-12-02T01:30:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.2:0", 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1216834516 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.2:0", 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1216834516 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "inst_str": "client.4758 192.168.0.2:0/1216834516", 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "addr_str": "192.168.0.2:0/1216834516", 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "inode_count": 1, 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_epoch": 6, 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch": 20, 2023-12-02T01:30:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch_barrier": 0, 2023-12-02T01:30:01.856 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklisted": false, 2023-12-02T01:30:01.856 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs" 2023-12-02T01:30:01.856 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-12-02T01:30:01.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-02T01:30:01.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.965+0000 7f27df70f640 1 Processor -- start 2023-12-02T01:30:01.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.965+0000 7f27df70f640 1 -- start start 2023-12-02T01:30:01.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.966+0000 7f27df70f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 0x7f27d80cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.966+0000 7f27df70f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d80cdd30 con 0x7f27d8160ab0 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.966+0000 7f27df70f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d80ce2d0 con 0x7f27d80d0030 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.966+0000 7f27df70f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80d0a90 con 0x7f27d80b2450 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.966+0000 7f27dd4ab640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f27d8160ab0 0x7f27d80afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51094/0 (socket says 172.21.15.1:51094) 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.966+0000 7f27dd4ab640 1 -- 172.21.15.1:0/2703281364 learned_addr learned my addr 172.21.15.1:0/2703281364 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.966+0000 7f27dccaa640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 0x7f27d80cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702109538 0 0) 0x7f27d80cdd30 con 0x7f27d8160ab0 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c4003520 con 0x7f27d8160ab0 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2990839906 0 0) 0x7f27c4003520 con 0x7f27d8160ab0 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 msgr2=0x7f27d80cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 0x7f27d80cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 >> v1:172.21.15.167:6789/0 conn(0x7f27d80d0030 legacy=0x7f27d80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80d04d0 con 0x7f27d8160ab0 2023-12-02T01:30:01.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f27d4001670 con 0x7f27d8160ab0 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 >> v1:172.21.15.1:6789/0 conn(0x7f27d8160ab0 legacy=0x7f27d80afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27c40039a0 0x7f27c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 0x7f27c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c4004d00 0x7f27c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80d0a90 con 0x7f27c40039a0 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c400bab0 con 0x7f27c4004d00 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c400bc70 con 0x7f27d80b2450 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27dd4ab640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27c40039a0 0x7f27c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27dccaa640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 0x7f27c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27ddcac640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c4004d00 0x7f27c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27dd4ab640 1 -- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 msgr2=0x7f27c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:01.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27dd4ab640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d80b2450 0x7f27c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27dd4ab640 1 -- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c4004d00 msgr2=0x7f27c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27dd4ab640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c4004d00 0x7f27c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.967+0000 7f27dd4ab640 1 -- 172.21.15.1:0/2703281364 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c4003520 con 0x7f27c40039a0 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.968+0000 7f27dd4ab640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27c40039a0 0x7f27c4003dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c240 tx=0x7f27c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e41e7eb18bafdad server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.968+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4005ad0 con 0x7f27c40039a0 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.968+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4005c50 con 0x7f27c40039a0 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.968+0000 7f27cffff640 1 -- 172.21.15.1:0/2703281364 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d402c810 con 0x7f27c40039a0 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.969+0000 7f27df70f640 1 -- 172.21.15.1:0/2703281364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27c40039a0 msgr2=0x7f27c4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.969+0000 7f27df70f640 1 --2- 172.21.15.1:0/2703281364 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27c40039a0 0x7f27c4003dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c240 tx=0x7f27c40057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.969+0000 7f27ddcac640 1 -- 172.21.15.1:0/2703281364 reap_dead start 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.969+0000 7f27df70f640 1 -- 172.21.15.1:0/2703281364 shutdown_connections 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.969+0000 7f27df70f640 1 -- 172.21.15.1:0/2703281364 >> 172.21.15.1:0/2703281364 conn(0x7f27d809c450 msgr2=0x7f27d80d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:01.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.969+0000 7f27df70f640 1 -- 172.21.15.1:0/2703281364 shutdown_connections 2023-12-02T01:30:01.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.969+0000 7f27df70f640 1 -- 172.21.15.1:0/2703281364 wait complete. 2023-12-02T01:30:01.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.970+0000 7f27df70f640 1 Processor -- start 2023-12-02T01:30:01.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.970+0000 7f27df70f640 1 -- start start 2023-12-02T01:30:01.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27df70f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27c40039a0 0x7f27d80b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27df70f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d815e6b0 0x7f27d815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27df70f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d815d800 0x7f27d815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27df70f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80b72c0 con 0x7f27d815e6b0 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27df70f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d815f050 con 0x7f27d815d800 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27df70f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80b76e0 con 0x7f27c40039a0 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d815e6b0 0x7f27d815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d815e6b0 0x7f27d815eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44014/0 (socket says 172.21.15.1:44014) 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 -- 172.21.15.1:0/3163234131 learned_addr learned my addr 172.21.15.1:0/3163234131 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27ddcac640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d815d800 0x7f27d815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dd4ab640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27c40039a0 0x7f27d80b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 -- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27c40039a0 msgr2=0x7f27d80b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27c40039a0 0x7f27d80b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 -- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d815d800 msgr2=0x7f27d815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d815d800 0x7f27d815dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 -- 172.21.15.1:0/3163234131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80b6640 con 0x7f27d815e6b0 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.971+0000 7f27dccaa640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d815e6b0 0x7f27d815eb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27c80119a0 tx=0x7f27c8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:01.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.972+0000 7f27cdffb640 1 -- 172.21.15.1:0/3163234131 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800faf0 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.972+0000 7f27cdffb640 1 -- 172.21.15.1:0/3163234131 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800fc50 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.972+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d80b6920 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.972+0000 7f27cdffb640 1 -- 172.21.15.1:0/3163234131 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8014440 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.972+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d80b6ee0 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.973+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d8161e40 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.974+0000 7f27cdffb640 1 -- 172.21.15.1:0/3163234131 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27c80145a0 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.974+0000 7f27cdffb640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f27bc06ae70 0x7f27bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.974+0000 7f27cdffb640 1 -- 172.21.15.1:0/3163234131 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27c8089d60 con 0x7f27d815e6b0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.974+0000 7f27dd4ab640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f27bc06ae70 0x7f27bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:01.978 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.975+0000 7f27dd4ab640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f27bc06ae70 0x7f27bc06d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27d4034000 tx=0x7f27d4009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:01.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:01.978+0000 7f27cdffb640 1 -- 172.21.15.1:0/3163234131 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27c8054e10 con 0x7f27d815e6b0 2023-12-02T01:30:02.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.193+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27d8067420 con 0x7f27d815e6b0 2023-12-02T01:30:02.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.193+0000 7f27cdffb640 1 -- 172.21.15.1:0/3163234131 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27c8022070 con 0x7f27d815e6b0 2023-12-02T01:30:02.195 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f27bc06ae70 msgr2=0x7f27bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f27bc06ae70 0x7f27bc06d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27d4034000 tx=0x7f27d4009030 comp rx=0 tx=0).stop 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d815e6b0 msgr2=0x7f27d815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d815e6b0 0x7f27d815eb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27c80119a0 tx=0x7f27c8011e60 comp rx=0 tx=0).stop 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 shutdown_connections 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f27bc06ae70 0x7f27bc06d330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d815d800 0x7f27d815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:02.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d815e6b0 0x7f27d815eb10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:02.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 --2- 172.21.15.1:0/3163234131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27c40039a0 0x7f27d80b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:02.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 >> 172.21.15.1:0/3163234131 conn(0x7f27d809c450 msgr2=0x7f27d80b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:02.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 shutdown_connections 2023-12-02T01:30:02.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:02.195+0000 7f27df70f640 1 -- 172.21.15.1:0/3163234131 wait complete. 2023-12-02T01:30:02.207 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-02T01:30:02.207 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-02T01:30:02.207 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2023-12-02T01:30:02.207 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-02T01:30:02.207 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:02.207 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-02T01:30:02.208 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-02T01:30:02.208 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-02T01:30:02.208 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-02T01:30:02.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.208 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42667sec preferred_lft 42667sec 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:02.228 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-02T01:30:02.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.229 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:02.229 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:02.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2023-12-02T01:30:02.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2023-12-02T01:30:02.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2023-12-02T01:30:02.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-02T01:30:02.229 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:02.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.407 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-02T01:30:02.434 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-12-02T01:30:02.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.436 DEBUG:teuthology.orchestra.run.smithi167:> route 2023-12-02T01:30:02.510 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2023-12-02T01:30:02.511 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-02T01:30:02.511 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-02T01:30:02.511 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-02T01:30:02.511 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-02T01:30:02.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.511 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:02.511 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:02.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-02T01:30:02.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-02T01:30:02.512 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-02T01:30:02.512 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:02.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.791 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-12-02T01:30:02.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.806 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2023-12-02T01:30:02.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.861 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:02.861 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:02.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:02.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-02T01:30:02.861 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:02.946 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-02T01:30:02.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-02T01:30:02.947 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:03.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:03.085 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:03.085 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:03.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2023-12-02T01:30:03.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2023-12-02T01:30:03.085 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:03.126 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-02T01:30:03.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:03.126 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:03.181 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-02T01:30:03.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:03.181 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:03.236 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-12-02T01:30:03.304 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:03.359 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-12-02T01:30:03.361 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-12-02T01:30:03.361 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-12-02T01:30:03.361 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-12-02T01:30:03.362 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-4 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-5 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-6 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-7 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-12-02T01:30:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:03.364 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:03.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:03.364 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-12-02T01:30:03.414 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-02T01:30:03.414 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-02T01:30:03.456 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-12-02T01:30:03.483 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:03.538 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-12-02T01:30:03.548 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2023-12-02T01:30:03.549 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-12-02T01:30:03.550 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-4 2023-12-02T01:30:03.551 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-5 2023-12-02T01:30:03.551 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-6 2023-12-02T01:30:03.551 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-7 2023-12-02T01:30:03.551 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-12-02T01:30:03.551 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:03.551 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:03.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:03.551 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-12-02T01:30:03.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:2023-12-02T01:30:03.561+0000 7fd516836480 -1 init, newargv = 0x555c6a3e41b0 newargc=15 2023-12-02T01:30:03.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:ceph-fuse[95108]: starting ceph client 2023-12-02T01:30:03.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:ceph-fuse[95108]: starting fuse 2023-12-02T01:30:03.577 INFO:teuthology.orchestra.run.smithi167.stdout:41 2023-12-02T01:30:03.577 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> sudo stdin-killer -- python3 -c ' 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> import re 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> import os 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2023-12-02T01:30:03.578 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> return f 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.1")) 2023-12-02T01:30:03.579 DEBUG:teuthology.orchestra.run.smithi167:> ' 2023-12-02T01:30:03.698 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.1.95108.asok 2023-12-02T01:30:03.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:30:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-02T01:30:03.708 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95108.asok 2023-12-02T01:30:03.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:03.708 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95108.asok status 2023-12-02T01:30:03.846 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-12-02T01:30:03.846 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "bed7681480ccb0192b91a35e691658867e1e96b7", 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev)", 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "1", 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "95108", 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4579, 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2023-12-02T01:30:03.847 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4579 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 1394750315 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 1394750315 2023-12-02T01:30:03.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4579 192.168.0.1:0/1394750315", 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.1:0/1394750315", 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 6, 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 20, 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2023-12-02T01:30:03.849 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-12-02T01:30:03.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-02T01:30:03.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.973+0000 7ffa6aae5640 1 Processor -- start 2023-12-02T01:30:03.975 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.973+0000 7ffa6aae5640 1 -- start start 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa6aae5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffa640d0ab0 0x7ffa640cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa6aae5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffa640d1c50 0x7ffa640cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa6aae5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6406f9d0 con 0x7ffa640cce70 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa6aae5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6406bfa0 con 0x7ffa640d1c50 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa6aae5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6406c190 con 0x7ffa640d0ab0 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa69082640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffa640d1c50 0x7ffa640cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa69082640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffa640d1c50 0x7ffa640cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44024/0 (socket says 172.21.15.1:44024) 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa69082640 1 -- 172.21.15.1:0/3587410583 learned_addr learned my addr 172.21.15.1:0/3587410583 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:03.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.974+0000 7ffa63fff640 1 --2- 172.21.15.1:0/3587410583 >> v2:172.21.15.167:3300/0 conn(0x7ffa640d0ab0 0x7ffa640cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:03.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.975+0000 7ffa69082640 1 -- 172.21.15.1:0/3587410583 >> v2:172.21.15.167:3300/0 conn(0x7ffa640d0ab0 msgr2=0x7ffa640cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:03.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.975+0000 7ffa69082640 1 --2- 172.21.15.1:0/3587410583 >> v2:172.21.15.167:3300/0 conn(0x7ffa640d0ab0 0x7ffa640cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:03.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.975+0000 7ffa69082640 1 -- 172.21.15.1:0/3587410583 >> v1:172.21.15.167:6789/0 conn(0x7ffa640cce70 legacy=0x7ffa64099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:03.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.975+0000 7ffa637fe640 1 -- 172.21.15.1:0/3587410583 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913381422 0 0) 0x7ffa6406f9d0 con 0x7ffa640cce70 2023-12-02T01:30:03.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.975+0000 7ffa69082640 1 -- 172.21.15.1:0/3587410583 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6406c470 con 0x7ffa640d1c50 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.975+0000 7ffa69082640 1 --2- 172.21.15.1:0/3587410583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640d1c50 0x7ffa640cf8d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffa640b6fd0 tx=0x7ffa5c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231e5b83af9b65d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.975+0000 7ffa637fe640 1 -- 172.21.15.1:0/3587410583 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c02cb20 con 0x7ffa640d1c50 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa637fe640 1 -- 172.21.15.1:0/3587410583 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c02cc80 con 0x7ffa640d1c50 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa637fe640 1 -- 172.21.15.1:0/3587410583 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0343f0 con 0x7ffa640d1c50 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3587410583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640d1c50 msgr2=0x7ffa640cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3587410583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640d1c50 0x7ffa640cf8d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffa640b6fd0 tx=0x7ffa5c02bf80 comp rx=0 tx=0).stop 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3587410583 shutdown_connections 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3587410583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640d1c50 0x7ffa640cf8d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3587410583 >> v2:172.21.15.167:3300/0 conn(0x7ffa640d0ab0 0x7ffa640cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3587410583 >> 172.21.15.1:0/3587410583 conn(0x7ffa640d0f20 msgr2=0x7ffa640d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3587410583 shutdown_connections 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.976+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3587410583 wait complete. 2023-12-02T01:30:03.979 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.977+0000 7ffa6aae5640 1 Processor -- start 2023-12-02T01:30:03.980 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.977+0000 7ffa6aae5640 1 -- start start 2023-12-02T01:30:03.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa6aae5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640cce70 0x7ffa6415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:03.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa6aae5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa640d0ab0 0x7ffa640add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:03.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa6aae5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa640d1c50 0x7ffa641f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:03.981 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa6aae5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b0370 con 0x7ffa640cce70 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa6aae5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6415a730 con 0x7ffa640d0ab0 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa6aae5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640afad0 con 0x7ffa640d1c50 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa68881640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640cce70 0x7ffa6415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa68881640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640cce70 0x7ffa6415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44036/0 (socket says 172.21.15.1:44036) 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.978+0000 7ffa68881640 1 -- 172.21.15.1:0/3940874045 learned_addr learned my addr 172.21.15.1:0/3940874045 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa63fff640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa640d0ab0 0x7ffa640add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa69082640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa640d1c50 0x7ffa641f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa68881640 1 -- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa640d1c50 msgr2=0x7ffa641f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa68881640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa640d1c50 0x7ffa641f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa68881640 1 -- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa640d0ab0 msgr2=0x7ffa640add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa68881640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa640d0ab0 0x7ffa640add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:03.982 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa68881640 1 -- 172.21.15.1:0/3940874045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009b30 con 0x7ffa640cce70 2023-12-02T01:30:03.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa63fff640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa640d0ab0 0x7ffa640add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:03.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa68881640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640cce70 0x7ffa6415c1c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c410 tx=0x7ffa5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:03.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa617fa640 1 -- 172.21.15.1:0/3940874045 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540035f0 con 0x7ffa640cce70 2023-12-02T01:30:03.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa617fa640 1 -- 172.21.15.1:0/3940874045 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54003770 con 0x7ffa640cce70 2023-12-02T01:30:03.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa640afdb0 con 0x7ffa640cce70 2023-12-02T01:30:03.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa617fa640 1 -- 172.21.15.1:0/3940874045 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54003b20 con 0x7ffa640cce70 2023-12-02T01:30:03.983 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.979+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6415c700 con 0x7ffa640cce70 2023-12-02T01:30:03.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.980+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa64067420 con 0x7ffa640cce70 2023-12-02T01:30:03.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.981+0000 7ffa617fa640 1 -- 172.21.15.1:0/3940874045 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa54003c80 con 0x7ffa640cce70 2023-12-02T01:30:03.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.981+0000 7ffa617fa640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffa5006ae40 0x7ffa5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:03.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.981+0000 7ffa617fa640 1 -- 172.21.15.1:0/3940874045 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa54088c20 con 0x7ffa640cce70 2023-12-02T01:30:03.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.982+0000 7ffa63fff640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffa5006ae40 0x7ffa5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:03.984 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.982+0000 7ffa63fff640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffa5006ae40 0x7ffa5006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa64155210 tx=0x7ffa58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:03.987 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:03.986+0000 7ffa617fa640 1 -- 172.21.15.1:0/3940874045 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa54053cc0 con 0x7ffa640cce70 2023-12-02T01:30:04.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.197+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa6406fbe0 con 0x7ffa640cce70 2023-12-02T01:30:04.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.197+0000 7ffa617fa640 1 -- 172.21.15.1:0/3940874045 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffa54017020 con 0x7ffa640cce70 2023-12-02T01:30:04.199 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffa5006ae40 msgr2=0x7ffa5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffa5006ae40 0x7ffa5006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa64155210 tx=0x7ffa58008040 comp rx=0 tx=0).stop 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640cce70 msgr2=0x7ffa6415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640cce70 0x7ffa6415c1c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c410 tx=0x7ffa5400c8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 shutdown_connections 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa640d1c50 0x7ffa641f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffa5006ae40 0x7ffa5006d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa640d0ab0 0x7ffa640add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 --2- 172.21.15.1:0/3940874045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa640cce70 0x7ffa6415c1c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:04.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 >> 172.21.15.1:0/3940874045 conn(0x7ffa640d0f20 msgr2=0x7ffa641568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:04.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 shutdown_connections 2023-12-02T01:30:04.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:04.199+0000 7ffa6aae5640 1 -- 172.21.15.1:0/3940874045 wait complete. 2023-12-02T01:30:04.211 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-02T01:30:04.211 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-02T01:30:04.211 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2023-12-02T01:30:04.211 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-02T01:30:04.211 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-02T01:30:04.212 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-02T01:30:04.212 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-02T01:30:04.212 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-02T01:30:04.212 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-02T01:30:04.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.212 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:04.228 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42665sec preferred_lft 42665sec 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 4e:21:da:4b:8e:56 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::8426:59ff:fed0:2944/64 scope link 2023-12-02T01:30:04.229 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.230 INFO:teuthology.orchestra.run.smithi167.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-02T01:30:04.230 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 4e:21:da:4b:8e:56 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:04.230 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::4c21:daff:fe4b:8e56/64 scope link tentative 2023-12-02T01:30:04.230 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.230 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-02T01:30:04.294 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-12-02T01:30:04.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.296 DEBUG:teuthology.orchestra.run.smithi167:> route 2023-12-02T01:30:04.352 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2023-12-02T01:30:04.352 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-02T01:30:04.352 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-02T01:30:04.352 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-02T01:30:04.352 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-02T01:30:04.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.353 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:04.353 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:04.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-02T01:30:04.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-02T01:30:04.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-02T01:30:04.353 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:04.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.450 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-12-02T01:30:04.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-02T01:30:04.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.465 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2023-12-02T01:30:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-02T01:30:04.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.520 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:04.520 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:04.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-02T01:30:04.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-02T01:30:04.521 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:04.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.602 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 5e:96:9e:74:c3:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.669 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::5c96:9eff:fe74:c389/64 scope link tentative 2023-12-02T01:30:04.670 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.671 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-02T01:30:04.737 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 5e:96:9e:74:c3:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::5c96:9eff:fe74:c389/64 scope link tentative 2023-12-02T01:30:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:04.739 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-02T01:30:04.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-02T01:30:04.740 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:04.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:04.864 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-12-02T01:30:04.864 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-12-02T01:30:04.864 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.1 up 2023-12-02T01:30:04.864 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.1 master ceph-brx 2023-12-02T01:30:04.864 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-12-02T01:30:04.906 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-02T01:30:04.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:04.907 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-02T01:30:04.966 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-02T01:30:04.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:04.966 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-02T01:30:05.020 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-12-02T01:30:05.087 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-12-02T01:30:05.143 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:05.144 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-4 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-5 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-6 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-7 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-02T01:30:05.145 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-02T01:30:05.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.146 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-12-02T01:30:05.198 INFO:teuthology.orchestra.run.smithi167.stdout:41 2023-12-02T01:30:05.198 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-12-02T01:30:05.198 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-02T01:30:05.240 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-12-02T01:30:05.267 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-12-02T01:30:05.324 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-12-02T01:30:05.325 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-4 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-5 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-6 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-7 2023-12-02T01:30:05.326 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-12-02T01:30:05.327 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:05.327 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-02T01:30:05.327 INFO:teuthology.orchestra.run.smithi167.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:05.327 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-02T01:30:05.327 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-02T01:30:05.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.327 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-12-02T01:30:05.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi167.stderr:2023-12-02T01:30:05.326+0000 7f2e45741480 -1 init, newargv = 0x5649b3530bb0 newargc=15 2023-12-02T01:30:05.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi167.stderr:ceph-fuse[95543]: starting ceph client 2023-12-02T01:30:05.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi167.stderr:ceph-fuse[95543]: starting fuse 2023-12-02T01:30:05.342 INFO:teuthology.orchestra.run.smithi167.stdout:41 2023-12-02T01:30:05.342 INFO:teuthology.orchestra.run.smithi167.stdout:44 2023-12-02T01:30:05.343 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> sudo stdin-killer -- python3 -c ' 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> import re 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> import os 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:05.343 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> return f 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.3")) 2023-12-02T01:30:05.344 DEBUG:teuthology.orchestra.run.smithi167:> ' 2023-12-02T01:30:05.463 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.3.95543.asok 2023-12-02T01:30:05.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-12-02T01:30:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-02T01:30:05.474 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.95543.asok 2023-12-02T01:30:05.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.474 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.95543.asok status 2023-12-02T01:30:05.610 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-12-02T01:30:05.610 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2023-12-02T01:30:05.610 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "bed7681480ccb0192b91a35e691658867e1e96b7", 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev)", 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "3", 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "95543", 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4505, 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2023-12-02T01:30:05.611 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4505 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.2:0", 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 205352789 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.2:0", 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 205352789 2023-12-02T01:30:05.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4505 192.168.0.2:0/205352789", 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.2:0/205352789", 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 6, 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 20, 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2023-12-02T01:30:05.613 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-12-02T01:30:05.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.619 DEBUG:teuthology.orchestra.run.smithi001:> stat --file-system '--printf=%T 2023-12-02T01:30:05.619 DEBUG:teuthology.orchestra.run.smithi001:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:05.639 INFO:teuthology.orchestra.run.smithi001.stdout:fuseblk 2023-12-02T01:30:05.639 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:05.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.639 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:05.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.717 DEBUG:teuthology.orchestra.run.smithi001:> stat --file-system '--printf=%T 2023-12-02T01:30:05.717 DEBUG:teuthology.orchestra.run.smithi001:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-02T01:30:05.776 INFO:teuthology.orchestra.run.smithi001.stdout:fuseblk 2023-12-02T01:30:05.776 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-02T01:30:05.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.776 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-02T01:30:05.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.855 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2023-12-02T01:30:05.855 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:05.871 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2023-12-02T01:30:05.871 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:05.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.871 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:05.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.939 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2023-12-02T01:30:05.939 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-02T01:30:05.994 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2023-12-02T01:30:05.995 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-02T01:30:05.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:05.995 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-02T01:30:06.062 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-02T01:30:06.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:06.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.195+0000 7ff303b90640 1 Processor -- start 2023-12-02T01:30:06.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.195+0000 7ff303b90640 1 -- start start 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff303b90640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2fc142d20 0x7ff2fc071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff303b90640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff2fc0b1df0 0x7ff2fc06d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff303b90640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc0b3130 con 0x7ff2fc06da60 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff303b90640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc06ded0 con 0x7ff2fc0b1df0 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff303b90640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc143100 con 0x7ff2fc142d20 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30112b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff2fc0b1df0 0x7ff2fc06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30112b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff2fc0b1df0 0x7ff2fc06d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44044/0 (socket says 172.21.15.1:44044) 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30112b640 1 -- 172.21.15.1:0/3795574621 learned_addr learned my addr 172.21.15.1:0/3795574621 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30192c640 1 --2- 172.21.15.1:0/3795574621 >> v2:172.21.15.167:3300/0 conn(0x7ff2fc142d20 0x7ff2fc071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30112b640 1 -- 172.21.15.1:0/3795574621 >> v2:172.21.15.167:3300/0 conn(0x7ff2fc142d20 msgr2=0x7ff2fc071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:06.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30112b640 1 --2- 172.21.15.1:0/3795574621 >> v2:172.21.15.167:3300/0 conn(0x7ff2fc142d20 0x7ff2fc071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30112b640 1 -- 172.21.15.1:0/3795574621 >> v1:172.21.15.167:6789/0 conn(0x7ff2fc06da60 legacy=0x7ff2fc0b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.196+0000 7ff30112b640 1 -- 172.21.15.1:0/3795574621 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0b2250 con 0x7ff2fc0b1df0 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.197+0000 7ff30112b640 1 --2- 172.21.15.1:0/3795574621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc0b1df0 0x7ff2fc06d520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc06ba70 tx=0x7ff2ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291989e4f2f2b8a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.197+0000 7ff30092a640 1 -- 172.21.15.1:0/3795574621 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec030860 con 0x7ff2fc0b1df0 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.197+0000 7ff30092a640 1 -- 172.21.15.1:0/3795574621 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec0309c0 con 0x7ff2fc0b1df0 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.197+0000 7ff30092a640 1 -- 172.21.15.1:0/3795574621 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec030d50 con 0x7ff2fc0b1df0 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 -- 172.21.15.1:0/3795574621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc0b1df0 msgr2=0x7ff2fc06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 --2- 172.21.15.1:0/3795574621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc0b1df0 0x7ff2fc06d520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc06ba70 tx=0x7ff2ec02b9a0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 -- 172.21.15.1:0/3795574621 shutdown_connections 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 --2- 172.21.15.1:0/3795574621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc0b1df0 0x7ff2fc06d520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 --2- 172.21.15.1:0/3795574621 >> v2:172.21.15.167:3300/0 conn(0x7ff2fc142d20 0x7ff2fc071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 -- 172.21.15.1:0/3795574621 >> 172.21.15.1:0/3795574621 conn(0x7ff2fc0b0af0 msgr2=0x7ff2fc0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:06.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 -- 172.21.15.1:0/3795574621 shutdown_connections 2023-12-02T01:30:06.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.198+0000 7ff303b90640 1 -- 172.21.15.1:0/3795574621 wait complete. 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.199+0000 7ff303b90640 1 Processor -- start 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.199+0000 7ff303b90640 1 -- start start 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff303b90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2fc06da60 0x7ff2fc154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff303b90640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2fc0b1df0 0x7ff2fc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff303b90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc142d20 0x7ff2fc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff303b90640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc15d200 con 0x7ff2fc142d20 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff303b90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc1557c0 con 0x7ff2fc06da60 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff303b90640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc155aa0 con 0x7ff2fc0b1df0 2023-12-02T01:30:06.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc142d20 0x7ff2fc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc142d20 0x7ff2fc0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44060/0 (socket says 172.21.15.1:44060) 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 -- 172.21.15.1:0/1943012040 learned_addr learned my addr 172.21.15.1:0/1943012040 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30192c640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2fc06da60 0x7ff2fc154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30112b640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2fc0b1df0 0x7ff2fc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 -- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2fc0b1df0 msgr2=0x7ff2fc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2fc0b1df0 0x7ff2fc0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 -- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2fc06da60 msgr2=0x7ff2fc154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2fc06da60 0x7ff2fc154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 -- 172.21.15.1:0/1943012040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0094d0 con 0x7ff2fc142d20 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.200+0000 7ff30212d640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc142d20 0x7ff2fc0b3a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c7a0 tx=0x7ff2f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.201+0000 7ff2f27fc640 1 -- 172.21.15.1:0/1943012040 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4003b70 con 0x7ff2fc142d20 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.201+0000 7ff2f27fc640 1 -- 172.21.15.1:0/1943012040 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f4003cf0 con 0x7ff2fc142d20 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.201+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc155d80 con 0x7ff2fc142d20 2023-12-02T01:30:06.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.201+0000 7ff2f27fc640 1 -- 172.21.15.1:0/1943012040 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4003ea0 con 0x7ff2fc142d20 2023-12-02T01:30:06.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.201+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc134220 con 0x7ff2fc142d20 2023-12-02T01:30:06.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.202+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc067420 con 0x7ff2fc142d20 2023-12-02T01:30:06.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.202+0000 7ff2f27fc640 1 -- 172.21.15.1:0/1943012040 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2f400aa90 con 0x7ff2fc142d20 2023-12-02T01:30:06.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.203+0000 7ff2f27fc640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff2e006ae40 0x7ff2e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.203+0000 7ff30192c640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff2e006ae40 0x7ff2e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.203+0000 7ff2f27fc640 1 -- 172.21.15.1:0/1943012040 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2f40892e0 con 0x7ff2fc142d20 2023-12-02T01:30:06.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.203+0000 7ff30192c640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff2e006ae40 0x7ff2e006d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009aa0 tx=0x7ff2f8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.208 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.207+0000 7ff2f27fc640 1 -- 172.21.15.1:0/1943012040 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2f4054440 con 0x7ff2fc142d20 2023-12-02T01:30:06.386 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.384+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2fc1424a0 con 0x7ff2fc142d20 2023-12-02T01:30:06.387 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.385+0000 7ff2f27fc640 1 -- 172.21.15.1:0/1943012040 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7ff2f4057a60 con 0x7ff2fc142d20 2023-12-02T01:30:06.387 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:06.388 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:06.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.387+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff2e006ae40 msgr2=0x7ff2e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff2e006ae40 0x7ff2e006d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009aa0 tx=0x7ff2f8009190 comp rx=0 tx=0).stop 2023-12-02T01:30:06.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc142d20 msgr2=0x7ff2fc0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc142d20 0x7ff2fc0b3a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c7a0 tx=0x7ff2f400cc60 comp rx=0 tx=0).stop 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 shutdown_connections 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2fc142d20 0x7ff2fc0b3a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2fc0b1df0 0x7ff2fc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff2e006ae40 0x7ff2e006d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 --2- 172.21.15.1:0/1943012040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2fc06da60 0x7ff2fc154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 >> 172.21.15.1:0/1943012040 conn(0x7ff2fc0b0af0 msgr2=0x7ff2fc0709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 shutdown_connections 2023-12-02T01:30:06.390 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.388+0000 7ff303b90640 1 -- 172.21.15.1:0/1943012040 wait complete. 2023-12-02T01:30:06.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:06.400 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.509+0000 7f28c1168640 1 Processor -- start 2023-12-02T01:30:06.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.509+0000 7f28c1168640 1 -- start start 2023-12-02T01:30:06.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.509+0000 7f28c1168640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28bc09a080 0x7f28bc0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.509+0000 7f28c1168640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc0b3590 con 0x7f28bc0b6b50 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.509+0000 7f28c1168640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc06b310 con 0x7f28bc06bc50 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.509+0000 7f28c1168640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0cd3a0 con 0x7f28bc09a080 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.510+0000 7f28ba59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28bc09a080 0x7f28bc0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.510+0000 7f28bad9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f28bc0b6b50 0x7f28bc099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51104/0 (socket says 172.21.15.1:51104) 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.510+0000 7f28bad9d640 1 -- 172.21.15.1:0/990384372 learned_addr learned my addr 172.21.15.1:0/990384372 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.510+0000 7f28ba59c640 1 -- 172.21.15.1:0/990384372 >> v1:172.21.15.167:6789/0 conn(0x7f28bc06bc50 legacy=0x7f28bc06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.510+0000 7f28ba59c640 1 -- 172.21.15.1:0/990384372 >> v1:172.21.15.1:6789/0 conn(0x7f28bc0b6b50 legacy=0x7f28bc099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.510+0000 7f28ba59c640 1 -- 172.21.15.1:0/990384372 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0b37c0 con 0x7f28bc09a080 2023-12-02T01:30:06.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.510+0000 7f28b9d9b640 1 -- 172.21.15.1:0/990384372 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911191597 0 0) 0x7f28bc0b3590 con 0x7f28bc0b6b50 2023-12-02T01:30:06.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28ba59c640 1 --2- 172.21.15.1:0/990384372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc09a080 0x7f28bc0cfd40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f28b00097a0 tx=0x7f28b002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8cca2360240058 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.513 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28b9d9b640 1 -- 172.21.15.1:0/990384372 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b002f810 con 0x7f28bc09a080 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28b9d9b640 1 -- 172.21.15.1:0/990384372 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b002f970 con 0x7f28bc09a080 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28b9d9b640 1 -- 172.21.15.1:0/990384372 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b002fd00 con 0x7f28bc09a080 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28c1168640 1 -- 172.21.15.1:0/990384372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc09a080 msgr2=0x7f28bc0cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28c1168640 1 --2- 172.21.15.1:0/990384372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc09a080 0x7f28bc0cfd40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f28b00097a0 tx=0x7f28b002b9f0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28c1168640 1 -- 172.21.15.1:0/990384372 shutdown_connections 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28c1168640 1 --2- 172.21.15.1:0/990384372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc09a080 0x7f28bc0cfd40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28c1168640 1 -- 172.21.15.1:0/990384372 >> 172.21.15.1:0/990384372 conn(0x7f28bc0b2a70 msgr2=0x7f28bc0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28c1168640 1 -- 172.21.15.1:0/990384372 shutdown_connections 2023-12-02T01:30:06.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.511+0000 7f28c1168640 1 -- 172.21.15.1:0/990384372 wait complete. 2023-12-02T01:30:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.513+0000 7f28c1168640 1 Processor -- start 2023-12-02T01:30:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.513+0000 7f28c1168640 1 -- start start 2023-12-02T01:30:06.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28c1168640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28bc06bc50 0x7f28bc0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28c1168640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28bc09a080 0x7f28bc0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28c1168640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc0b6b50 0x7f28bc1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28c1168640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc15d620 con 0x7f28bc0b6b50 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28c1168640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0c76c0 con 0x7f28bc09a080 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28c1168640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0c51b0 con 0x7f28bc06bc50 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc0b6b50 0x7f28bc1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc0b6b50 0x7f28bc1f2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44082/0 (socket says 172.21.15.1:44082) 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 -- 172.21.15.1:0/2127673117 learned_addr learned my addr 172.21.15.1:0/2127673117 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28ba59c640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28bc09a080 0x7f28bc0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bad9d640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28bc06bc50 0x7f28bc0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 -- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28bc06bc50 msgr2=0x7f28bc0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28bc06bc50 0x7f28bc0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 -- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28bc09a080 msgr2=0x7f28bc0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28bc09a080 0x7f28bc0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 -- 172.21.15.1:0/2127673117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0009400 con 0x7f28bc0b6b50 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28ba59c640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28bc09a080 0x7f28bc0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.514+0000 7f28bb59e640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc0b6b50 0x7f28bc1f2690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f28b400c7a0 tx=0x7f28b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.515+0000 7f28a37fe640 1 -- 172.21.15.1:0/2127673117 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4003b70 con 0x7f28bc0b6b50 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.515+0000 7f28a37fe640 1 -- 172.21.15.1:0/2127673117 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4003cf0 con 0x7f28bc0b6b50 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.515+0000 7f28a37fe640 1 -- 172.21.15.1:0/2127673117 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4003ea0 con 0x7f28bc0b6b50 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.515+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0c5490 con 0x7f28bc0b6b50 2023-12-02T01:30:06.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.515+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc0c5a50 con 0x7f28bc0b6b50 2023-12-02T01:30:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.516+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc0c7ea0 con 0x7f28bc0b6b50 2023-12-02T01:30:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.516+0000 7f28a37fe640 1 -- 172.21.15.1:0/2127673117 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28b400aa90 con 0x7f28bc0b6b50 2023-12-02T01:30:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.516+0000 7f28a37fe640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28a806ae40 0x7f28a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.517+0000 7f28a37fe640 1 -- 172.21.15.1:0/2127673117 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28b4089470 con 0x7f28bc0b6b50 2023-12-02T01:30:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.517+0000 7f28bad9d640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28a806ae40 0x7f28a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.517+0000 7f28bad9d640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28a806ae40 0x7f28a806d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f28ac000f60 tx=0x7f28ac007d00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.521+0000 7f28a37fe640 1 -- 172.21.15.1:0/2127673117 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28b4054520 con 0x7f28bc0b6b50 2023-12-02T01:30:06.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.695+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28bc0cbb70 con 0x7f28bc0b6b50 2023-12-02T01:30:06.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.696+0000 7f28a37fe640 1 -- 172.21.15.1:0/2127673117 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28bc0cbb70 con 0x7f28bc0b6b50 2023-12-02T01:30:06.697 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28a806ae40 msgr2=0x7f28a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28a806ae40 0x7f28a806d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f28ac000f60 tx=0x7f28ac007d00 comp rx=0 tx=0).stop 2023-12-02T01:30:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc0b6b50 msgr2=0x7f28bc1f2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc0b6b50 0x7f28bc1f2690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f28b400c7a0 tx=0x7f28b400cc60 comp rx=0 tx=0).stop 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 shutdown_connections 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28bc0b6b50 0x7f28bc1f2690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28a806ae40 0x7f28a806d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28bc09a080 0x7f28bc0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 --2- 172.21.15.1:0/2127673117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28bc06bc50 0x7f28bc0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.697+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 >> 172.21.15.1:0/2127673117 conn(0x7f28bc0b2a70 msgr2=0x7f28bc099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.698+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 shutdown_connections 2023-12-02T01:30:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.698+0000 7f28c1168640 1 -- 172.21.15.1:0/2127673117 wait complete. 2023-12-02T01:30:06.711 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:06.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.819+0000 7fdefee87640 1 Processor -- start 2023-12-02T01:30:06.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.819+0000 7fdefee87640 1 -- start start 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefee87640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdef809a080 0x7fdef80cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefee87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 0x7fdef806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefee87640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80b3590 con 0x7fdef80b6b50 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefee87640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef806b310 con 0x7fdef809a080 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefee87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80cd3a0 con 0x7fdef806bc50 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefcc23640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdef80b6b50 0x7fdef8099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51114/0 (socket says 172.21.15.1:51114) 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefcc23640 1 -- 172.21.15.1:0/3529467916 learned_addr learned my addr 172.21.15.1:0/3529467916 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094292189 0 0) 0x7fdef80b3590 con 0x7fdef80b6b50 2023-12-02T01:30:06.824 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee8003520 con 0x7fdef80b6b50 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef7fff640 1 --2- 172.21.15.1:0/3529467916 >> v2:172.21.15.167:3300/0 conn(0x7fdef809a080 0x7fdef80cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefd424640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 0x7fdef806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 769453724 0 0) 0x7fdee8003520 con 0x7fdef80b6b50 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 msgr2=0x7fdef806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 0x7fdef806c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 >> v2:172.21.15.167:3300/0 conn(0x7fdef809a080 msgr2=0x7fdef80cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 --2- 172.21.15.1:0/3529467916 >> v2:172.21.15.167:3300/0 conn(0x7fdef809a080 0x7fdef80cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80b37c0 con 0x7fdef80b6b50 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fdeec001670 con 0x7fdef80b6b50 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdefd424640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 0x7fdef806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:06.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.820+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 >> v1:172.21.15.1:6789/0 conn(0x7fdef80b6b50 legacy=0x7fdef8099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef77fe640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 0x7fdee8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef77fe640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdee80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef77fe640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdee8004d00 0x7fdee8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef806b310 con 0x7fdee8004d00 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80cd3a0 con 0x7fdee8003eb0 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800ba30 con 0x7fdef806bc50 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdefd424640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdee8004d00 0x7fdee8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef7fff640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdee80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdefcc23640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 0x7fdee8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef7fff640 1 -- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 msgr2=0x7fdee8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef7fff640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef806bc50 0x7fdee8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef7fff640 1 -- 172.21.15.1:0/3529467916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdee8004d00 msgr2=0x7fdee8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef7fff640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdee8004d00 0x7fdee8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdef7fff640 1 -- 172.21.15.1:0/3529467916 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8003520 con 0x7fdee8003eb0 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.821+0000 7fdefd424640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdee8004d00 0x7fdee8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdef7fff640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdee80047c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009a90 tx=0x7fdee80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=382657f85a1a543a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee402c6b0 con 0x7fdee8003eb0 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee402c810 con 0x7fdee8003eb0 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdef77fe640 1 -- 172.21.15.1:0/3529467916 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee402cbc0 con 0x7fdee8003eb0 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdefee87640 1 -- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 msgr2=0x7fdee80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdefee87640 1 --2- 172.21.15.1:0/3529467916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdee80047c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009a90 tx=0x7fdee80057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdefd424640 1 -- 172.21.15.1:0/3529467916 reap_dead start 2023-12-02T01:30:06.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdefee87640 1 -- 172.21.15.1:0/3529467916 shutdown_connections 2023-12-02T01:30:06.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdefee87640 1 -- 172.21.15.1:0/3529467916 >> 172.21.15.1:0/3529467916 conn(0x7fdef80b2a70 msgr2=0x7fdef80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:06.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdefee87640 1 -- 172.21.15.1:0/3529467916 shutdown_connections 2023-12-02T01:30:06.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.822+0000 7fdefee87640 1 -- 172.21.15.1:0/3529467916 wait complete. 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.824+0000 7fdefee87640 1 Processor -- start 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.824+0000 7fdefee87640 1 -- start start 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.824+0000 7fdefee87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdef80b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.824+0000 7fdefee87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef80adbc0 0x7fdef814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.824+0000 7fdefee87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef80af420 0x7fdef80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefee87640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80aef90 con 0x7fdef80af420 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefee87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80ae380 con 0x7fdee8003eb0 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefee87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80ae660 con 0x7fdef80adbc0 2023-12-02T01:30:06.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef80af420 0x7fdef80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef80af420 0x7fdef80b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44100/0 (socket says 172.21.15.1:44100) 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 -- 172.21.15.1:0/1624630051 learned_addr learned my addr 172.21.15.1:0/1624630051 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefcc23640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdef80b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdef7fff640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef80adbc0 0x7fdef814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 -- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef80adbc0 msgr2=0x7fdef814f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef80adbc0 0x7fdef814f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 -- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 msgr2=0x7fdef80b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdef80b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 -- 172.21.15.1:0/1624630051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80ae940 con 0x7fdef80af420 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefd424640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef80af420 0x7fdef80b4e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdef80719d0 tx=0x7fdef0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdef57fa640 1 -- 172.21.15.1:0/1624630051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0015420 con 0x7fdef80af420 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdef57fa640 1 -- 172.21.15.1:0/1624630051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef00155a0 con 0x7fdef80af420 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdef57fa640 1 -- 172.21.15.1:0/1624630051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0015950 con 0x7fdef80af420 2023-12-02T01:30:06.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80aec20 con 0x7fdef80af420 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.825+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef814f840 con 0x7fdef80af420 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.826+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef80af100 con 0x7fdef80af420 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.827+0000 7fdef57fa640 1 -- 172.21.15.1:0/1624630051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdef0015ab0 con 0x7fdef80af420 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.827+0000 7fdef57fa640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdedc06ae70 0x7fdedc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.827+0000 7fdef57fa640 1 -- 172.21.15.1:0/1624630051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdef0089ca0 con 0x7fdef80af420 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.827+0000 7fdefcc23640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdedc06ae70 0x7fdedc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.828+0000 7fdefcc23640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdedc06ae70 0x7fdedc06d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdeec001cc0 tx=0x7fdeec0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:06.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:06.831+0000 7fdef57fa640 1 -- 172.21.15.1:0/1624630051 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdef0054d60 con 0x7fdef80af420 2023-12-02T01:30:07.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.006+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdef809ef40 con 0x7fdef80af420 2023-12-02T01:30:07.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.007+0000 7fdef57fa640 1 -- 172.21.15.1:0/1624630051 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdef0009c80 con 0x7fdef80af420 2023-12-02T01:30:07.008 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:07.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.008+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdedc06ae70 msgr2=0x7fdedc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.008+0000 7fdefee87640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdedc06ae70 0x7fdedc06d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdeec001cc0 tx=0x7fdeec0078f0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.008+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef80af420 msgr2=0x7fdef80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.008+0000 7fdefee87640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef80af420 0x7fdef80b4e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdef80719d0 tx=0x7fdef0007700 comp rx=0 tx=0).stop 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.008+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 shutdown_connections 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.008+0000 7fdefee87640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef80af420 0x7fdef80b4e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.009+0000 7fdefee87640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdef80adbc0 0x7fdef814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.009+0000 7fdefee87640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fdedc06ae70 0x7fdedc06d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.009+0000 7fdefee87640 1 --2- 172.21.15.1:0/1624630051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdee8003eb0 0x7fdef80b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.009+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 >> 172.21.15.1:0/1624630051 conn(0x7fdef80b2a70 msgr2=0x7fdef80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.009+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 shutdown_connections 2023-12-02T01:30:07.011 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.009+0000 7fdefee87640 1 -- 172.21.15.1:0/1624630051 wait complete. 2023-12-02T01:30:07.021 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:07.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.129+0000 7efd7113c640 1 Processor -- start 2023-12-02T01:30:07.131 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.129+0000 7efd7113c640 1 -- start start 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd7113c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efd6c06abe0 0x7efd6c0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd7113c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0cf790 con 0x7efd6c1465d0 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd7113c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c072160 con 0x7efd6c071d40 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd7113c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c161d80 con 0x7efd6c06abe0 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd6ad9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efd6c1465d0 0x7efd6c06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51130/0 (socket says 172.21.15.1:51130) 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd6ad9d640 1 -- 172.21.15.1:0/328633778 learned_addr learned my addr 172.21.15.1:0/328633778 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd6a59c640 1 --2- 172.21.15.1:0/328633778 >> v2:172.21.15.1:3300/0 conn(0x7efd6c06abe0 0x7efd6c0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd69d9b640 1 -- 172.21.15.1:0/328633778 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422794694 0 0) 0x7efd6c0cf790 con 0x7efd6c1465d0 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd69d9b640 1 -- 172.21.15.1:0/328633778 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd54003520 con 0x7efd6c1465d0 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd6a59c640 1 -- 172.21.15.1:0/328633778 >> v1:172.21.15.167:6789/0 conn(0x7efd6c071d40 legacy=0x7efd6c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:07.132 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd6a59c640 1 -- 172.21.15.1:0/328633778 >> v1:172.21.15.1:6789/0 conn(0x7efd6c1465d0 legacy=0x7efd6c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.130+0000 7efd6a59c640 1 -- 172.21.15.1:0/328633778 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c1614e0 con 0x7efd6c06abe0 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.131+0000 7efd6a59c640 1 --2- 172.21.15.1:0/328633778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c06abe0 0x7efd6c0b2ee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd600097a0 tx=0x7efd6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd6b7f68c370e35 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.131+0000 7efd69d9b640 1 -- 172.21.15.1:0/328633778 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60031830 con 0x7efd6c06abe0 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.131+0000 7efd69d9b640 1 -- 172.21.15.1:0/328633778 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60031990 con 0x7efd6c06abe0 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.131+0000 7efd69d9b640 1 -- 172.21.15.1:0/328633778 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60031d20 con 0x7efd6c06abe0 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.132+0000 7efd7113c640 1 -- 172.21.15.1:0/328633778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c06abe0 msgr2=0x7efd6c0b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.132+0000 7efd7113c640 1 --2- 172.21.15.1:0/328633778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c06abe0 0x7efd6c0b2ee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd600097a0 tx=0x7efd6002b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.132+0000 7efd7113c640 1 -- 172.21.15.1:0/328633778 shutdown_connections 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.132+0000 7efd7113c640 1 --2- 172.21.15.1:0/328633778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c06abe0 0x7efd6c0b2ee0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.132+0000 7efd7113c640 1 -- 172.21.15.1:0/328633778 >> 172.21.15.1:0/328633778 conn(0x7efd6c0cc930 msgr2=0x7efd6c0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.132+0000 7efd7113c640 1 -- 172.21.15.1:0/328633778 shutdown_connections 2023-12-02T01:30:07.134 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.132+0000 7efd7113c640 1 -- 172.21.15.1:0/328633778 wait complete. 2023-12-02T01:30:07.136 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.133+0000 7efd7113c640 1 Processor -- start 2023-12-02T01:30:07.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.133+0000 7efd7113c640 1 -- start start 2023-12-02T01:30:07.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd7113c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c071d40 0x7efd6c13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd7113c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd6c1465d0 0x7efd6c140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd7113c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd6c15f8e0 0x7efd6c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd7113c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c13f190 con 0x7efd6c071d40 2023-12-02T01:30:07.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd7113c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c160150 con 0x7efd6c1465d0 2023-12-02T01:30:07.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd7113c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1409a0 con 0x7efd6c15f8e0 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c071d40 0x7efd6c13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c071d40 0x7efd6c13ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44114/0 (socket says 172.21.15.1:44114) 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 -- 172.21.15.1:0/1779792989 learned_addr learned my addr 172.21.15.1:0/1779792989 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6a59c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd6c1465d0 0x7efd6c140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6b59e640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd6c15f8e0 0x7efd6c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 -- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd6c15f8e0 msgr2=0x7efd6c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd6c15f8e0 0x7efd6c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 -- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd6c1465d0 msgr2=0x7efd6c140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd6c1465d0 0x7efd6c140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6ad9d640 1 -- 172.21.15.1:0/1779792989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009400 con 0x7efd6c071d40 2023-12-02T01:30:07.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.134+0000 7efd6b59e640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd6c15f8e0 0x7efd6c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:07.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.135+0000 7efd6ad9d640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c071d40 0x7efd6c13ec50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efd6400cbf0 tx=0x7efd6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.135+0000 7efd537fe640 1 -- 172.21.15.1:0/1779792989 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6400ad40 con 0x7efd6c071d40 2023-12-02T01:30:07.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.135+0000 7efd537fe640 1 -- 172.21.15.1:0/1779792989 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64012400 con 0x7efd6c071d40 2023-12-02T01:30:07.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.135+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c13f3c0 con 0x7efd6c071d40 2023-12-02T01:30:07.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.135+0000 7efd537fe640 1 -- 172.21.15.1:0/1779792989 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6400aea0 con 0x7efd6c071d40 2023-12-02T01:30:07.139 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.135+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c13f980 con 0x7efd6c071d40 2023-12-02T01:30:07.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.136+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c06e6a0 con 0x7efd6c071d40 2023-12-02T01:30:07.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.136+0000 7efd537fe640 1 -- 172.21.15.1:0/1779792989 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd64007070 con 0x7efd6c071d40 2023-12-02T01:30:07.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.137+0000 7efd537fe640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7efd5806ae70 0x7efd5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.137+0000 7efd537fe640 1 -- 172.21.15.1:0/1779792989 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd64089600 con 0x7efd6c071d40 2023-12-02T01:30:07.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.137+0000 7efd6a59c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7efd5806ae70 0x7efd5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.140 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.137+0000 7efd6a59c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7efd5806ae70 0x7efd5806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd60036000 tx=0x7efd60008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.141+0000 7efd537fe640 1 -- 172.21.15.1:0/1779792989 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd640546b0 con 0x7efd6c071d40 2023-12-02T01:30:07.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.316+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd6c04e920 con 0x7efd6c071d40 2023-12-02T01:30:07.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.317+0000 7efd537fe640 1 -- 172.21.15.1:0/1779792989 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd64057cd0 con 0x7efd6c071d40 2023-12-02T01:30:07.319 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:07.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7efd5806ae70 msgr2=0x7efd5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7efd5806ae70 0x7efd5806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd60036000 tx=0x7efd60008030 comp rx=0 tx=0).stop 2023-12-02T01:30:07.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c071d40 msgr2=0x7efd6c13ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c071d40 0x7efd6c13ec50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efd6400cbf0 tx=0x7efd6400a430 comp rx=0 tx=0).stop 2023-12-02T01:30:07.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 shutdown_connections 2023-12-02T01:30:07.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd6c15f8e0 0x7efd6c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7efd5806ae70 0x7efd5806d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd6c1465d0 0x7efd6c140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 --2- 172.21.15.1:0/1779792989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd6c071d40 0x7efd6c13ec50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 >> 172.21.15.1:0/1779792989 conn(0x7efd6c0cc930 msgr2=0x7efd6c06e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:07.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 shutdown_connections 2023-12-02T01:30:07.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.319+0000 7efd7113c640 1 -- 172.21.15.1:0/1779792989 wait complete. 2023-12-02T01:30:07.332 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.438+0000 7f0bf0087640 1 Processor -- start 2023-12-02T01:30:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.438+0000 7f0bf0087640 1 -- start start 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bf0087640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 0x7f0be80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bf0087640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0be80d1e30 0x7f0be80b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bf0087640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be80b5f90 con 0x7f0be80ced30 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bf0087640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be80cf170 con 0x7f0be80d1e30 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bf0087640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80b61e0 con 0x7f0be815d3e0 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bee624640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0be80d1e30 0x7f0be80b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bee624640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0be80d1e30 0x7f0be80b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44120/0 (socket says 172.21.15.1:44120) 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bee624640 1 -- 172.21.15.1:0/2162662963 learned_addr learned my addr 172.21.15.1:0/2162662963 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bede23640 1 --2- 172.21.15.1:0/2162662963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 0x7f0be80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bee624640 1 -- 172.21.15.1:0/2162662963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 msgr2=0x7f0be80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bee624640 1 --2- 172.21.15.1:0/2162662963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 0x7f0be80ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bee624640 1 -- 172.21.15.1:0/2162662963 >> v1:172.21.15.167:6789/0 conn(0x7f0be80ced30 legacy=0x7f0be80d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.439+0000 7f0bee624640 1 -- 172.21.15.1:0/2162662963 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be80b64c0 con 0x7f0be80d1e30 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.440+0000 7f0bee624640 1 --2- 172.21.15.1:0/2162662963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80d1e30 0x7f0be80b3db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009e80 tx=0x7f0be002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1563aa922f189d71 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.440+0000 7f0bece21640 1 -- 172.21.15.1:0/2162662963 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be002caf0 con 0x7f0be80d1e30 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.440+0000 7f0bece21640 1 -- 172.21.15.1:0/2162662963 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be002cc50 con 0x7f0be80d1e30 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.440+0000 7f0bece21640 1 -- 172.21.15.1:0/2162662963 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00343f0 con 0x7f0be80d1e30 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 -- 172.21.15.1:0/2162662963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80d1e30 msgr2=0x7f0be80b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 --2- 172.21.15.1:0/2162662963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80d1e30 0x7f0be80b3db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009e80 tx=0x7f0be002bf50 comp rx=0 tx=0).stop 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 -- 172.21.15.1:0/2162662963 shutdown_connections 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 --2- 172.21.15.1:0/2162662963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80d1e30 0x7f0be80b3db0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 --2- 172.21.15.1:0/2162662963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 0x7f0be80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 -- 172.21.15.1:0/2162662963 >> 172.21.15.1:0/2162662963 conn(0x7f0be809c480 msgr2=0x7f0be80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 -- 172.21.15.1:0/2162662963 shutdown_connections 2023-12-02T01:30:07.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.441+0000 7f0bf0087640 1 -- 172.21.15.1:0/2162662963 wait complete. 2023-12-02T01:30:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.442+0000 7f0bf0087640 1 Processor -- start 2023-12-02T01:30:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.442+0000 7f0bf0087640 1 -- start start 2023-12-02T01:30:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bf0087640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80ced30 0x7f0be81f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bf0087640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0be80d1e30 0x7f0be809ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bf0087640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 0x7f0be815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bf0087640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be809dc10 con 0x7f0be80ced30 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bf0087640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be81f7010 con 0x7f0be80d1e30 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bf0087640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be809cf90 con 0x7f0be815d3e0 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80ced30 0x7f0be81f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80ced30 0x7f0be81f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44128/0 (socket says 172.21.15.1:44128) 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 -- 172.21.15.1:0/1433752361 learned_addr learned my addr 172.21.15.1:0/1433752361 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 -- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 msgr2=0x7f0be815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 0x7f0be815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 -- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0be80d1e30 msgr2=0x7f0be809ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bed622640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0be80d1e30 0x7f0be809ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0be80d1e30 0x7f0be809ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 -- 172.21.15.1:0/1433752361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0009b30 con 0x7f0be80ced30 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bed622640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0be80d1e30 0x7f0be809ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.443+0000 7f0bede23640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80ced30 0x7f0be81f6ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0be400e870 tx=0x7f0be400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.444+0000 7f0bde7fc640 1 -- 172.21.15.1:0/1433752361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40094f0 con 0x7f0be80ced30 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.444+0000 7f0bde7fc640 1 -- 172.21.15.1:0/1433752361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400c940 con 0x7f0be80ced30 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.444+0000 7f0bde7fc640 1 -- 172.21.15.1:0/1433752361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400ccf0 con 0x7f0be80ced30 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.444+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be809d270 con 0x7f0be80ced30 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.444+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be809d830 con 0x7f0be80ced30 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.445+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8067420 con 0x7f0be80ced30 2023-12-02T01:30:07.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.445+0000 7f0bde7fc640 1 -- 172.21.15.1:0/1433752361 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0be4013470 con 0x7f0be80ced30 2023-12-02T01:30:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.445+0000 7f0bde7fc640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0bcc06ae40 0x7f0bcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.445+0000 7f0bde7fc640 1 -- 172.21.15.1:0/1433752361 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0be40896a0 con 0x7f0be80ced30 2023-12-02T01:30:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.445+0000 7f0bed622640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0bcc06ae40 0x7f0bcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.446+0000 7f0bed622640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0bcc06ae40 0x7f0bcc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0be81f3c40 tx=0x7f0bd8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.450+0000 7f0bde7fc640 1 -- 172.21.15.1:0/1433752361 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0be40547e0 con 0x7f0be80ced30 2023-12-02T01:30:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.627+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0be80d1500 con 0x7f0be80ced30 2023-12-02T01:30:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.628+0000 7f0bde7fc640 1 -- 172.21.15.1:0/1433752361 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f0be4057e00 con 0x7f0be80ced30 2023-12-02T01:30:07.630 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:07.630 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0bcc06ae40 msgr2=0x7f0bcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0bcc06ae40 0x7f0bcc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0be81f3c40 tx=0x7f0bd8009040 comp rx=0 tx=0).stop 2023-12-02T01:30:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80ced30 msgr2=0x7f0be81f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80ced30 0x7f0be81f6ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0be400e870 tx=0x7f0be400ed30 comp rx=0 tx=0).stop 2023-12-02T01:30:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 shutdown_connections 2023-12-02T01:30:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0be815d3e0 0x7f0be815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0bcc06ae40 0x7f0bcc06d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0be80d1e30 0x7f0be809ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 --2- 172.21.15.1:0/1433752361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0be80ced30 0x7f0be81f6ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 >> 172.21.15.1:0/1433752361 conn(0x7f0be809c480 msgr2=0x7f0be81600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:07.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 shutdown_connections 2023-12-02T01:30:07.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.630+0000 7f0bf0087640 1 -- 172.21.15.1:0/1433752361 wait complete. 2023-12-02T01:30:07.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:07.643 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:07.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.751+0000 7f7180697640 1 Processor -- start 2023-12-02T01:30:07.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.751+0000 7f7180697640 1 -- start start 2023-12-02T01:30:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f7180697640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f717815a6b0 0x7f717806d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f7180697640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f717806d660 0x7f717806c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f7180697640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780cebe0 con 0x7f71780ce800 2023-12-02T01:30:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f7180697640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717806db10 con 0x7f717815a6b0 2023-12-02T01:30:07.754 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f7180697640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7178070da0 con 0x7f717806d660 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f717dc32640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f717815a6b0 0x7f717806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f717dc32640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f717815a6b0 0x7f717806d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44144/0 (socket says 172.21.15.1:44144) 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.752+0000 7f717dc32640 1 -- 172.21.15.1:0/2465669416 learned_addr learned my addr 172.21.15.1:0/2465669416 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.753+0000 7f717ec34640 1 --2- 172.21.15.1:0/2465669416 >> v2:172.21.15.167:3300/0 conn(0x7f717806d660 0x7f717806c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.753+0000 7f717dc32640 1 -- 172.21.15.1:0/2465669416 >> v2:172.21.15.167:3300/0 conn(0x7f717806d660 msgr2=0x7f717806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.753+0000 7f717dc32640 1 --2- 172.21.15.1:0/2465669416 >> v2:172.21.15.167:3300/0 conn(0x7f717806d660 0x7f717806c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.753+0000 7f717dc32640 1 -- 172.21.15.1:0/2465669416 >> v1:172.21.15.167:6789/0 conn(0x7f71780ce800 legacy=0x7f71780702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.753+0000 7f717dc32640 1 -- 172.21.15.1:0/2465669416 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178071080 con 0x7f717815a6b0 2023-12-02T01:30:07.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.753+0000 7f717ec34640 1 --2- 172.21.15.1:0/2465669416 >> v2:172.21.15.167:3300/0 conn(0x7f717806d660 0x7f717806c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.753+0000 7f717dc32640 1 --2- 172.21.15.1:0/2465669416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717815a6b0 0x7f717806d120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f717815e2e0 tx=0x7f716c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c3e054b46bc16d server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f717d431640 1 -- 172.21.15.1:0/2465669416 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0317e0 con 0x7f717815a6b0 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f717d431640 1 -- 172.21.15.1:0/2465669416 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c031940 con 0x7f717815a6b0 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f717d431640 1 -- 172.21.15.1:0/2465669416 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c031cd0 con 0x7f717815a6b0 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 -- 172.21.15.1:0/2465669416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717815a6b0 msgr2=0x7f717806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 --2- 172.21.15.1:0/2465669416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717815a6b0 0x7f717806d120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f717815e2e0 tx=0x7f716c02b880 comp rx=0 tx=0).stop 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 -- 172.21.15.1:0/2465669416 shutdown_connections 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 --2- 172.21.15.1:0/2465669416 >> v2:172.21.15.167:3300/0 conn(0x7f717806d660 0x7f717806c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 --2- 172.21.15.1:0/2465669416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717815a6b0 0x7f717806d120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 -- 172.21.15.1:0/2465669416 >> 172.21.15.1:0/2465669416 conn(0x7f717806a8f0 msgr2=0x7f717806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:07.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 -- 172.21.15.1:0/2465669416 shutdown_connections 2023-12-02T01:30:07.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.754+0000 7f7180697640 1 -- 172.21.15.1:0/2465669416 wait complete. 2023-12-02T01:30:07.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.755+0000 7f7180697640 1 Processor -- start 2023-12-02T01:30:07.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.755+0000 7f7180697640 1 -- start start 2023-12-02T01:30:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f7180697640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f717806d660 0x7f7178135570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f7180697640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71780ce800 0x7f717814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f7180697640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f717815a6b0 0x7f7178147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f7180697640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7178149000 con 0x7f71780ce800 2023-12-02T01:30:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f7180697640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71781483f0 con 0x7f717815a6b0 2023-12-02T01:30:07.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f7180697640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71781486d0 con 0x7f717806d660 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f717dc32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71780ce800 0x7f717814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f717dc32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71780ce800 0x7f717814ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44146/0 (socket says 172.21.15.1:44146) 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.756+0000 7f717dc32640 1 -- 172.21.15.1:0/2130107876 learned_addr learned my addr 172.21.15.1:0/2130107876 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717ec34640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f717815a6b0 0x7f7178147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717dc32640 1 -- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f717806d660 msgr2=0x7f7178135570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717e433640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f717806d660 0x7f7178135570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717dc32640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f717806d660 0x7f7178135570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717dc32640 1 -- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f717815a6b0 msgr2=0x7f7178147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717dc32640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f717815a6b0 0x7f7178147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717dc32640 1 -- 172.21.15.1:0/2130107876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0094d0 con 0x7f71780ce800 2023-12-02T01:30:07.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717e433640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f717806d660 0x7f7178135570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717ec34640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f717815a6b0 0x7f7178147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f717dc32640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71780ce800 0x7f717814ebe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f716c000c00 tx=0x7f716c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f7176ffd640 1 -- 172.21.15.1:0/2130107876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c032880 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f7176ffd640 1 -- 172.21.15.1:0/2130107876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c0329e0 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71781489b0 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f7176ffd640 1 -- 172.21.15.1:0/2130107876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c032d90 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.757+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7178135ab0 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.758+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178159b60 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.758+0000 7f7176ffd640 1 -- 172.21.15.1:0/2130107876 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f716c04d3f0 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.759+0000 7f7176ffd640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f716406ae40 0x7f716406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.759+0000 7f7176ffd640 1 -- 172.21.15.1:0/2130107876 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f716c0ab5b0 con 0x7f71780ce800 2023-12-02T01:30:07.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.759+0000 7f717e433640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f716406ae40 0x7f716406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:07.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.759+0000 7f717e433640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f716406ae40 0x7f716406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7168004520 tx=0x7f7168009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:07.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.763+0000 7f7176ffd640 1 -- 172.21.15.1:0/2130107876 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f716c0765d0 con 0x7f71780ce800 2023-12-02T01:30:07.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.936+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7178072ae0 con 0x7f71780ce800 2023-12-02T01:30:07.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.937+0000 7f7176ffd640 1 -- 172.21.15.1:0/2130107876 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f716c079bf0 con 0x7f71780ce800 2023-12-02T01:30:07.939 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:07.940 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f716406ae40 msgr2=0x7f716406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f716406ae40 0x7f716406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7168004520 tx=0x7f7168009040 comp rx=0 tx=0).stop 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71780ce800 msgr2=0x7f717814ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71780ce800 0x7f717814ebe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f716c000c00 tx=0x7f716c0046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 shutdown_connections 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f716406ae40 0x7f716406d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f717815a6b0 0x7f7178147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71780ce800 0x7f717814ebe0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 --2- 172.21.15.1:0/2130107876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f717806d660 0x7f7178135570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 >> 172.21.15.1:0/2130107876 conn(0x7f717806a8f0 msgr2=0x7f71780b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 shutdown_connections 2023-12-02T01:30:07.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:07.939+0000 7f7180697640 1 -- 172.21.15.1:0/2130107876 wait complete. 2023-12-02T01:30:07.951 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:08.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.058+0000 7f8d8a941640 1 Processor -- start 2023-12-02T01:30:08.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.059+0000 7f8d8a941640 1 -- start start 2023-12-02T01:30:08.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.059+0000 7f8d8a941640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413f750 0x7f8d8415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.059+0000 7f8d8a941640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d84070630 0x7f8d84070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.059+0000 7f8d8a941640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d840ce060 con 0x7f8d8413fb30 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.059+0000 7f8d8a941640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840cec70 con 0x7f8d84070630 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.059+0000 7f8d8a941640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840ce340 con 0x7f8d8413f750 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d88ede640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d84070630 0x7f8d84070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d837fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8d8413fb30 0x7f8d840cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51138/0 (socket says 172.21.15.1:51138) 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d837fe640 1 -- 172.21.15.1:0/60416185 learned_addr learned my addr 172.21.15.1:0/60416185 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d83fff640 1 --2- 172.21.15.1:0/60416185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413f750 0x7f8d8415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d88ede640 1 -- 172.21.15.1:0/60416185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413f750 msgr2=0x7f8d8415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d88ede640 1 --2- 172.21.15.1:0/60416185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413f750 0x7f8d8415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d88ede640 1 -- 172.21.15.1:0/60416185 >> v1:172.21.15.1:6789/0 conn(0x7f8d8413fb30 legacy=0x7f8d840cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d88ede640 1 -- 172.21.15.1:0/60416185 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840ce620 con 0x7f8d84070630 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.060+0000 7f8d82ffd640 1 -- 172.21.15.1:0/60416185 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993757086 0 0) 0x7f8d840ce060 con 0x7f8d8413fb30 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d88ede640 1 --2- 172.21.15.1:0/60416185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84070ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009d90 tx=0x7f8d7c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eec0d13baef30c server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d82ffd640 1 -- 172.21.15.1:0/60416185 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c02cc50 con 0x7f8d84070630 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d82ffd640 1 -- 172.21.15.1:0/60416185 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c02cdb0 con 0x7f8d84070630 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d82ffd640 1 -- 172.21.15.1:0/60416185 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c034660 con 0x7f8d84070630 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 -- 172.21.15.1:0/60416185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 msgr2=0x7f8d84070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 --2- 172.21.15.1:0/60416185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84070ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009d90 tx=0x7f8d7c02bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 -- 172.21.15.1:0/60416185 shutdown_connections 2023-12-02T01:30:08.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 --2- 172.21.15.1:0/60416185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84070ac0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 --2- 172.21.15.1:0/60416185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413f750 0x7f8d8415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 -- 172.21.15.1:0/60416185 >> 172.21.15.1:0/60416185 conn(0x7f8d8406a8f0 msgr2=0x7f8d8406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:08.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 -- 172.21.15.1:0/60416185 shutdown_connections 2023-12-02T01:30:08.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.061+0000 7f8d8a941640 1 -- 172.21.15.1:0/60416185 wait complete. 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.063+0000 7f8d8a941640 1 Processor -- start 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.063+0000 7f8d8a941640 1 -- start start 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.063+0000 7f8d8a941640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.063+0000 7f8d8a941640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8413f750 0x7f8d841f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d8a941640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413fb30 0x7f8d841f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d8a941640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84158170 con 0x7f8d84070630 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d8a941640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84137b60 con 0x7f8d8413f750 2023-12-02T01:30:08.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d8a941640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8415ba20 con 0x7f8d8413fb30 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44166/0 (socket says 172.21.15.1:44166) 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 -- 172.21.15.1:0/235902263 learned_addr learned my addr 172.21.15.1:0/235902263 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d837fe640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8413f750 0x7f8d841f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d88ede640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413fb30 0x7f8d841f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 -- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413fb30 msgr2=0x7f8d841f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413fb30 0x7f8d841f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 -- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8413f750 msgr2=0x7f8d841f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8413f750 0x7f8d841f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 -- 172.21.15.1:0/235902263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c009a70 con 0x7f8d84070630 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d83fff640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84137620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d830 tx=0x7f8d7400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d80ff9640 1 -- 172.21.15.1:0/235902263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400b6c0 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d80ff9640 1 -- 172.21.15.1:0/235902263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7400b820 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8415bd00 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d80ff9640 1 -- 172.21.15.1:0/235902263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400bbb0 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.064+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d841586a0 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.065+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d84072ae0 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.066+0000 7f8d80ff9640 1 -- 172.21.15.1:0/235902263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d7401e460 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.066+0000 7f8d80ff9640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d7006ae40 0x7f8d7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.066+0000 7f8d80ff9640 1 -- 172.21.15.1:0/235902263 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d74089bd0 con 0x7f8d84070630 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.066+0000 7f8d837fe640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d7006ae40 0x7f8d7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.067+0000 7f8d837fe640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d7006ae40 0x7f8d7006d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8d84070e60 tx=0x7f8d78007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.070+0000 7f8d80ff9640 1 -- 172.21.15.1:0/235902263 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d74054dc0 con 0x7f8d84070630 2023-12-02T01:30:08.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.245+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d8415bef0 con 0x7f8d84070630 2023-12-02T01:30:08.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.246+0000 7f8d80ff9640 1 -- 172.21.15.1:0/235902263 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d740583e0 con 0x7f8d84070630 2023-12-02T01:30:08.247 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:08.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d7006ae40 msgr2=0x7f8d7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.249 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d7006ae40 0x7f8d7006d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8d84070e60 tx=0x7f8d78007de0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 msgr2=0x7f8d84137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84137620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d830 tx=0x7f8d7400dcf0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 shutdown_connections 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d8413fb30 0x7f8d841f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d7006ae40 0x7f8d7006d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d8413f750 0x7f8d841f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 --2- 172.21.15.1:0/235902263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d84070630 0x7f8d84137620 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 >> 172.21.15.1:0/235902263 conn(0x7f8d8406a8f0 msgr2=0x7f8d8406acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 shutdown_connections 2023-12-02T01:30:08.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.248+0000 7f8d8a941640 1 -- 172.21.15.1:0/235902263 wait complete. 2023-12-02T01:30:08.260 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.369+0000 7f2906ad3640 1 Processor -- start 2023-12-02T01:30:08.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.369+0000 7f2906ad3640 1 -- start start 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f2906ad3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29000b3610 0x7f2900160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f2906ad3640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000adda0 con 0x7f2900161370 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f2906ad3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000b3aa0 con 0x7f290006efd0 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f2906ad3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2900161820 con 0x7f29000b3610 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f2905070640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2900161370 0x7f290006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51154/0 (socket says 172.21.15.1:51154) 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f2905070640 1 -- 172.21.15.1:0/3382536258 learned_addr learned my addr 172.21.15.1:0/3382536258 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f28fffff640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29000b3610 0x7f2900160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497012692 0 0) 0x7f29000adda0 con 0x7f2900161370 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.370+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e8003520 con 0x7f2900161370 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230397568 0 0) 0x7f28e8003520 con 0x7f2900161370 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29000b3610 msgr2=0x7f2900160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29000b3610 0x7f2900160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 >> v1:172.21.15.167:6789/0 conn(0x7f290006efd0 legacy=0x7f29000ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000b3d80 con 0x7f2900161370 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f28f0001670 con 0x7f2900161370 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 >> v1:172.21.15.1:6789/0 conn(0x7f2900161370 legacy=0x7f290006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e80039a0 0x7f28e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f28e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28e8005180 0x7f28e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900161820 con 0x7f28e80047c0 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e800bec0 con 0x7f28e80039a0 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e800c000 con 0x7f28e8005180 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28fffff640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f28e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f290486f640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e80039a0 0x7f28e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f2905070640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28e8005180 0x7f28e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28fffff640 1 -- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28e8005180 msgr2=0x7f28e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28fffff640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28e8005180 0x7f28e800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28fffff640 1 -- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e80039a0 msgr2=0x7f28e8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28fffff640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e80039a0 0x7f28e8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f28fffff640 1 -- 172.21.15.1:0/3382536258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8003520 con 0x7f28e80047c0 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.371+0000 7f2905070640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28e8005180 0x7f28e800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.372+0000 7f28fffff640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f28e8004c40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009ac0 tx=0x7f28e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fb581ab8c010aa server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.372+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f402c6b0 con 0x7f28e80047c0 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.372+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f402c810 con 0x7f28e80047c0 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.372+0000 7f28ff7fe640 1 -- 172.21.15.1:0/3382536258 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f402cba0 con 0x7f28e80047c0 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.373+0000 7f2906ad3640 1 -- 172.21.15.1:0/3382536258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 msgr2=0x7f28e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.373+0000 7f2906ad3640 1 --2- 172.21.15.1:0/3382536258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f28e8004c40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009ac0 tx=0x7f28e80057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.373+0000 7f2905070640 1 -- 172.21.15.1:0/3382536258 reap_dead start 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.373+0000 7f2906ad3640 1 -- 172.21.15.1:0/3382536258 shutdown_connections 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.373+0000 7f2906ad3640 1 -- 172.21.15.1:0/3382536258 >> 172.21.15.1:0/3382536258 conn(0x7f29000b1670 msgr2=0x7f29000b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.373+0000 7f2906ad3640 1 -- 172.21.15.1:0/3382536258 shutdown_connections 2023-12-02T01:30:08.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.373+0000 7f2906ad3640 1 -- 172.21.15.1:0/3382536258 wait complete. 2023-12-02T01:30:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.374+0000 7f2906ad3640 1 Processor -- start 2023-12-02T01:30:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.374+0000 7f2906ad3640 1 -- start start 2023-12-02T01:30:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f2906ad3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f29001f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f2906ad3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2900150f20 0x7f2900155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f2906ad3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290015f650 0x7f290015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f2906ad3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900160010 con 0x7f28e80047c0 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f2906ad3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29001f2ae0 con 0x7f290015f650 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f2906ad3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29001f2d30 con 0x7f2900150f20 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f29001f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f29001f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44184/0 (socket says 172.21.15.1:44184) 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 -- 172.21.15.1:0/3759843351 learned_addr learned my addr 172.21.15.1:0/3759843351 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 -- 172.21.15.1:0/3759843351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2900150f20 msgr2=0x7f2900155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2900150f20 0x7f2900155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 -- 172.21.15.1:0/3759843351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290015f650 msgr2=0x7f290015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290015f650 0x7f290015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 -- 172.21.15.1:0/3759843351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2900155bc0 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f290486f640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f29001f25a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f28f800fb90 tx=0x7f28f800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f28fd7fa640 1 -- 172.21.15.1:0/3759843351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800fe90 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f28fd7fa640 1 -- 172.21.15.1:0/3759843351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800dbb0 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2900155ea0 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.375+0000 7f28fd7fa640 1 -- 172.21.15.1:0/3759843351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8003970 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.376+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29001558b0 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.376+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900072720 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.377+0000 7f28fd7fa640 1 -- 172.21.15.1:0/3759843351 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28f8003ad0 con 0x7f28e80047c0 2023-12-02T01:30:08.383 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.377+0000 7f28fd7fa640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28ec06ae40 0x7f28ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.377+0000 7f28fd7fa640 1 -- 172.21.15.1:0/3759843351 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28f8089920 con 0x7f28e80047c0 2023-12-02T01:30:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.377+0000 7f28fffff640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28ec06ae40 0x7f28ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.378+0000 7f28fffff640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28ec06ae40 0x7f28ec06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28f4036000 tx=0x7f28f402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.381+0000 7f28fd7fa640 1 -- 172.21.15.1:0/3759843351 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28f8054930 con 0x7f28e80047c0 2023-12-02T01:30:08.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.561+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f290006b9a0 con 0x7f28e80047c0 2023-12-02T01:30:08.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.561+0000 7f28fd7fa640 1 -- 172.21.15.1:0/3759843351 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28f8057f50 con 0x7f28e80047c0 2023-12-02T01:30:08.563 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28ec06ae40 msgr2=0x7f28ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28ec06ae40 0x7f28ec06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28f4036000 tx=0x7f28f402e000 comp rx=0 tx=0).stop 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 msgr2=0x7f29001f25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f29001f25a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f28f800fb90 tx=0x7f28f800d520 comp rx=0 tx=0).stop 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 shutdown_connections 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f28ec06ae40 0x7f28ec06d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290015f650 0x7f290015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2900150f20 0x7f2900155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 --2- 172.21.15.1:0/3759843351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28e80047c0 0x7f29001f25a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 >> 172.21.15.1:0/3759843351 conn(0x7f29000b1670 msgr2=0x7f29000aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:08.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 shutdown_connections 2023-12-02T01:30:08.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.563+0000 7f2906ad3640 1 -- 172.21.15.1:0/3759843351 wait complete. 2023-12-02T01:30:08.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:08.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.680+0000 7f7ad979e640 1 Processor -- start 2023-12-02T01:30:08.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad979e640 1 -- start start 2023-12-02T01:30:08.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad979e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ad40cee70 0x7f7ad40cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad979e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 0x7f7ad40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.683 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad979e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad40d20d0 con 0x7f7ad415d3f0 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad979e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40d0470 con 0x7f7ad40cee70 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad979e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40d14c0 con 0x7f7ad40cfff0 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad37fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7ad40cee70 0x7f7ad40cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.681+0000 7f7ad3fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7ad415d3f0 0x7f7ad40d0cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51170/0 (socket says 172.21.15.1:51170) 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.682+0000 7f7ad3fff640 1 -- 172.21.15.1:0/4012303417 learned_addr learned my addr 172.21.15.1:0/4012303417 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.682+0000 7f7ad37fe640 1 -- 172.21.15.1:0/4012303417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 msgr2=0x7f7ad40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.682+0000 7f7ad37fe640 1 --2- 172.21.15.1:0/4012303417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 0x7f7ad40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.682+0000 7f7ad37fe640 1 -- 172.21.15.1:0/4012303417 >> v1:172.21.15.1:6789/0 conn(0x7f7ad415d3f0 legacy=0x7f7ad40d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.682+0000 7f7ad37fe640 1 -- 172.21.15.1:0/4012303417 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40d17a0 con 0x7f7ad40cee70 2023-12-02T01:30:08.684 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.682+0000 7f7ad2ffd640 1 -- 172.21.15.1:0/4012303417 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109466390 0 0) 0x7f7ad40d20d0 con 0x7f7ad415d3f0 2023-12-02T01:30:08.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad37fe640 1 --2- 172.21.15.1:0/4012303417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad40cfab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40097a0 tx=0x7f7ac402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39981a21fb57b234 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad2ffd640 1 -- 172.21.15.1:0/4012303417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4031830 con 0x7f7ad40cee70 2023-12-02T01:30:08.685 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad2ffd640 1 -- 172.21.15.1:0/4012303417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac4031990 con 0x7f7ad40cee70 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad2ffd640 1 -- 172.21.15.1:0/4012303417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4031d20 con 0x7f7ad40cee70 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 -- 172.21.15.1:0/4012303417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 msgr2=0x7f7ad40cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 --2- 172.21.15.1:0/4012303417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad40cfab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40097a0 tx=0x7f7ac402b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 -- 172.21.15.1:0/4012303417 shutdown_connections 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 --2- 172.21.15.1:0/4012303417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 0x7f7ad40b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 --2- 172.21.15.1:0/4012303417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad40cfab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 -- 172.21.15.1:0/4012303417 >> 172.21.15.1:0/4012303417 conn(0x7f7ad409c410 msgr2=0x7f7ad40d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 -- 172.21.15.1:0/4012303417 shutdown_connections 2023-12-02T01:30:08.686 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.683+0000 7f7ad979e640 1 -- 172.21.15.1:0/4012303417 wait complete. 2023-12-02T01:30:08.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.685+0000 7f7ad979e640 1 Processor -- start 2023-12-02T01:30:08.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.685+0000 7f7ad979e640 1 -- start start 2023-12-02T01:30:08.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad4159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 0x7f7ad40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.688 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad415d3f0 0x7f7ad40c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad415faa0 con 0x7f7ad40cee70 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad415fd80 con 0x7f7ad415d3f0 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4160060 con 0x7f7ad40cfff0 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad4159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad4159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44210/0 (socket says 172.21.15.1:44210) 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 -- 172.21.15.1:0/2365829445 learned_addr learned my addr 172.21.15.1:0/2365829445 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad37fe640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 0x7f7ad40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad8f9d640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad415d3f0 0x7f7ad40c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 -- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 msgr2=0x7f7ad40cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 0x7f7ad40cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 -- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad415d3f0 msgr2=0x7f7ad40c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.689 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad415d3f0 0x7f7ad40c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 -- 172.21.15.1:0/2365829445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009400 con 0x7f7ad40cee70 2023-12-02T01:30:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad3fff640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad4159400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c430 tx=0x7f7ac800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad0ff9640 1 -- 172.21.15.1:0/2365829445 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80074e0 con 0x7f7ad40cee70 2023-12-02T01:30:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad0ff9640 1 -- 172.21.15.1:0/2365829445 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac8007660 con 0x7f7ad40cee70 2023-12-02T01:30:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad0ff9640 1 -- 172.21.15.1:0/2365829445 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8004a20 con 0x7f7ad40cee70 2023-12-02T01:30:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad4160340 con 0x7f7ad40cee70 2023-12-02T01:30:08.690 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.686+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad40ccec0 con 0x7f7ad40cee70 2023-12-02T01:30:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.687+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad40a1080 con 0x7f7ad40cee70 2023-12-02T01:30:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.688+0000 7f7ad0ff9640 1 -- 172.21.15.1:0/2365829445 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ac8004b80 con 0x7f7ad40cee70 2023-12-02T01:30:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.688+0000 7f7ad0ff9640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7ac006ae40 0x7f7ac006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.688+0000 7f7ad0ff9640 1 -- 172.21.15.1:0/2365829445 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ac8089410 con 0x7f7ad40cee70 2023-12-02T01:30:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.688+0000 7f7ad37fe640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7ac006ae40 0x7f7ac006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.691 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.689+0000 7f7ad37fe640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7ac006ae40 0x7f7ac006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4036000 tx=0x7f7ac403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:08.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.692+0000 7f7ad0ff9640 1 -- 172.21.15.1:0/2365829445 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ac8054550 con 0x7f7ad40cee70 2023-12-02T01:30:08.872 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.870+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ad404e920 con 0x7f7ad40cee70 2023-12-02T01:30:08.873 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.872+0000 7f7ad0ff9640 1 -- 172.21.15.1:0/2365829445 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f7ac8057b70 con 0x7f7ad40cee70 2023-12-02T01:30:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:08.873 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:08.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7ac006ae40 msgr2=0x7f7ac006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7ac006ae40 0x7f7ac006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4036000 tx=0x7f7ac403c040 comp rx=0 tx=0).stop 2023-12-02T01:30:08.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 msgr2=0x7f7ad4159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:08.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad4159400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c430 tx=0x7f7ac800c8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.875 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 shutdown_connections 2023-12-02T01:30:08.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f7ac006ae40 0x7f7ac006d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad415d3f0 0x7f7ad40c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7ad40cfff0 0x7f7ad40cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 --2- 172.21.15.1:0/2365829445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ad40cee70 0x7f7ad4159400 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.873+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 >> 172.21.15.1:0/2365829445 conn(0x7f7ad409c410 msgr2=0x7f7ad40b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:08.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.874+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 shutdown_connections 2023-12-02T01:30:08.876 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.874+0000 7f7ad979e640 1 -- 172.21.15.1:0/2365829445 wait complete. 2023-12-02T01:30:08.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:08.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:08.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.995+0000 7f79c759e640 1 Processor -- start 2023-12-02T01:30:08.996 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.995+0000 7f79c759e640 1 -- start start 2023-12-02T01:30:08.997 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c759e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f79c015af10 0x7f79c00cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f79c00703c0 0x7f79c0070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c759e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00b2d20 con 0x7f79c00cecd0 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c759e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00cf5f0 con 0x7f79c015af10 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c759e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00b21a0 con 0x7f79c00703c0 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c5d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f79c015af10 0x7f79c00cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c5d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f79c015af10 0x7f79c00cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44212/0 (socket says 172.21.15.1:44212) 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c5d9b640 1 -- 172.21.15.1:0/1030765118 learned_addr learned my addr 172.21.15.1:0/1030765118 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c6d9d640 1 --2- 172.21.15.1:0/1030765118 >> v2:172.21.15.167:3300/0 conn(0x7f79c00703c0 0x7f79c0070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c5d9b640 1 -- 172.21.15.1:0/1030765118 >> v2:172.21.15.167:3300/0 conn(0x7f79c00703c0 msgr2=0x7f79c0070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c5d9b640 1 --2- 172.21.15.1:0/1030765118 >> v2:172.21.15.167:3300/0 conn(0x7f79c00703c0 0x7f79c0070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c5d9b640 1 -- 172.21.15.1:0/1030765118 >> v1:172.21.15.167:6789/0 conn(0x7f79c00cecd0 legacy=0x7f79c00b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:08.998 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.996+0000 7f79c5d9b640 1 -- 172.21.15.1:0/1030765118 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00b2480 con 0x7f79c015af10 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.997+0000 7f79c5d9b640 1 --2- 172.21.15.1:0/1030765118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c015af10 0x7f79c00cf0b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79c006d930 tx=0x7f79b802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cb252134baf55f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.997+0000 7f79c559a640 1 -- 172.21.15.1:0/1030765118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80317e0 con 0x7f79c015af10 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.997+0000 7f79c559a640 1 -- 172.21.15.1:0/1030765118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8031940 con 0x7f79c015af10 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.997+0000 7f79c559a640 1 -- 172.21.15.1:0/1030765118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8031cd0 con 0x7f79c015af10 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 -- 172.21.15.1:0/1030765118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c015af10 msgr2=0x7f79c00cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 --2- 172.21.15.1:0/1030765118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c015af10 0x7f79c00cf0b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79c006d930 tx=0x7f79b802b880 comp rx=0 tx=0).stop 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 -- 172.21.15.1:0/1030765118 shutdown_connections 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 --2- 172.21.15.1:0/1030765118 >> v2:172.21.15.167:3300/0 conn(0x7f79c00703c0 0x7f79c0070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 --2- 172.21.15.1:0/1030765118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c015af10 0x7f79c00cf0b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 -- 172.21.15.1:0/1030765118 >> 172.21.15.1:0/1030765118 conn(0x7f79c006a6b0 msgr2=0x7f79c006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 -- 172.21.15.1:0/1030765118 shutdown_connections 2023-12-02T01:30:09.000 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.998+0000 7f79c759e640 1 -- 172.21.15.1:0/1030765118 wait complete. 2023-12-02T01:30:09.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.999+0000 7f79c759e640 1 Processor -- start 2023-12-02T01:30:09.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:08.999+0000 7f79c759e640 1 -- start start 2023-12-02T01:30:09.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c00703c0 0x7f79c01493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c00cecd0 0x7f79c00cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c759e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c015af10 0x7f79c00cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c759e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01f2dd0 con 0x7f79c00cecd0 2023-12-02T01:30:09.003 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00a8bc0 con 0x7f79c00703c0 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c759e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00ab7c0 con 0x7f79c015af10 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c00cecd0 0x7f79c00cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c00cecd0 0x7f79c00cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44222/0 (socket says 172.21.15.1:44222) 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 -- 172.21.15.1:0/2729284773 learned_addr learned my addr 172.21.15.1:0/2729284773 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c659c640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c00703c0 0x7f79c01493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c6d9d640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c015af10 0x7f79c00cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 -- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c015af10 msgr2=0x7f79c00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c015af10 0x7f79c00cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 -- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c00703c0 msgr2=0x7f79c01493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c00703c0 0x7f79c01493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 -- 172.21.15.1:0/2729284773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b80094d0 con 0x7f79c00cecd0 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c6d9d640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c015af10 0x7f79c00cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.000+0000 7f79c5d9b640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c00cecd0 0x7f79c00cd6b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79b802b8c0 tx=0x7f79b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.001+0000 7f79b2ffd640 1 -- 172.21.15.1:0/2729284773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8032880 con 0x7f79c00cecd0 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.001+0000 7f79b2ffd640 1 -- 172.21.15.1:0/2729284773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b80329e0 con 0x7f79c00cecd0 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.001+0000 7f79b2ffd640 1 -- 172.21.15.1:0/2729284773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8032d90 con 0x7f79c00cecd0 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.001+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c01f2af0 con 0x7f79c00cecd0 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.001+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c00a8850 con 0x7f79c00cecd0 2023-12-02T01:30:09.005 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.002+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c00a83d0 con 0x7f79c00cecd0 2023-12-02T01:30:09.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.002+0000 7f79b2ffd640 1 -- 172.21.15.1:0/2729284773 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79b804e450 con 0x7f79c00cecd0 2023-12-02T01:30:09.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.002+0000 7f79b2ffd640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f79a406ae40 0x7f79a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.003+0000 7f79b2ffd640 1 -- 172.21.15.1:0/2729284773 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b80ab600 con 0x7f79c00cecd0 2023-12-02T01:30:09.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.003+0000 7f79c659c640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f79a406ae40 0x7f79a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.006 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.003+0000 7f79c659c640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f79a406ae40 0x7f79a406d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79b4004f60 tx=0x7f79b4007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.007+0000 7f79b2ffd640 1 -- 172.21.15.1:0/2729284773 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79c00a83d0 con 0x7f79c00cecd0 2023-12-02T01:30:09.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.180+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79c00a83d0 con 0x7f79c00cecd0 2023-12-02T01:30:09.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.180+0000 7f79b2ffd640 1 -- 172.21.15.1:0/2729284773 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79c00a83d0 con 0x7f79c00cecd0 2023-12-02T01:30:09.182 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f79a406ae40 msgr2=0x7f79a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f79a406ae40 0x7f79a406d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79b4004f60 tx=0x7f79b4007e30 comp rx=0 tx=0).stop 2023-12-02T01:30:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c00cecd0 msgr2=0x7f79c00cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c00cecd0 0x7f79c00cd6b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79b802b8c0 tx=0x7f79b80046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 shutdown_connections 2023-12-02T01:30:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c015af10 0x7f79c00cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79c00cecd0 0x7f79c00cd6b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f79a406ae40 0x7f79a406d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 --2- 172.21.15.1:0/2729284773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c00703c0 0x7f79c01493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 >> 172.21.15.1:0/2729284773 conn(0x7f79c006a6b0 msgr2=0x7f79c00ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 shutdown_connections 2023-12-02T01:30:09.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.182+0000 7f79c759e640 1 -- 172.21.15.1:0/2729284773 wait complete. 2023-12-02T01:30:09.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:09.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.304+0000 7f9617b0f640 1 Processor -- start 2023-12-02T01:30:09.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.304+0000 7f9617b0f640 1 -- start start 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f9617b0f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9610160b70 0x7f96100d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f9617b0f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f96100b2aa0 0x7f96100ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f9617b0f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100ced30 0x7f96100cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f9617b0f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100ce360 con 0x7f9610160b70 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f9617b0f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100b2f20 con 0x7f96100b2aa0 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f9617b0f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96100cdd50 con 0x7f96100ced30 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9610160b70 0x7f96100d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9610160b70 0x7f96100d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44230/0 (socket says 172.21.15.1:44230) 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 -- 172.21.15.1:0/3382499742 learned_addr learned my addr 172.21.15.1:0/3382499742 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96160ac640 1 --2- 172.21.15.1:0/3382499742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100ced30 0x7f96100cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 -- 172.21.15.1:0/3382499742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100ced30 msgr2=0x7f96100cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96150aa640 1 --2- 172.21.15.1:0/3382499742 >> v2:172.21.15.167:3300/0 conn(0x7f96100b2aa0 0x7f96100ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 --2- 172.21.15.1:0/3382499742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100ced30 0x7f96100cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 -- 172.21.15.1:0/3382499742 >> v2:172.21.15.167:3300/0 conn(0x7f96100b2aa0 msgr2=0x7f96100ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 --2- 172.21.15.1:0/3382499742 >> v2:172.21.15.167:3300/0 conn(0x7f96100b2aa0 0x7f96100ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96158ab640 1 -- 172.21.15.1:0/3382499742 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100d1c70 con 0x7f9610160b70 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96160ac640 1 --2- 172.21.15.1:0/3382499742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100ced30 0x7f96100cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:09.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.305+0000 7f96150aa640 1 --2- 172.21.15.1:0/3382499742 >> v2:172.21.15.167:3300/0 conn(0x7f96100b2aa0 0x7f96100ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.306+0000 7f96158ab640 1 --2- 172.21.15.1:0/3382499742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9610160b70 0x7f96100d1570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96100d2e30 tx=0x7f960c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37e00ed3ce946fe server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.306+0000 7f96148a9640 1 -- 172.21.15.1:0/3382499742 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c031870 con 0x7f9610160b70 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.306+0000 7f96148a9640 1 -- 172.21.15.1:0/3382499742 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c0319d0 con 0x7f9610160b70 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.306+0000 7f96148a9640 1 -- 172.21.15.1:0/3382499742 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c031d60 con 0x7f9610160b70 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 -- 172.21.15.1:0/3382499742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9610160b70 msgr2=0x7f96100d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 --2- 172.21.15.1:0/3382499742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9610160b70 0x7f96100d1570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96100d2e30 tx=0x7f960c02b910 comp rx=0 tx=0).stop 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 -- 172.21.15.1:0/3382499742 shutdown_connections 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 --2- 172.21.15.1:0/3382499742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100ced30 0x7f96100cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 --2- 172.21.15.1:0/3382499742 >> v2:172.21.15.167:3300/0 conn(0x7f96100b2aa0 0x7f96100ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 --2- 172.21.15.1:0/3382499742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9610160b70 0x7f96100d1570 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 -- 172.21.15.1:0/3382499742 >> 172.21.15.1:0/3382499742 conn(0x7f961009c470 msgr2=0x7f96100d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:09.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 -- 172.21.15.1:0/3382499742 shutdown_connections 2023-12-02T01:30:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.307+0000 7f9617b0f640 1 -- 172.21.15.1:0/3382499742 wait complete. 2023-12-02T01:30:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.308+0000 7f9617b0f640 1 Processor -- start 2023-12-02T01:30:09.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.308+0000 7f9617b0f640 1 -- start start 2023-12-02T01:30:09.312 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f9617b0f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100b2aa0 0x7f96100b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f9617b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96100ced30 0x7f961015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f9617b0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610160b70 0x7f961014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f9617b0f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100cb260 con 0x7f96100ced30 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f9617b0f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100cb7e0 con 0x7f9610160b70 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f9617b0f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96101474b0 con 0x7f96100b2aa0 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96100ced30 0x7f961015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96100ced30 0x7f961015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44236/0 (socket says 172.21.15.1:44236) 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 -- 172.21.15.1:0/239897113 learned_addr learned my addr 172.21.15.1:0/239897113 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96158ab640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100b2aa0 0x7f96100b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96160ac640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610160b70 0x7f961014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 -- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100b2aa0 msgr2=0x7f96100b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.313 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100b2aa0 0x7f96100b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 -- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610160b70 msgr2=0x7f961014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610160b70 0x7f961014cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.309+0000 7f96150aa640 1 -- 172.21.15.1:0/239897113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0094d0 con 0x7f96100ced30 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.310+0000 7f96150aa640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96100ced30 0x7f961015d920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f960000c7f0 tx=0x7f960000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.310+0000 7f96067fc640 1 -- 172.21.15.1:0/239897113 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000cea0 con 0x7f96100ced30 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.310+0000 7f96067fc640 1 -- 172.21.15.1:0/239897113 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600007a30 con 0x7f96100ced30 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.310+0000 7f96067fc640 1 -- 172.21.15.1:0/239897113 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600007dc0 con 0x7f96100ced30 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.310+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96100b8b90 con 0x7f96100ced30 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.310+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100cb470 con 0x7f96100ced30 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.311+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96100cb990 con 0x7f96100ced30 2023-12-02T01:30:09.314 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.311+0000 7f96067fc640 1 -- 172.21.15.1:0/239897113 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96000113f0 con 0x7f96100ced30 2023-12-02T01:30:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.312+0000 7f96067fc640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f95f406ae40 0x7f95f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.312+0000 7f96158ab640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f95f406ae40 0x7f95f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.312+0000 7f96067fc640 1 -- 172.21.15.1:0/239897113 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9600089660 con 0x7f96100ced30 2023-12-02T01:30:09.315 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.312+0000 7f96158ab640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f95f406ae40 0x7f95f406d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f960c036000 tx=0x7f960c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.317 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.316+0000 7f96067fc640 1 -- 172.21.15.1:0/239897113 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96100cb990 con 0x7f96100ced30 2023-12-02T01:30:09.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.514+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96100cb990 con 0x7f96100ced30 2023-12-02T01:30:09.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.514+0000 7f96067fc640 1 -- 172.21.15.1:0/239897113 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96100cb990 con 0x7f96100ced30 2023-12-02T01:30:09.516 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f95f406ae40 msgr2=0x7f95f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f95f406ae40 0x7f95f406d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f960c036000 tx=0x7f960c03c040 comp rx=0 tx=0).stop 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96100ced30 msgr2=0x7f961015d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96100ced30 0x7f961015d920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f960000c7f0 tx=0x7f960000ccb0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 shutdown_connections 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f95f406ae40 0x7f95f406d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610160b70 0x7f961014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f96100ced30 0x7f961015d920 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 --2- 172.21.15.1:0/239897113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96100b2aa0 0x7f96100b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 >> 172.21.15.1:0/239897113 conn(0x7f961009c470 msgr2=0x7f96100b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 shutdown_connections 2023-12-02T01:30:09.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.516+0000 7f9617b0f640 1 -- 172.21.15.1:0/239897113 wait complete. 2023-12-02T01:30:09.528 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:09.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.635+0000 7fb39a1b6640 1 Processor -- start 2023-12-02T01:30:09.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.635+0000 7fb39a1b6640 1 -- start start 2023-12-02T01:30:09.639 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.636+0000 7fb39a1b6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3940b2aa0 0x7fb394168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.636+0000 7fb39a1b6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3940ce360 con 0x7fb3940d1570 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.636+0000 7fb39a1b6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3940d19f0 con 0x7fb394160b70 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.636+0000 7fb39a1b6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3940cdd50 con 0x7fb3940b2aa0 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.636+0000 7fb392ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb3940d1570 0x7fb3940cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51176/0 (socket says 172.21.15.1:51176) 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.636+0000 7fb392ffd640 1 -- 172.21.15.1:0/3905587239 learned_addr learned my addr 172.21.15.1:0/3905587239 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb393fff640 1 --2- 172.21.15.1:0/3905587239 >> v2:172.21.15.167:3300/0 conn(0x7fb3940b2aa0 0x7fb394168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934512819 0 0) 0x7fb3940ce360 con 0x7fb3940d1570 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb37c003520 con 0x7fb3940d1570 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768265271 0 0) 0x7fb37c003520 con 0x7fb3940d1570 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 >> v2:172.21.15.167:3300/0 conn(0x7fb3940b2aa0 msgr2=0x7fb394168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 --2- 172.21.15.1:0/3905587239 >> v2:172.21.15.167:3300/0 conn(0x7fb3940b2aa0 0x7fb394168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 >> v1:172.21.15.167:6789/0 conn(0x7fb394160b70 legacy=0x7fb3940ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.640 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3940b2ed0 con 0x7fb3940d1570 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fb388001670 con 0x7fb3940d1570 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 >> v1:172.21.15.1:6789/0 conn(0x7fb3940d1570 legacy=0x7fb3940cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb37c003970 0x7fb37c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0047c0 0x7fb37c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c005180 0x7fb37c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940cdd50 con 0x7fb37c003970 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c00c020 con 0x7fb37c0047c0 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c00c1e0 con 0x7fb37c005180 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3937fe640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb37c003970 0x7fb37c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb392ffd640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0047c0 0x7fb37c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb393fff640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c005180 0x7fb37c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3937fe640 1 -- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c005180 msgr2=0x7fb37c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3937fe640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c005180 0x7fb37c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3937fe640 1 -- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0047c0 msgr2=0x7fb37c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:09.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3937fe640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0047c0 0x7fb37c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb3937fe640 1 -- 172.21.15.1:0/3905587239 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c003520 con 0x7fb37c003970 2023-12-02T01:30:09.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.637+0000 7fb393fff640 1 -- 172.21.15.1:0/3905587239 reap_dead start 2023-12-02T01:30:09.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.638+0000 7fb3937fe640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb37c003970 0x7fb37c003d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb384001750 tx=0x7fb37c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fab9aa257c5679 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.638+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840052d0 con 0x7fb37c003970 2023-12-02T01:30:09.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.638+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38402e050 con 0x7fb37c003970 2023-12-02T01:30:09.642 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.638+0000 7fb3927fc640 1 -- 172.21.15.1:0/3905587239 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384003830 con 0x7fb37c003970 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.639+0000 7fb39a1b6640 1 -- 172.21.15.1:0/3905587239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb37c003970 msgr2=0x7fb37c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.639+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb37c003970 0x7fb37c003d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb384001750 tx=0x7fb37c0057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.639+0000 7fb39a1b6640 1 -- 172.21.15.1:0/3905587239 shutdown_connections 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.639+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/3905587239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb37c003970 0x7fb37c003d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.639+0000 7fb39a1b6640 1 -- 172.21.15.1:0/3905587239 >> 172.21.15.1:0/3905587239 conn(0x7fb39409c470 msgr2=0x7fb3940d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.639+0000 7fb39a1b6640 1 -- 172.21.15.1:0/3905587239 shutdown_connections 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.639+0000 7fb39a1b6640 1 -- 172.21.15.1:0/3905587239 wait complete. 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.640+0000 7fb39a1b6640 1 Processor -- start 2023-12-02T01:30:09.645 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.640+0000 7fb39a1b6640 1 -- start start 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb39a1b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c003970 0x7fb3940ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb39a1b6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3941538b0 0x7fb3940cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb39a1b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3940cc340 0x7fb3940b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb39a1b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39415aa70 con 0x7fb3940cc340 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb39a1b6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940cd110 con 0x7fb3941538b0 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb39a1b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940cb600 con 0x7fb37c003970 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3940cc340 0x7fb3940b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3940cc340 0x7fb3940b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44264/0 (socket says 172.21.15.1:44264) 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 -- 172.21.15.1:0/2234591315 learned_addr learned my addr 172.21.15.1:0/2234591315 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 -- 172.21.15.1:0/2234591315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c003970 msgr2=0x7fb3940ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c003970 0x7fb3940ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.646 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 -- 172.21.15.1:0/2234591315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3941538b0 msgr2=0x7fb3940cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3941538b0 0x7fb3940cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 -- 172.21.15.1:0/2234591315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39415a140 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb393fff640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3940cc340 0x7fb3940b3100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb39408d200 tx=0x7fb38c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.641+0000 7fb37bfff640 1 -- 172.21.15.1:0/2234591315 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c00e070 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.642+0000 7fb37bfff640 1 -- 172.21.15.1:0/2234591315 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c011e10 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.642+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39415a420 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.642+0000 7fb37bfff640 1 -- 172.21.15.1:0/2234591315 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c003990 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.642+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb394159e40 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.643+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3940a1150 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.643+0000 7fb37bfff640 1 -- 172.21.15.1:0/2234591315 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb38c003af0 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.643+0000 7fb37bfff640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb38006ae40 0x7fb38006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.644+0000 7fb37bfff640 1 -- 172.21.15.1:0/2234591315 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb38c089b40 con 0x7fb3940cc340 2023-12-02T01:30:09.647 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.644+0000 7fb3937fe640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb38006ae40 0x7fb38006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.644+0000 7fb3937fe640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb38006ae40 0x7fb38006d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb384033000 tx=0x7fb38402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.648+0000 7fb37bfff640 1 -- 172.21.15.1:0/2234591315 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb38c054c80 con 0x7fb3940cc340 2023-12-02T01:30:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.824+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb39415abb0 con 0x7fb3940cc340 2023-12-02T01:30:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.824+0000 7fb37bfff640 1 -- 172.21.15.1:0/2234591315 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb38c0582a0 con 0x7fb3940cc340 2023-12-02T01:30:09.826 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:09.827 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb38006ae40 msgr2=0x7fb38006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb38006ae40 0x7fb38006d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb384033000 tx=0x7fb38402f000 comp rx=0 tx=0).stop 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3940cc340 msgr2=0x7fb3940b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3940cc340 0x7fb3940b3100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb39408d200 tx=0x7fb38c0115a0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 shutdown_connections 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3940cc340 0x7fb3940b3100 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb38006ae40 0x7fb38006d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3941538b0 0x7fb3940cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 --2- 172.21.15.1:0/2234591315 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c003970 0x7fb3940ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 >> 172.21.15.1:0/2234591315 conn(0x7fb39409c470 msgr2=0x7fb39406b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 shutdown_connections 2023-12-02T01:30:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.826+0000 7fb39a1b6640 1 -- 172.21.15.1:0/2234591315 wait complete. 2023-12-02T01:30:09.838 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:09.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.943+0000 7f187a287640 1 Processor -- start 2023-12-02T01:30:09.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.943+0000 7f187a287640 1 -- start start 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.943+0000 7f187a287640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f187415d3e0 0x7f18740ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.943+0000 7f187a287640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f18740ced30 0x7f18740d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.943+0000 7f187a287640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18740b5f90 con 0x7f18740d1c60 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.943+0000 7f187a287640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18740cf170 con 0x7f18740ced30 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.943+0000 7f187a287640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18740d20d0 con 0x7f187415d3e0 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f18737fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f18740ced30 0x7f18740d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f18737fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f18740ced30 0x7f18740d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44280/0 (socket says 172.21.15.1:44280) 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f18737fe640 1 -- 172.21.15.1:0/1038984194 learned_addr learned my addr 172.21.15.1:0/1038984194 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f1873fff640 1 --2- 172.21.15.1:0/1038984194 >> v2:172.21.15.167:3300/0 conn(0x7f187415d3e0 0x7f18740ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f18737fe640 1 -- 172.21.15.1:0/1038984194 >> v2:172.21.15.167:3300/0 conn(0x7f187415d3e0 msgr2=0x7f18740ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f18737fe640 1 --2- 172.21.15.1:0/1038984194 >> v2:172.21.15.167:3300/0 conn(0x7f187415d3e0 0x7f18740ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f18737fe640 1 -- 172.21.15.1:0/1038984194 >> v1:172.21.15.167:6789/0 conn(0x7f18740d1c60 legacy=0x7f18740b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f18737fe640 1 -- 172.21.15.1:0/1038984194 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18740b61e0 con 0x7f18740ced30 2023-12-02T01:30:09.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.944+0000 7f1873fff640 1 --2- 172.21.15.1:0/1038984194 >> v2:172.21.15.167:3300/0 conn(0x7f187415d3e0 0x7f18740ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:09.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f18737fe640 1 --2- 172.21.15.1:0/1038984194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740ced30 0x7f18740d1720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1874073e20 tx=0x7f186802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6282488d24cb0ec server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f1872ffd640 1 -- 172.21.15.1:0/1038984194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868030860 con 0x7f18740ced30 2023-12-02T01:30:09.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f1872ffd640 1 -- 172.21.15.1:0/1038984194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18680309c0 con 0x7f18740ced30 2023-12-02T01:30:09.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f1872ffd640 1 -- 172.21.15.1:0/1038984194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868030d50 con 0x7f18740ced30 2023-12-02T01:30:09.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 -- 172.21.15.1:0/1038984194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740ced30 msgr2=0x7f18740d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 --2- 172.21.15.1:0/1038984194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740ced30 0x7f18740d1720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1874073e20 tx=0x7f186802b9a0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 -- 172.21.15.1:0/1038984194 shutdown_connections 2023-12-02T01:30:09.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 --2- 172.21.15.1:0/1038984194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740ced30 0x7f18740d1720 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 --2- 172.21.15.1:0/1038984194 >> v2:172.21.15.167:3300/0 conn(0x7f187415d3e0 0x7f18740ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 -- 172.21.15.1:0/1038984194 >> 172.21.15.1:0/1038984194 conn(0x7f187409c480 msgr2=0x7f18740d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:09.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 -- 172.21.15.1:0/1038984194 shutdown_connections 2023-12-02T01:30:09.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.945+0000 7f187a287640 1 -- 172.21.15.1:0/1038984194 wait complete. 2023-12-02T01:30:09.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.947+0000 7f187a287640 1 Processor -- start 2023-12-02T01:30:09.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.947+0000 7f187a287640 1 -- start start 2023-12-02T01:30:09.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.947+0000 7f187a287640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18740ced30 0x7f18740a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.947+0000 7f187a287640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740d1c60 0x7f1874159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f187a287640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f187415d3e0 0x7f18741f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f187a287640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18741483c0 con 0x7f18740d1c60 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f187a287640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740c9590 con 0x7f18740ced30 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f187a287640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187415a110 con 0x7f187415d3e0 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740d1c60 0x7f1874159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740d1c60 0x7f1874159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44282/0 (socket says 172.21.15.1:44282) 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 -- 172.21.15.1:0/754321602 learned_addr learned my addr 172.21.15.1:0/754321602 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f1873fff640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18740ced30 0x7f18740a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f1878824640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f187415d3e0 0x7f18741f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 -- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f187415d3e0 msgr2=0x7f18741f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f187415d3e0 0x7f18741f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 -- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18740ced30 msgr2=0x7f18740a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18740ced30 0x7f18740a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 -- 172.21.15.1:0/754321602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680094d0 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f1873fff640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18740ced30 0x7f18740a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f1878824640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f187415d3e0 0x7f18741f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f18737fe640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740d1c60 0x7f1874159800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f186802b9e0 tx=0x7f1868004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f1870ff9640 1 -- 172.21.15.1:0/754321602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868039c90 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f1870ff9640 1 -- 172.21.15.1:0/754321602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1868039df0 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187415a3f0 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f1870ff9640 1 -- 172.21.15.1:0/754321602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680446c0 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.948+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1874159d40 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.949+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1874159ed0 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.950+0000 7f1870ff9640 1 -- 172.21.15.1:0/754321602 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f186804d3b0 con 0x7f18740d1c60 2023-12-02T01:30:09.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.950+0000 7f1870ff9640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f186006ae70 0x7f186006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:09.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.950+0000 7f1870ff9640 1 -- 172.21.15.1:0/754321602 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f186803e070 con 0x7f18740d1c60 2023-12-02T01:30:09.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.950+0000 7f1873fff640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f186006ae70 0x7f186006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:09.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.951+0000 7f1873fff640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f186006ae70 0x7f186006d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1864006fd0 tx=0x7f1864008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:09.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:09.954+0000 7f1870ff9640 1 -- 172.21.15.1:0/754321602 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1874159ed0 con 0x7f18740d1c60 2023-12-02T01:30:10.133 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.132+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f187415a910 con 0x7f18740d1c60 2023-12-02T01:30:10.135 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.133+0000 7f1870ff9640 1 -- 172.21.15.1:0/754321602 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f187415a910 con 0x7f18740d1c60 2023-12-02T01:30:10.135 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:10.135 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f186006ae70 msgr2=0x7f186006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f186006ae70 0x7f186006d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1864006fd0 tx=0x7f1864008040 comp rx=0 tx=0).stop 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740d1c60 msgr2=0x7f1874159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740d1c60 0x7f1874159800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f186802b9e0 tx=0x7f1868004730 comp rx=0 tx=0).stop 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 shutdown_connections 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f187415d3e0 0x7f18741f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18740d1c60 0x7f1874159800 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f186006ae70 0x7f186006d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.137 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 --2- 172.21.15.1:0/754321602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18740ced30 0x7f18740a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 >> 172.21.15.1:0/754321602 conn(0x7f187409c480 msgr2=0x7f18740ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 shutdown_connections 2023-12-02T01:30:10.138 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.135+0000 7f187a287640 1 -- 172.21.15.1:0/754321602 wait complete. 2023-12-02T01:30:10.148 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:10.148 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:10.257 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.256+0000 7fd85a861640 1 Processor -- start 2023-12-02T01:30:10.258 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.256+0000 7fd85a861640 1 -- start start 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd85a861640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd85415a6b0 0x7fd85406d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd85a861640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8540cebe0 con 0x7fd8540ce800 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd85a861640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd854070da0 con 0x7fd85406d660 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd85a861640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85406db10 con 0x7fd85415a6b0 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd853fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd8540ce800 0x7fd8540702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51182/0 (socket says 172.21.15.1:51182) 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd853fff640 1 -- 172.21.15.1:0/2927986683 learned_addr learned my addr 172.21.15.1:0/2927986683 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217435729 0 0) 0x7fd8540cebe0 con 0x7fd8540ce800 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd83c004630 con 0x7fd8540ce800 2023-12-02T01:30:10.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd8537fe640 1 --2- 172.21.15.1:0/2927986683 >> v2:172.21.15.167:3300/0 conn(0x7fd85415a6b0 0x7fd85406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2728908490 0 0) 0x7fd83c004630 con 0x7fd8540ce800 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 >> v2:172.21.15.167:3300/0 conn(0x7fd85415a6b0 msgr2=0x7fd85406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 --2- 172.21.15.1:0/2927986683 >> v2:172.21.15.167:3300/0 conn(0x7fd85415a6b0 0x7fd85406d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 >> v1:172.21.15.167:6789/0 conn(0x7fd85406d660 legacy=0x7fd8540b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd854071080 con 0x7fd8540ce800 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fd844001670 con 0x7fd8540ce800 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 >> v1:172.21.15.1:6789/0 conn(0x7fd8540ce800 legacy=0x7fd8540702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd83c004a80 0x7fd83c004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd83c0058d0 0x7fd83c005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0063b0 0x7fd83c00ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85406db10 con 0x7fd83c0058d0 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c00d280 con 0x7fd83c004a80 2023-12-02T01:30:10.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c00d440 con 0x7fd83c0063b0 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.257+0000 7fd8537fe640 1 --2- 172.21.15.1:0/2927986683 >> v2:172.21.15.167:3300/0 conn(0x7fd85415a6b0 0x7fd85406d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd853fff640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd83c004a80 0x7fd83c004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd8537fe640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd83c0058d0 0x7fd83c005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd858dfe640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0063b0 0x7fd83c00ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd8537fe640 1 -- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0063b0 msgr2=0x7fd83c00ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd8537fe640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0063b0 0x7fd83c00ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd8537fe640 1 -- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd83c004a80 msgr2=0x7fd83c004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd8537fe640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd83c004a80 0x7fd83c004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd8537fe640 1 -- 172.21.15.1:0/2927986683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c004630 con 0x7fd83c0058d0 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd858dfe640 1 -- 172.21.15.1:0/2927986683 reap_dead start 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.258+0000 7fd853fff640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd83c004a80 0x7fd83c004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd8537fe640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd83c0058d0 0x7fd83c005d50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd83c006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3c051355f33232 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848004230 con 0x7fd83c0058d0 2023-12-02T01:30:10.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd848004390 con 0x7fd83c0058d0 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd852ffd640 1 -- 172.21.15.1:0/2927986683 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848003850 con 0x7fd83c0058d0 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd85a861640 1 -- 172.21.15.1:0/2927986683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd83c0058d0 msgr2=0x7fd83c005d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd85a861640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd83c0058d0 0x7fd83c005d50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd83c006900 comp rx=0 tx=0).stop 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd85a861640 1 -- 172.21.15.1:0/2927986683 shutdown_connections 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd85a861640 1 --2- 172.21.15.1:0/2927986683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd83c0058d0 0x7fd83c005d50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd85a861640 1 -- 172.21.15.1:0/2927986683 >> 172.21.15.1:0/2927986683 conn(0x7fd85406a8f0 msgr2=0x7fd85406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd85a861640 1 -- 172.21.15.1:0/2927986683 shutdown_connections 2023-12-02T01:30:10.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.259+0000 7fd85a861640 1 -- 172.21.15.1:0/2927986683 wait complete. 2023-12-02T01:30:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.261+0000 7fd85a861640 1 Processor -- start 2023-12-02T01:30:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.261+0000 7fd85a861640 1 -- start start 2023-12-02T01:30:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.261+0000 7fd85a861640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0058d0 0x7fd854156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.261+0000 7fd85a861640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854156dd0 0x7fd85406c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.261+0000 7fd85a861640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd85406cda0 0x7fd8541f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.261+0000 7fd85a861640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85406d230 con 0x7fd85406cda0 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.261+0000 7fd85a861640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8541f2130 con 0x7fd854156dd0 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd85a861640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd854148ae0 con 0x7fd83c0058d0 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd85406cda0 0x7fd8541f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd85406cda0 0x7fd8541f0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44306/0 (socket says 172.21.15.1:44306) 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 -- 172.21.15.1:0/3033335924 learned_addr learned my addr 172.21.15.1:0/3033335924 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd853fff640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0058d0 0x7fd854156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd8537fe640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854156dd0 0x7fd85406c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 -- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0058d0 msgr2=0x7fd854156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0058d0 0x7fd854156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 -- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854156dd0 msgr2=0x7fd85406c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854156dd0 0x7fd85406c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 -- 172.21.15.1:0/3033335924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd854155a90 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd858dfe640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd85406cda0 0x7fd8541f0cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd85406df20 tx=0x7fd84c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd850ff9640 1 -- 172.21.15.1:0/3033335924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c003b80 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd850ff9640 1 -- 172.21.15.1:0/3033335924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c003d00 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd854155d70 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd850ff9640 1 -- 172.21.15.1:0/3033335924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c005310 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.262+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8541f2380 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.264+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd854072ae0 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.264+0000 7fd850ff9640 1 -- 172.21.15.1:0/3033335924 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd84c005470 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.264+0000 7fd850ff9640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd84006ae40 0x7fd84006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.264+0000 7fd853fff640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd84006ae40 0x7fd84006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.264+0000 7fd850ff9640 1 -- 172.21.15.1:0/3033335924 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd84c089320 con 0x7fd85406cda0 2023-12-02T01:30:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.265+0000 7fd853fff640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd84006ae40 0x7fd84006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd844001200 tx=0x7fd844007f00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.269+0000 7fd850ff9640 1 -- 172.21.15.1:0/3033335924 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd84c054480 con 0x7fd85406cda0 2023-12-02T01:30:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.444+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd85404e920 con 0x7fd85406cda0 2023-12-02T01:30:10.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.444+0000 7fd850ff9640 1 -- 172.21.15.1:0/3033335924 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd84c057aa0 con 0x7fd85406cda0 2023-12-02T01:30:10.446 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:10.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd84006ae40 msgr2=0x7fd84006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd84006ae40 0x7fd84006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd844001200 tx=0x7fd844007f00 comp rx=0 tx=0).stop 2023-12-02T01:30:10.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd85406cda0 msgr2=0x7fd8541f0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd85406cda0 0x7fd8541f0cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd85406df20 tx=0x7fd84c00fc90 comp rx=0 tx=0).stop 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 shutdown_connections 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd85406cda0 0x7fd8541f0cc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd84006ae40 0x7fd84006d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854156dd0 0x7fd85406c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 --2- 172.21.15.1:0/3033335924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd83c0058d0 0x7fd854156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 >> 172.21.15.1:0/3033335924 conn(0x7fd85406a8f0 msgr2=0x7fd8540702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.446+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 shutdown_connections 2023-12-02T01:30:10.449 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.447+0000 7fd85a861640 1 -- 172.21.15.1:0/3033335924 wait complete. 2023-12-02T01:30:10.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.567+0000 7fe572bd7640 1 Processor -- start 2023-12-02T01:30:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.567+0000 7fe572bd7640 1 -- start start 2023-12-02T01:30:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe572bd7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 0x7fe56c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe572bd7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c0b04d0 con 0x7fe56c15d7b0 2023-12-02T01:30:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe572bd7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c0d1e40 con 0x7fe56c0b1970 2023-12-02T01:30:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe572bd7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0afe80 con 0x7fe56c0d0220 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe570973640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe56c15d7b0 0x7fe56c0cfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51192/0 (socket says 172.21.15.1:51192) 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe570973640 1 -- 172.21.15.1:0/3254600144 learned_addr learned my addr 172.21.15.1:0/3254600144 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe563fff640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 0x7fe56c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374682568 0 0) 0x7fe56c0b04d0 con 0x7fe56c15d7b0 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe554003520 con 0x7fe56c15d7b0 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544213042 0 0) 0x7fe554003520 con 0x7fe56c15d7b0 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 msgr2=0x7fe56c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 0x7fe56c0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 >> v1:172.21.15.167:6789/0 conn(0x7fe56c0b1970 legacy=0x7fe56c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c0b0160 con 0x7fe56c15d7b0 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fe568001670 con 0x7fe56c15d7b0 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 >> v1:172.21.15.1:6789/0 conn(0x7fe56c15d7b0 legacy=0x7fe56c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.568+0000 7fe5637fe640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5540039a0 0x7fe554003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe5637fe640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 0x7fe5540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe5637fe640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe554005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0afe80 con 0x7fe554004d00 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55400ba30 con 0x7fe5540039a0 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55400bbf0 con 0x7fe56c0d0220 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe571174640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe554005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe570973640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5540039a0 0x7fe554003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe563fff640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 0x7fe5540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe571174640 1 -- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 msgr2=0x7fe5540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe571174640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c0d0220 0x7fe5540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe571174640 1 -- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5540039a0 msgr2=0x7fe554003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe571174640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5540039a0 0x7fe554003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.569+0000 7fe571174640 1 -- 172.21.15.1:0/3254600144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe554003520 con 0x7fe554004d00 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe571174640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe554005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0b1e00 tx=0x7fe5540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe54e1daf446ea4 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564003b70 con 0x7fe554004d00 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe564003cd0 con 0x7fe554004d00 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe5637fe640 1 -- 172.21.15.1:0/3254600144 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564005310 con 0x7fe554004d00 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe572bd7640 1 -- 172.21.15.1:0/3254600144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 msgr2=0x7fe554005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe572bd7640 1 --2- 172.21.15.1:0/3254600144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe554005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0b1e00 tx=0x7fe5540057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe571174640 1 -- 172.21.15.1:0/3254600144 reap_dead start 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe572bd7640 1 -- 172.21.15.1:0/3254600144 shutdown_connections 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe572bd7640 1 -- 172.21.15.1:0/3254600144 >> 172.21.15.1:0/3254600144 conn(0x7fe56c09c480 msgr2=0x7fe56c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.570+0000 7fe572bd7640 1 -- 172.21.15.1:0/3254600144 shutdown_connections 2023-12-02T01:30:10.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.571+0000 7fe572bd7640 1 -- 172.21.15.1:0/3254600144 wait complete. 2023-12-02T01:30:10.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.572+0000 7fe572bd7640 1 Processor -- start 2023-12-02T01:30:10.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.572+0000 7fe572bd7640 1 -- start start 2023-12-02T01:30:10.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe56c09cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c157410 0x7fe56c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c09de50 0x7fe56c09e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c09e810 con 0x7fe554004d00 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c157cb0 con 0x7fe56c09de50 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0a0b20 con 0x7fe56c157410 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe56c09cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe56c09cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44324/0 (socket says 172.21.15.1:44324) 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 -- 172.21.15.1:0/335663662 learned_addr learned my addr 172.21.15.1:0/335663662 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe571174640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c09de50 0x7fe56c09e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe563fff640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c157410 0x7fe56c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 -- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c157410 msgr2=0x7fe56c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c157410 0x7fe56c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 -- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c09de50 msgr2=0x7fe56c09e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c09de50 0x7fe56c09e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 -- 172.21.15.1:0/335663662 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c0cb3d0 con 0x7fe554004d00 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe570973640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe56c09cef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5680072c0 tx=0x7fe568007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe5617fa640 1 -- 172.21.15.1:0/335663662 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800f960 con 0x7fe554004d00 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe5617fa640 1 -- 172.21.15.1:0/335663662 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800fac0 con 0x7fe554004d00 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c0cb6b0 con 0x7fe554004d00 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe5617fa640 1 -- 172.21.15.1:0/335663662 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800fe70 con 0x7fe554004d00 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.573+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c157140 con 0x7fe554004d00 2023-12-02T01:30:10.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.574+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c0cbbd0 con 0x7fe554004d00 2023-12-02T01:30:10.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.575+0000 7fe5617fa640 1 -- 172.21.15.1:0/335663662 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe56801d460 con 0x7fe554004d00 2023-12-02T01:30:10.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.575+0000 7fe5617fa640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe55806ae70 0x7fe55806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.575+0000 7fe5617fa640 1 -- 172.21.15.1:0/335663662 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe568089860 con 0x7fe554004d00 2023-12-02T01:30:10.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.575+0000 7fe563fff640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe55806ae70 0x7fe55806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.576+0000 7fe563fff640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe55806ae70 0x7fe55806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06c890 tx=0x7fe55c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.580+0000 7fe5617fa640 1 -- 172.21.15.1:0/335663662 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe56c0cbbd0 con 0x7fe554004d00 2023-12-02T01:30:10.757 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.756+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe56c0cbbd0 con 0x7fe554004d00 2023-12-02T01:30:10.758 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.756+0000 7fe5617fa640 1 -- 172.21.15.1:0/335663662 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe56c0cbbd0 con 0x7fe554004d00 2023-12-02T01:30:10.758 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe55806ae70 msgr2=0x7fe55806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe55806ae70 0x7fe55806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06c890 tx=0x7fe55c008040 comp rx=0 tx=0).stop 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 msgr2=0x7fe56c09cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe56c09cef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5680072c0 tx=0x7fe568007780 comp rx=0 tx=0).stop 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 shutdown_connections 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe55806ae70 0x7fe55806d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c09de50 0x7fe56c09e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe56c157410 0x7fe56c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.760 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 --2- 172.21.15.1:0/335663662 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe554004d00 0x7fe56c09cef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 >> 172.21.15.1:0/335663662 conn(0x7fe56c09c480 msgr2=0x7fe56c0c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:10.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 shutdown_connections 2023-12-02T01:30:10.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.758+0000 7fe572bd7640 1 -- 172.21.15.1:0/335663662 wait complete. 2023-12-02T01:30:10.771 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:10.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.878+0000 7f65aa6d0640 1 Processor -- start 2023-12-02T01:30:10.880 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.878+0000 7f65aa6d0640 1 -- start start 2023-12-02T01:30:10.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.879+0000 7f65aa6d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 0x7f65a40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.879+0000 7f65aa6d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f65a40afee0 0x7f65a40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.879+0000 7f65aa6d0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a415ee60 con 0x7f65a40cbbd0 2023-12-02T01:30:10.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.879+0000 7f65aa6d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40cef60 con 0x7f65a40afee0 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.879+0000 7f65aa6d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4099a10 con 0x7f65a415ea80 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.879+0000 7f65a8c6d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f65a40cbbd0 0x7f65a40cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51208/0 (socket says 172.21.15.1:51208) 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.879+0000 7f65a8c6d640 1 -- 172.21.15.1:0/1544923427 learned_addr learned my addr 172.21.15.1:0/1544923427 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073231073 0 0) 0x7f65a415ee60 con 0x7f65a40cbbd0 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a3fff640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 0x7f65a40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a37fe640 1 --2- 172.21.15.1:0/1544923427 >> v2:172.21.15.167:3300/0 conn(0x7f65a40afee0 0x7f65a40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f658c003520 con 0x7f65a40cbbd0 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207117756 0 0) 0x7f658c003520 con 0x7f65a40cbbd0 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 msgr2=0x7f65a40cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 0x7f65a40cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 >> v2:172.21.15.167:3300/0 conn(0x7f65a40afee0 msgr2=0x7f65a40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 --2- 172.21.15.1:0/1544923427 >> v2:172.21.15.167:3300/0 conn(0x7f65a40afee0 0x7f65a40cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a4099cf0 con 0x7f65a40cbbd0 2023-12-02T01:30:10.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f659c0019f0 con 0x7f65a40cbbd0 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 >> v1:172.21.15.1:6789/0 conn(0x7f65a40cbbd0 legacy=0x7f65a40cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f658c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 0x7f658c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f658c004d00 0x7f658c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40cef60 con 0x7f658c003970 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4099a10 con 0x7f658c004d00 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c00b980 con 0x7f65a415ea80 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a3fff640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f658c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a37fe640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 0x7f658c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a8c6d640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f658c004d00 0x7f658c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a3fff640 1 -- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 msgr2=0x7f658c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a3fff640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a415ea80 0x7f658c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a3fff640 1 -- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f658c004d00 msgr2=0x7f658c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:10.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a3fff640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f658c004d00 0x7f658c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.880+0000 7f65a3fff640 1 -- 172.21.15.1:0/1544923427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c003520 con 0x7f658c003970 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.881+0000 7f65a3fff640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f658c003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6594009ac0 tx=0x7f658c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a1f29bf5f8699 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.881+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659402c6b0 con 0x7f658c003970 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.881+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659402c810 con 0x7f658c003970 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.881+0000 7f65a2ffd640 1 -- 172.21.15.1:0/1544923427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659402cba0 con 0x7f658c003970 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.882+0000 7f65aa6d0640 1 -- 172.21.15.1:0/1544923427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 msgr2=0x7f658c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.882+0000 7f65aa6d0640 1 --2- 172.21.15.1:0/1544923427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f658c003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6594009ac0 tx=0x7f658c0057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.882+0000 7f65a8c6d640 1 -- 172.21.15.1:0/1544923427 reap_dead start 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.882+0000 7f65aa6d0640 1 -- 172.21.15.1:0/1544923427 shutdown_connections 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.882+0000 7f65aa6d0640 1 -- 172.21.15.1:0/1544923427 >> 172.21.15.1:0/1544923427 conn(0x7f65a40b2ab0 msgr2=0x7f65a40b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.882+0000 7f65aa6d0640 1 -- 172.21.15.1:0/1544923427 shutdown_connections 2023-12-02T01:30:10.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.882+0000 7f65aa6d0640 1 -- 172.21.15.1:0/1544923427 wait complete. 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.883+0000 7f65aa6d0640 1 Processor -- start 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.883+0000 7f65aa6d0640 1 -- start start 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65aa6d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f65a40c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65aa6d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a40c73e0 0x7f65a414b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65aa6d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a40c7860 0x7f65a40cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65aa6d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40ca830 con 0x7f658c003970 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65aa6d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40c9e90 con 0x7f65a40c73e0 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65aa6d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40ca170 con 0x7f65a40c7860 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f65a40c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f65a40c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44346/0 (socket says 172.21.15.1:44346) 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 -- 172.21.15.1:0/2470887413 learned_addr learned my addr 172.21.15.1:0/2470887413 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a37fe640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a40c73e0 0x7f65a414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a8c6d640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a40c7860 0x7f65a40cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 -- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a40c7860 msgr2=0x7f65a40cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a40c7860 0x7f65a40cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 -- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a40c73e0 msgr2=0x7f65a414b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a40c73e0 0x7f65a414b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.884+0000 7f65a3fff640 1 -- 172.21.15.1:0/2470887413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40ca450 con 0x7f658c003970 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.885+0000 7f65a3fff640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f65a40c8090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f659402c250 tx=0x7f6594004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.885+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2470887413 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594003810 con 0x7f658c003970 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.885+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2470887413 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594003970 con 0x7f658c003970 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.885+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2470887413 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594003ce0 con 0x7f658c003970 2023-12-02T01:30:10.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.885+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a40c9b40 con 0x7f658c003970 2023-12-02T01:30:10.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.885+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a414b8a0 con 0x7f658c003970 2023-12-02T01:30:10.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.886+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a40caaa0 con 0x7f658c003970 2023-12-02T01:30:10.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.886+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2470887413 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6594034440 con 0x7f658c003970 2023-12-02T01:30:10.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.887+0000 7f65a0ff9640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:10.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.887+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2470887413 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65940ab880 con 0x7f658c003970 2023-12-02T01:30:10.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.887+0000 7f65a37fe640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:10.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.887+0000 7f65a37fe640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65a406e260 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:10.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:10.891+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2470887413 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6594076a70 con 0x7f658c003970 2023-12-02T01:30:11.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.067+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65a409f0b0 con 0x7f658c003970 2023-12-02T01:30:11.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.067+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2470887413 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f659404c0a0 con 0x7f658c003970 2023-12-02T01:30:11.069 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:11.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 msgr2=0x7f659006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65a406e260 tx=0x7f6598008040 comp rx=0 tx=0).stop 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 msgr2=0x7f65a40c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f65a40c8090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f659402c250 tx=0x7f6594004730 comp rx=0 tx=0).stop 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 shutdown_connections 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a40c7860 0x7f65a40cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a40c73e0 0x7f65a414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 --2- 172.21.15.1:0/2470887413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f658c003970 0x7f65a40c8090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 >> 172.21.15.1:0/2470887413 conn(0x7f65a40b2ab0 msgr2=0x7f65a40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 shutdown_connections 2023-12-02T01:30:11.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.070+0000 7f65aa6d0640 1 -- 172.21.15.1:0/2470887413 wait complete. 2023-12-02T01:30:11.103 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-02T01:30:11.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:11.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.209+0000 7f7938bbe640 1 Processor -- start 2023-12-02T01:30:11.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.209+0000 7f7938bbe640 1 -- start start 2023-12-02T01:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7938bbe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 0x7f793415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7938bbe640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793406e9e0 con 0x7f793406cc50 2023-12-02T01:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7938bbe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793406de60 con 0x7f793406a8b0 2023-12-02T01:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7938bbe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793406d0d0 con 0x7f79340b2690 2023-12-02T01:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f792bfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f793406cc50 0x7f79340b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51222/0 (socket says 172.21.15.1:51222) 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f792bfff640 1 -- 172.21.15.1:0/1520155560 learned_addr learned my addr 172.21.15.1:0/1520155560 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f793259c640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 0x7f793415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257391092 0 0) 0x7f793406e9e0 con 0x7f793406cc50 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7920003520 con 0x7f793406cc50 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117445429 0 0) 0x7f793406de60 con 0x7f793406a8b0 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793406e9e0 con 0x7f793406a8b0 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3433168263 0 0) 0x7f7920003520 con 0x7f793406cc50 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 msgr2=0x7f793415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 0x7f793415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 >> v1:172.21.15.167:6789/0 conn(0x7f793406a8b0 legacy=0x7f793406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793406d2e0 con 0x7f793406cc50 2023-12-02T01:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f791c001670 con 0x7f793406cc50 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.210+0000 7f793259c640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 0x7f793415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 >> v1:172.21.15.1:6789/0 conn(0x7f793406cc50 legacy=0x7f79340b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7931d9b640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7920003b30 0x7f7920003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7931d9b640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79200047c0 0x7f7920004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7931d9b640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 0x7f7920005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793406d0d0 con 0x7f7920003b30 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792000ba60 con 0x7f79200047c0 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792000bc20 con 0x7f79340b2690 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f793259c640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7920003b30 0x7f7920003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f7932d9d640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 0x7f7920005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f792bfff640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79200047c0 0x7f7920004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f793259c640 1 -- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 msgr2=0x7f7920005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f793259c640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340b2690 0x7f7920005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f793259c640 1 -- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79200047c0 msgr2=0x7f7920004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f793259c640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79200047c0 0x7f7920004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.211+0000 7f793259c640 1 -- 172.21.15.1:0/1520155560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924009400 con 0x7f7920003b30 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f793259c640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7920003b30 0x7f7920003f30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7924009c60 tx=0x7f79200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e94d08a5ddedbb server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792402c8a0 con 0x7f7920003b30 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792402ca00 con 0x7f7920003b30 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7931d9b640 1 -- 172.21.15.1:0/1520155560 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792402cdb0 con 0x7f7920003b30 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7938bbe640 1 -- 172.21.15.1:0/1520155560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7920003b30 msgr2=0x7f7920003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7938bbe640 1 --2- 172.21.15.1:0/1520155560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7920003b30 0x7f7920003f30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7924009c60 tx=0x7f79200057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7932d9d640 1 -- 172.21.15.1:0/1520155560 reap_dead start 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7938bbe640 1 -- 172.21.15.1:0/1520155560 shutdown_connections 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7938bbe640 1 -- 172.21.15.1:0/1520155560 >> 172.21.15.1:0/1520155560 conn(0x7f79340cf6a0 msgr2=0x7f79340cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7938bbe640 1 -- 172.21.15.1:0/1520155560 shutdown_connections 2023-12-02T01:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.212+0000 7f7938bbe640 1 -- 172.21.15.1:0/1520155560 wait complete. 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 Processor -- start 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 -- start start 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920003b30 0x7f79340c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79340c4600 0x7f79341490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340c5b30 0x7f7934161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340c56a0 con 0x7f79340c4600 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340c4a90 con 0x7f7920003b30 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.214+0000 7f7938bbe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79340c4d70 con 0x7f79340c5b30 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79340c4600 0x7f79341490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79340c4600 0x7f79341490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44358/0 (socket says 172.21.15.1:44358) 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 -- 172.21.15.1:0/2505553427 learned_addr learned my addr 172.21.15.1:0/2505553427 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f7932d9d640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340c5b30 0x7f7934161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f793259c640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920003b30 0x7f79340c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 -- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340c5b30 msgr2=0x7f7934161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340c5b30 0x7f7934161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 -- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920003b30 msgr2=0x7f79340c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920003b30 0x7f79340c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 -- 172.21.15.1:0/2505553427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340c5050 con 0x7f79340c4600 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792bfff640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79340c4600 0x7f79341490d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f791c000c00 tx=0x7f791c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792affd640 1 -- 172.21.15.1:0/2505553427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00c630 con 0x7f79340c4600 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792affd640 1 -- 172.21.15.1:0/2505553427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00c790 con 0x7f79340c4600 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79340c5330 con 0x7f79340c4600 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f792affd640 1 -- 172.21.15.1:0/2505553427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00cb40 con 0x7f79340c4600 2023-12-02T01:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.215+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79340cede0 con 0x7f79340c4600 2023-12-02T01:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.216+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79340c5810 con 0x7f79340c4600 2023-12-02T01:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.217+0000 7f792affd640 1 -- 172.21.15.1:0/2505553427 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f791c01d460 con 0x7f79340c4600 2023-12-02T01:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.217+0000 7f792affd640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f791406ae40 0x7f791406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.217+0000 7f792affd640 1 -- 172.21.15.1:0/2505553427 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f791c089490 con 0x7f79340c4600 2023-12-02T01:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.217+0000 7f793259c640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f791406ae40 0x7f791406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.218+0000 7f793259c640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f791406ae40 0x7f791406d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7924036000 tx=0x7f7924030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.221+0000 7f792affd640 1 -- 172.21.15.1:0/2505553427 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f791c054680 con 0x7f79340c4600 2023-12-02T01:30:11.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.399+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7934067420 con 0x7f79340c4600 2023-12-02T01:30:11.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.400+0000 7f792affd640 1 -- 172.21.15.1:0/2505553427 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f791c057ca0 con 0x7f79340c4600 2023-12-02T01:30:11.402 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:11.402 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:11.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f791406ae40 msgr2=0x7f791406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f791406ae40 0x7f791406d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7924036000 tx=0x7f7924030000 comp rx=0 tx=0).stop 2023-12-02T01:30:11.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79340c4600 msgr2=0x7f79341490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79340c4600 0x7f79341490d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f791c000c00 tx=0x7f791c00eb90 comp rx=0 tx=0).stop 2023-12-02T01:30:11.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 shutdown_connections 2023-12-02T01:30:11.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79340c5b30 0x7f7934161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79340c4600 0x7f79341490d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f791406ae40 0x7f791406d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.405 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 --2- 172.21.15.1:0/2505553427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920003b30 0x7f79340c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 >> 172.21.15.1:0/2505553427 conn(0x7f79340cf6a0 msgr2=0x7f793415fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:11.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 shutdown_connections 2023-12-02T01:30:11.406 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.402+0000 7f7938bbe640 1 -- 172.21.15.1:0/2505553427 wait complete. 2023-12-02T01:30:11.415 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:11.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:11.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.524+0000 7f1c8c2e5640 1 Processor -- start 2023-12-02T01:30:11.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.525+0000 7f1c8c2e5640 1 -- start start 2023-12-02T01:30:11.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.525+0000 7f1c8c2e5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c8406d830 0x7f1c840b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.525+0000 7f1c8c2e5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c840cebe0 con 0x7f1c840ce800 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.525+0000 7f1c8c2e5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c84070da0 con 0x7f1c8415a6b0 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8c2e5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c84071080 con 0x7f1c8406d830 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8a882640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1c8406d830 0x7f1c840b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8a081640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1c840ce800 0x7f1c840702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45528/0 (socket says 172.21.15.1:45528) 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8a081640 1 -- 172.21.15.1:0/484189304 learned_addr learned my addr 172.21.15.1:0/484189304 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8a882640 1 -- 172.21.15.1:0/484189304 >> v1:172.21.15.167:6789/0 conn(0x7f1c8415a6b0 legacy=0x7f1c8406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8a882640 1 -- 172.21.15.1:0/484189304 >> v1:172.21.15.1:6789/0 conn(0x7f1c840ce800 legacy=0x7f1c840702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8a882640 1 -- 172.21.15.1:0/484189304 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c84159eb0 con 0x7f1c8406d830 2023-12-02T01:30:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.526+0000 7f1c8907f640 1 -- 172.21.15.1:0/484189304 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395596106 0 0) 0x7f1c840cebe0 con 0x7f1c840ce800 2023-12-02T01:30:11.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.527+0000 7f1c8a882640 1 --2- 172.21.15.1:0/484189304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8406d830 0x7f1c840b31a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009d90 tx=0x7f1c7c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b68c4a0e8ec664 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.527+0000 7f1c8907f640 1 -- 172.21.15.1:0/484189304 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c02cbd0 con 0x7f1c8406d830 2023-12-02T01:30:11.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.527+0000 7f1c8907f640 1 -- 172.21.15.1:0/484189304 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c02cd30 con 0x7f1c8406d830 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.527+0000 7f1c8907f640 1 -- 172.21.15.1:0/484189304 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c02cea0 con 0x7f1c8406d830 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.527+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/484189304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8406d830 msgr2=0x7f1c840b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.527+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/484189304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8406d830 0x7f1c840b31a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009d90 tx=0x7f1c7c02be20 comp rx=0 tx=0).stop 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.528+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/484189304 shutdown_connections 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.528+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/484189304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8406d830 0x7f1c840b31a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.528+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/484189304 >> 172.21.15.1:0/484189304 conn(0x7f1c8406a8f0 msgr2=0x7f1c8406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.528+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/484189304 shutdown_connections 2023-12-02T01:30:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.528+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/484189304 wait complete. 2023-12-02T01:30:11.532 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 Processor -- start 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 -- start start 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c8406d830 0x7f1c84155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c840ce800 0x7f1c84146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8415a6b0 0x7f1c84159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c84154e30 con 0x7f1c8415a6b0 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c84146cc0 con 0x7f1c840ce800 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.529+0000 7f1c8c2e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8414b020 con 0x7f1c8406d830 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8415a6b0 0x7f1c84159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8415a6b0 0x7f1c84159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54746/0 (socket says 172.21.15.1:54746) 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 -- 172.21.15.1:0/540867365 learned_addr learned my addr 172.21.15.1:0/540867365 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c89880640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c840ce800 0x7f1c84146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a081640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c8406d830 0x7f1c84155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 -- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c8406d830 msgr2=0x7f1c84155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c8406d830 0x7f1c84155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 -- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c840ce800 msgr2=0x7f1c84146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c840ce800 0x7f1c84146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 -- 172.21.15.1:0/540867365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c009a70 con 0x7f1c8415a6b0 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8a882640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8415a6b0 0x7f1c84159010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009d90 tx=0x7f1c7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c7affd640 1 -- 172.21.15.1:0/540867365 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c02cea0 con 0x7f1c8415a6b0 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c7affd640 1 -- 172.21.15.1:0/540867365 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c03e630 con 0x7f1c8415a6b0 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c84149e20 con 0x7f1c8415a6b0 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c7affd640 1 -- 172.21.15.1:0/540867365 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c03e9e0 con 0x7f1c8415a6b0 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.530+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c84154770 con 0x7f1c8415a6b0 2023-12-02T01:30:11.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.531+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c840b1a60 con 0x7f1c8415a6b0 2023-12-02T01:30:11.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.532+0000 7f1c7affd640 1 -- 172.21.15.1:0/540867365 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c7c03b050 con 0x7f1c8415a6b0 2023-12-02T01:30:11.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.532+0000 7f1c7affd640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1c6806ae40 0x7f1c6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.532+0000 7f1c7affd640 1 -- 172.21.15.1:0/540867365 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c7c0ab800 con 0x7f1c8415a6b0 2023-12-02T01:30:11.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.532+0000 7f1c8a081640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1c6806ae40 0x7f1c6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.532+0000 7f1c8a081640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1c6806ae40 0x7f1c6806d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c80000f60 tx=0x7f1c80007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.536+0000 7f1c7affd640 1 -- 172.21.15.1:0/540867365 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c7c0768c0 con 0x7f1c8415a6b0 2023-12-02T01:30:11.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.712+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c84154f70 con 0x7f1c8415a6b0 2023-12-02T01:30:11.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.712+0000 7f1c7affd640 1 -- 172.21.15.1:0/540867365 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c84154f70 con 0x7f1c8415a6b0 2023-12-02T01:30:11.714 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1c6806ae40 msgr2=0x7f1c6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1c6806ae40 0x7f1c6806d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c80000f60 tx=0x7f1c80007b50 comp rx=0 tx=0).stop 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8415a6b0 msgr2=0x7f1c84159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8415a6b0 0x7f1c84159010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009d90 tx=0x7f1c7c004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 shutdown_connections 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c8415a6b0 0x7f1c84159010 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1c6806ae40 0x7f1c6806d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c840ce800 0x7f1c84146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 --2- 172.21.15.1:0/540867365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c8406d830 0x7f1c84155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 >> 172.21.15.1:0/540867365 conn(0x7f1c8406a8f0 msgr2=0x7f1c840b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:11.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 shutdown_connections 2023-12-02T01:30:11.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.714+0000 7f1c8c2e5640 1 -- 172.21.15.1:0/540867365 wait complete. 2023-12-02T01:30:11.727 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:11.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.835+0000 7fc52e810640 1 Processor -- start 2023-12-02T01:30:11.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.835+0000 7fc52e810640 1 -- start start 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc52e810640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc52809a080 0x7fc5280cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc52e810640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc52806bc50 0x7fc52806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc52e810640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280b3590 con 0x7fc5280b6b50 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc52e810640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52806b310 con 0x7fc52809a080 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc52e810640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5280cd3a0 con 0x7fc52806bc50 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc5277fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc52809a080 0x7fc5280cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc527fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc5280b6b50 0x7fc528099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45542/0 (socket says 172.21.15.1:45542) 2023-12-02T01:30:11.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc527fff640 1 -- 172.21.15.1:0/1147806542 learned_addr learned my addr 172.21.15.1:0/1147806542 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:11.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc52cdad640 1 --2- 172.21.15.1:0/1147806542 >> v2:172.21.15.167:3300/0 conn(0x7fc52806bc50 0x7fc52806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc5277fe640 1 -- 172.21.15.1:0/1147806542 >> v2:172.21.15.167:3300/0 conn(0x7fc52806bc50 msgr2=0x7fc52806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:11.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc5277fe640 1 --2- 172.21.15.1:0/1147806542 >> v2:172.21.15.167:3300/0 conn(0x7fc52806bc50 0x7fc52806c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc5277fe640 1 -- 172.21.15.1:0/1147806542 >> v1:172.21.15.1:6789/0 conn(0x7fc5280b6b50 legacy=0x7fc528099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc526ffd640 1 -- 172.21.15.1:0/1147806542 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521095802 0 0) 0x7fc5280b3590 con 0x7fc5280b6b50 2023-12-02T01:30:11.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc5277fe640 1 -- 172.21.15.1:0/1147806542 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280b37c0 con 0x7fc52809a080 2023-12-02T01:30:11.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.836+0000 7fc52cdad640 1 --2- 172.21.15.1:0/1147806542 >> v2:172.21.15.167:3300/0 conn(0x7fc52806bc50 0x7fc52806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:11.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.837+0000 7fc5277fe640 1 --2- 172.21.15.1:0/1147806542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52809a080 0x7fc5280cfd40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc528072410 tx=0x7fc51802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73b9798f5d0ecf6 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.837+0000 7fc526ffd640 1 -- 172.21.15.1:0/1147806542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518030610 con 0x7fc52809a080 2023-12-02T01:30:11.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.837+0000 7fc526ffd640 1 -- 172.21.15.1:0/1147806542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518030770 con 0x7fc52809a080 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.837+0000 7fc526ffd640 1 -- 172.21.15.1:0/1147806542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518030b00 con 0x7fc52809a080 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 -- 172.21.15.1:0/1147806542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52809a080 msgr2=0x7fc5280cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 --2- 172.21.15.1:0/1147806542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52809a080 0x7fc5280cfd40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc528072410 tx=0x7fc51802b960 comp rx=0 tx=0).stop 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 -- 172.21.15.1:0/1147806542 shutdown_connections 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 --2- 172.21.15.1:0/1147806542 >> v2:172.21.15.167:3300/0 conn(0x7fc52806bc50 0x7fc52806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 --2- 172.21.15.1:0/1147806542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52809a080 0x7fc5280cfd40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 -- 172.21.15.1:0/1147806542 >> 172.21.15.1:0/1147806542 conn(0x7fc5280b2a70 msgr2=0x7fc5280b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 -- 172.21.15.1:0/1147806542 shutdown_connections 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.838+0000 7fc52e810640 1 -- 172.21.15.1:0/1147806542 wait complete. 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.839+0000 7fc52e810640 1 Processor -- start 2023-12-02T01:30:11.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.839+0000 7fc52e810640 1 -- start start 2023-12-02T01:30:11.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc52e810640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52806bc50 0x7fc52814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc52e810640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc52809a080 0x7fc5280ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc52e810640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5280b6b50 0x7fc5280cf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc52e810640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280b5650 con 0x7fc52806bc50 2023-12-02T01:30:11.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc52e810640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52814efc0 con 0x7fc5280b6b50 2023-12-02T01:30:11.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc52e810640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281f31b0 con 0x7fc52809a080 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52806bc50 0x7fc52814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52806bc50 0x7fc52814ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54760/0 (socket says 172.21.15.1:54760) 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 -- 172.21.15.1:0/2641129198 learned_addr learned my addr 172.21.15.1:0/2641129198 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc5277fe640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc52809a080 0x7fc5280ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc52cdad640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5280b6b50 0x7fc5280cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 -- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc52809a080 msgr2=0x7fc5280ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc52809a080 0x7fc5280ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 -- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5280b6b50 msgr2=0x7fc5280cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5280b6b50 0x7fc5280cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.840+0000 7fc527fff640 1 -- 172.21.15.1:0/2641129198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518009400 con 0x7fc52806bc50 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.841+0000 7fc527fff640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52806bc50 0x7fc52814ea80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c430 tx=0x7fc51c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.841+0000 7fc524ff9640 1 -- 172.21.15.1:0/2641129198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0074e0 con 0x7fc52806bc50 2023-12-02T01:30:11.844 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.841+0000 7fc524ff9640 1 -- 172.21.15.1:0/2641129198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c007660 con 0x7fc52806bc50 2023-12-02T01:30:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.841+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5281f3490 con 0x7fc52806bc50 2023-12-02T01:30:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.841+0000 7fc524ff9640 1 -- 172.21.15.1:0/2641129198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c004a20 con 0x7fc52806bc50 2023-12-02T01:30:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.841+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5281f3a50 con 0x7fc52806bc50 2023-12-02T01:30:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.842+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5280cb210 con 0x7fc52806bc50 2023-12-02T01:30:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.842+0000 7fc524ff9640 1 -- 172.21.15.1:0/2641129198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc51c004b80 con 0x7fc52806bc50 2023-12-02T01:30:11.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.842+0000 7fc524ff9640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc51406ae40 0x7fc51406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:11.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.843+0000 7fc524ff9640 1 -- 172.21.15.1:0/2641129198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc51c0893b0 con 0x7fc52806bc50 2023-12-02T01:30:11.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.843+0000 7fc5277fe640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc51406ae40 0x7fc51406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:11.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.843+0000 7fc5277fe640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc51406ae40 0x7fc51406d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc518036000 tx=0x7fc51803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:11.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:11.847+0000 7fc524ff9640 1 -- 172.21.15.1:0/2641129198 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc51c0544f0 con 0x7fc52806bc50 2023-12-02T01:30:12.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.023+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5280afc50 con 0x7fc52806bc50 2023-12-02T01:30:12.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.023+0000 7fc524ff9640 1 -- 172.21.15.1:0/2641129198 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc51c057b10 con 0x7fc52806bc50 2023-12-02T01:30:12.025 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:12.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc51406ae40 msgr2=0x7fc51406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc51406ae40 0x7fc51406d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc518036000 tx=0x7fc51803b040 comp rx=0 tx=0).stop 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52806bc50 msgr2=0x7fc52814ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52806bc50 0x7fc52814ea80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00c430 tx=0x7fc51c00c8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 shutdown_connections 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc51406ae40 0x7fc51406d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5280b6b50 0x7fc5280cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc52809a080 0x7fc5280ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 --2- 172.21.15.1:0/2641129198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc52806bc50 0x7fc52814ea80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 >> 172.21.15.1:0/2641129198 conn(0x7fc5280b2a70 msgr2=0x7fc5280d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 shutdown_connections 2023-12-02T01:30:12.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.025+0000 7fc52e810640 1 -- 172.21.15.1:0/2641129198 wait complete. 2023-12-02T01:30:12.037 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.145+0000 7f6b1ae10640 1 Processor -- start 2023-12-02T01:30:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.145+0000 7f6b1ae10640 1 -- start start 2023-12-02T01:30:12.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b1ae10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 0x7f6b140cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b1ae10640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140b3590 con 0x7f6b14099970 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b1ae10640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1406b310 con 0x7f6b1406bc50 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b1ae10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140cd3a0 con 0x7f6b140b6b50 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b13fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6b14099970 0x7f6b14099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45556/0 (socket says 172.21.15.1:45556) 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b13fff640 1 -- 172.21.15.1:0/2246677502 learned_addr learned my addr 172.21.15.1:0/2246677502 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b18bac640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 0x7f6b140cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425870218 0 0) 0x7f6b140b3590 con 0x7f6b14099970 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.146+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6afc003520 con 0x7f6b14099970 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993266032 0 0) 0x7f6afc003520 con 0x7f6b14099970 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 msgr2=0x7f6b140cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 0x7f6b140cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 >> v1:172.21.15.167:6789/0 conn(0x7f6b1406bc50 legacy=0x7f6b1406c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140b37c0 con 0x7f6b14099970 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f6b08001670 con 0x7f6b14099970 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 >> v1:172.21.15.1:6789/0 conn(0x7f6b14099970 legacy=0x7f6b14099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6afc0039a0 0x7f6afc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6afc004350 0x7f6afc004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 0x7f6afc005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140cd3a0 con 0x7f6afc004350 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc00b980 con 0x7f6afc0039a0 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc00bb40 con 0x7f6b140b6b50 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b13fff640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6afc004350 0x7f6afc004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b18bac640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6afc0039a0 0x7f6afc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b193ad640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 0x7f6afc005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b13fff640 1 -- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 msgr2=0x7f6afc005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:12.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b13fff640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b140b6b50 0x7f6afc005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b13fff640 1 -- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6afc0039a0 msgr2=0x7f6afc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b13fff640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6afc0039a0 0x7f6afc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.147+0000 7f6b13fff640 1 -- 172.21.15.1:0/2246677502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc003520 con 0x7f6afc004350 2023-12-02T01:30:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.148+0000 7f6b13fff640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6afc004350 0x7f6afc004820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800c210 tx=0x7f6afc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ca197e75786b54 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.148+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08005ad0 con 0x7f6afc004350 2023-12-02T01:30:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.148+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08005c50 con 0x7f6afc004350 2023-12-02T01:30:12.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.148+0000 7f6b137fe640 1 -- 172.21.15.1:0/2246677502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0802c8d0 con 0x7f6afc004350 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.149+0000 7f6b1ae10640 1 -- 172.21.15.1:0/2246677502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6afc004350 msgr2=0x7f6afc004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.149+0000 7f6b1ae10640 1 --2- 172.21.15.1:0/2246677502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6afc004350 0x7f6afc004820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800c210 tx=0x7f6afc0057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.149+0000 7f6b193ad640 1 -- 172.21.15.1:0/2246677502 reap_dead start 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.149+0000 7f6b1ae10640 1 -- 172.21.15.1:0/2246677502 shutdown_connections 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.149+0000 7f6b1ae10640 1 -- 172.21.15.1:0/2246677502 >> 172.21.15.1:0/2246677502 conn(0x7f6b140b2a70 msgr2=0x7f6b140b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.149+0000 7f6b1ae10640 1 -- 172.21.15.1:0/2246677502 shutdown_connections 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.149+0000 7f6b1ae10640 1 -- 172.21.15.1:0/2246677502 wait complete. 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.150+0000 7f6b1ae10640 1 Processor -- start 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.150+0000 7f6b1ae10640 1 -- start start 2023-12-02T01:30:12.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b1ae10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6afc004350 0x7f6b1415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b1ae10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b141f2850 0x7f6b1415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b1ae10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b140ca880 0x7f6b140cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b1ae10640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1415fd30 con 0x7f6b141f2850 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b1ae10640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140cb240 con 0x7f6b140ca880 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b1ae10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1415e270 con 0x7f6afc004350 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b141f2850 0x7f6b1415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b141f2850 0x7f6b1415dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54770/0 (socket says 172.21.15.1:54770) 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 -- 172.21.15.1:0/3348783351 learned_addr learned my addr 172.21.15.1:0/3348783351 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b18bac640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6afc004350 0x7f6b1415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b193ad640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b140ca880 0x7f6b140cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 -- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6afc004350 msgr2=0x7f6b1415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6afc004350 0x7f6b1415ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 -- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b140ca880 msgr2=0x7f6b140cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b140ca880 0x7f6b140cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 -- 172.21.15.1:0/3348783351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b141f2cd0 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b193ad640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b140ca880 0x7f6b140cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.151+0000 7f6b13fff640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b141f2850 0x7f6b1415dd30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b08001930 tx=0x7f6b0802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.152+0000 7f6b117fa640 1 -- 172.21.15.1:0/3348783351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0803c040 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.152+0000 7f6b117fa640 1 -- 172.21.15.1:0/3348783351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0802cce0 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.152+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1415f1b0 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.152+0000 7f6b117fa640 1 -- 172.21.15.1:0/3348783351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080072b0 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.152+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1415f770 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.153+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1409ef40 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.153+0000 7f6b117fa640 1 -- 172.21.15.1:0/3348783351 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b08032070 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.154+0000 7f6b117fa640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b0006ae40 0x7f6b0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.154+0000 7f6b117fa640 1 -- 172.21.15.1:0/3348783351 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b080aab60 con 0x7f6b141f2850 2023-12-02T01:30:12.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.154+0000 7f6b18bac640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b0006ae40 0x7f6b0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.154+0000 7f6b18bac640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b0006ae40 0x7f6b0006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009b40 tx=0x7f6b04009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:12.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.158+0000 7f6b117fa640 1 -- 172.21.15.1:0/3348783351 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b08075d30 con 0x7f6b141f2850 2023-12-02T01:30:12.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.333+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b1404e920 con 0x7f6b141f2850 2023-12-02T01:30:12.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.333+0000 7f6b117fa640 1 -- 172.21.15.1:0/3348783351 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b08079350 con 0x7f6b141f2850 2023-12-02T01:30:12.335 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b0006ae40 msgr2=0x7f6b0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b0006ae40 0x7f6b0006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009b40 tx=0x7f6b04009190 comp rx=0 tx=0).stop 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b141f2850 msgr2=0x7f6b1415dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b141f2850 0x7f6b1415dd30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b08001930 tx=0x7f6b0802e070 comp rx=0 tx=0).stop 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 shutdown_connections 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6b0006ae40 0x7f6b0006d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b140ca880 0x7f6b140cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b141f2850 0x7f6b1415dd30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 --2- 172.21.15.1:0/3348783351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6afc004350 0x7f6b1415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 >> 172.21.15.1:0/3348783351 conn(0x7f6b140b2a70 msgr2=0x7f6b1406c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 shutdown_connections 2023-12-02T01:30:12.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.335+0000 7f6b1ae10640 1 -- 172.21.15.1:0/3348783351 wait complete. 2023-12-02T01:30:12.348 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-12-02T01:30:12.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.453+0000 7f554184f640 1 Processor -- start 2023-12-02T01:30:12.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.453+0000 7f554184f640 1 -- start start 2023-12-02T01:30:12.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f554184f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f553c099970 0x7f553c0b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f554184f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c0b2230 0x7f553c099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f554184f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c09a290 con 0x7f553c15dcb0 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f554184f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c0b26c0 con 0x7f553c099970 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f554184f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c06c190 con 0x7f553c0b2230 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f553b7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f553c15dcb0 0x7f553c15e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45570/0 (socket says 172.21.15.1:45570) 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f553b7fe640 1 -- 172.21.15.1:0/3863730977 learned_addr learned my addr 172.21.15.1:0/3863730977 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f553affd640 1 --2- 172.21.15.1:0/3863730977 >> v2:172.21.15.167:3300/0 conn(0x7f553c099970 0x7f553c0b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f5533fff640 1 --2- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c0b2230 0x7f553c099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.454+0000 7f553a7fc640 1 -- 172.21.15.1:0/3863730977 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404808324 0 0) 0x7f553c09a290 con 0x7f553c15dcb0 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.455+0000 7f553a7fc640 1 -- 172.21.15.1:0/3863730977 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5528003520 con 0x7f553c15dcb0 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.455+0000 7f553affd640 1 -- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c0b2230 msgr2=0x7f553c099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.455+0000 7f553affd640 1 --2- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c0b2230 0x7f553c099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.455+0000 7f553affd640 1 -- 172.21.15.1:0/3863730977 >> v1:172.21.15.1:6789/0 conn(0x7f553c15dcb0 legacy=0x7f553c15e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.455+0000 7f553affd640 1 -- 172.21.15.1:0/3863730977 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c06c470 con 0x7f553c099970 2023-12-02T01:30:12.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.455+0000 7f5533fff640 1 --2- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c0b2230 0x7f553c099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:12.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.455+0000 7f553affd640 1 --2- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c099970 0x7f553c0b35d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f552c0097a0 tx=0x7f552c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6936ae2564ed3b82 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:12.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f553a7fc640 1 -- 172.21.15.1:0/3863730977 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c031830 con 0x7f553c099970 2023-12-02T01:30:12.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f553a7fc640 1 -- 172.21.15.1:0/3863730977 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c031990 con 0x7f553c099970 2023-12-02T01:30:12.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f553a7fc640 1 -- 172.21.15.1:0/3863730977 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c031d20 con 0x7f553c099970 2023-12-02T01:30:12.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 -- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c099970 msgr2=0x7f553c0b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 --2- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c099970 0x7f553c0b35d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f552c0097a0 tx=0x7f552c02b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 -- 172.21.15.1:0/3863730977 shutdown_connections 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 --2- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c0b2230 0x7f553c099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 --2- 172.21.15.1:0/3863730977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c099970 0x7f553c0b35d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 -- 172.21.15.1:0/3863730977 >> 172.21.15.1:0/3863730977 conn(0x7f553c0b2ab0 msgr2=0x7f553c0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 -- 172.21.15.1:0/3863730977 shutdown_connections 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.456+0000 7f554184f640 1 -- 172.21.15.1:0/3863730977 wait complete. 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 Processor -- start 2023-12-02T01:30:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 -- start start 2023-12-02T01:30:12.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c099970 0x7f553c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c15dcb0 0x7f553c1f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c0b4fa0 0x7f553c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0b40c0 con 0x7f553c15dcb0 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0b5960 con 0x7f553c0b4fa0 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f554184f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1f3dc0 con 0x7f553c099970 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.458+0000 7f5533fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c15dcb0 0x7f553c1f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c15dcb0 0x7f553c1f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54776/0 (socket says 172.21.15.1:54776) 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 -- 172.21.15.1:0/1405693541 learned_addr learned my addr 172.21.15.1:0/1405693541 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f553affd640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c099970 0x7f553c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f553b7fe640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c0b4fa0 0x7f553c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 -- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c099970 msgr2=0x7f553c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c099970 0x7f553c0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 -- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c0b4fa0 msgr2=0x7f553c0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c0b4fa0 0x7f553c0b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 -- 172.21.15.1:0/1405693541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524009400 con 0x7f553c15dcb0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5533fff640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c15dcb0 0x7f553c1f3880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f552400e960 tx=0x7f552400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5538ff9640 1 -- 172.21.15.1:0/1405693541 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400ca00 con 0x7f553c15dcb0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5538ff9640 1 -- 172.21.15.1:0/1405693541 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552400cb60 con 0x7f553c15dcb0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c009400 con 0x7f553c15dcb0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f5538ff9640 1 -- 172.21.15.1:0/1405693541 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524013470 con 0x7f553c15dcb0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.459+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c0b3720 con 0x7f553c15dcb0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.460+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c0b4200 con 0x7f553c15dcb0 2023-12-02T01:30:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.461+0000 7f5538ff9640 1 -- 172.21.15.1:0/1405693541 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55240135d0 con 0x7f553c15dcb0 2023-12-02T01:30:12.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.461+0000 7f5538ff9640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f551c06ae40 0x7f551c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:12.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.461+0000 7f5538ff9640 1 -- 172.21.15.1:0/1405693541 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55240898a0 con 0x7f553c15dcb0 2023-12-02T01:30:12.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.461+0000 7f553affd640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f551c06ae40 0x7f551c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:12.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.462+0000 7f553affd640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f551c06ae40 0x7f551c06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f552c036000 tx=0x7f552c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:12.467 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.466+0000 7f5538ff9640 1 -- 172.21.15.1:0/1405693541 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f553c0b4200 con 0x7f553c15dcb0 2023-12-02T01:30:12.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:12.712+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f553c0b4200 con 0x7f553c15dcb0 2023-12-02T01:30:13.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.452+0000 7f5538ff9640 1 -- 172.21.15.1:0/1405693541 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v50) v1 ==== 147+0+0 (secure 0 0 0) 0x7f553c0b4200 con 0x7f553c15dcb0 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f551c06ae40 msgr2=0x7f551c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f551c06ae40 0x7f551c06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f552c036000 tx=0x7f552c03c040 comp rx=0 tx=0).stop 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c15dcb0 msgr2=0x7f553c1f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c15dcb0 0x7f553c1f3880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f552400e960 tx=0x7f552400ee20 comp rx=0 tx=0).stop 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 shutdown_connections 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f551c06ae40 0x7f551c06d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f553c0b4fa0 0x7f553c0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c15dcb0 0x7f553c1f3880 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 --2- 172.21.15.1:0/1405693541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f553c099970 0x7f553c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 >> 172.21.15.1:0/1405693541 conn(0x7f553c0b2ab0 msgr2=0x7f553c15d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:13.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 shutdown_connections 2023-12-02T01:30:13.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.455+0000 7f554184f640 1 -- 172.21.15.1:0/1405693541 wait complete. 2023-12-02T01:30:13.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-02T01:30:13.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.585+0000 7fabe5c10640 1 Processor -- start 2023-12-02T01:30:13.587 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.585+0000 7fabe5c10640 1 -- start start 2023-12-02T01:30:13.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabe5c10640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fabe006fd30 0x7fabe00cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.589 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabe5c10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 0x7fabe015f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabe5c10640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00cc080 con 0x7fabe0099970 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabe5c10640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe0070110 con 0x7fabe006fd30 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabe5c10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00ccec0 con 0x7fabe0099e00 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabdeffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fabe0099970 0x7fabe015ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45574/0 (socket says 172.21.15.1:45574) 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabdeffd640 1 -- 172.21.15.1:0/3053623625 learned_addr learned my addr 172.21.15.1:0/3053623625 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/3053623625 >> v2:172.21.15.167:3300/0 conn(0x7fabe006fd30 0x7fabe00cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabdffff640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 0x7fabe015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317438313 0 0) 0x7fabe00cc080 con 0x7fabe0099970 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.586+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc8003520 con 0x7fabe0099970 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1993583602 0 0) 0x7fabc8003520 con 0x7fabe0099970 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 msgr2=0x7fabe015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 0x7fabe015f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.590 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 >> v2:172.21.15.167:3300/0 conn(0x7fabe006fd30 msgr2=0x7fabe00cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 --2- 172.21.15.1:0/3053623625 >> v2:172.21.15.167:3300/0 conn(0x7fabe006fd30 0x7fabe00cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe009a270 con 0x7fabe0099970 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fabd4001670 con 0x7fabe0099970 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 >> v1:172.21.15.1:6789/0 conn(0x7fabe0099970 legacy=0x7fabe015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 0x7fabc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabc8004d00 0x7fabc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0070110 con 0x7fabc8003970 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00ccec0 con 0x7fabc8004d00 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc800b980 con 0x7fabe0099e00 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdffff640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabc8004d00 0x7fabc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.591 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdeffd640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 0x7fabc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdf7fe640 1 -- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 msgr2=0x7fabc80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe0099e00 0x7fabc80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdf7fe640 1 -- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabc8004d00 msgr2=0x7fabc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabc8004d00 0x7fabc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdf7fe640 1 -- 172.21.15.1:0/3053623625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8003520 con 0x7fabc8003970 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.587+0000 7fabdffff640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabc8004d00 0x7fabc8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.588+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabc8003d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009ac0 tx=0x7fabc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89db582117ac823 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.588+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd002c710 con 0x7fabc8003970 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.588+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd002c870 con 0x7fabc8003970 2023-12-02T01:30:13.592 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.588+0000 7fabde7fc640 1 -- 172.21.15.1:0/3053623625 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd002cc00 con 0x7fabc8003970 2023-12-02T01:30:13.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.588+0000 7fabe5c10640 1 -- 172.21.15.1:0/3053623625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 msgr2=0x7fabc8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.588+0000 7fabe5c10640 1 --2- 172.21.15.1:0/3053623625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabc8003d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009ac0 tx=0x7fabc80057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.595 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.588+0000 7fabdffff640 1 -- 172.21.15.1:0/3053623625 reap_dead start 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.589+0000 7fabe5c10640 1 -- 172.21.15.1:0/3053623625 shutdown_connections 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.589+0000 7fabe5c10640 1 -- 172.21.15.1:0/3053623625 >> 172.21.15.1:0/3053623625 conn(0x7fabe00b2a20 msgr2=0x7fabe00b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.589+0000 7fabe5c10640 1 -- 172.21.15.1:0/3053623625 shutdown_connections 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.589+0000 7fabe5c10640 1 -- 172.21.15.1:0/3053623625 wait complete. 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.590+0000 7fabe5c10640 1 Processor -- start 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.590+0000 7fabe5c10640 1 -- start start 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabe5c10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabe01f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabe5c10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe01524e0 0x7fabe00c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabe5c10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe015ca70 0x7fabe015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabe5c10640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe015d430 con 0x7fabc8003970 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabe5c10640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00c8000 con 0x7fabe01524e0 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabe5c10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00c6b00 con 0x7fabe015ca70 2023-12-02T01:30:13.596 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabe01f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabe01f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54786/0 (socket says 172.21.15.1:54786) 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 -- 172.21.15.1:0/1066995267 learned_addr learned my addr 172.21.15.1:0/1066995267 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdffff640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe015ca70 0x7fabe015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdeffd640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe01524e0 0x7fabe00c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 -- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe015ca70 msgr2=0x7fabe015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe015ca70 0x7fabe015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 -- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe01524e0 msgr2=0x7fabe00c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe01524e0 0x7fabe00c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 -- 172.21.15.1:0/1066995267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00c75d0 con 0x7fabc8003970 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdeffd640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe01524e0 0x7fabe00c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdffff640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe015ca70 0x7fabe015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabdf7fe640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabe01f5250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009be0 tx=0x7fabd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabc7fff640 1 -- 172.21.15.1:0/1066995267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0003810 con 0x7fabc8003970 2023-12-02T01:30:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabc7fff640 1 -- 172.21.15.1:0/1066995267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd002de90 con 0x7fabc8003970 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe0152960 con 0x7fabc8003970 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.591+0000 7fabc7fff640 1 -- 172.21.15.1:0/1066995267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0003b70 con 0x7fabc8003970 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.592+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe00c7010 con 0x7fabc8003970 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.592+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe00b6a60 con 0x7fabc8003970 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.593+0000 7fabc7fff640 1 -- 172.21.15.1:0/1066995267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabd0003cd0 con 0x7fabc8003970 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.593+0000 7fabc7fff640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fabcc06ae40 0x7fabcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.593+0000 7fabc7fff640 1 -- 172.21.15.1:0/1066995267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd00ab540 con 0x7fabc8003970 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.593+0000 7fabdeffd640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fabcc06ae40 0x7fabcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.594+0000 7fabdeffd640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fabcc06ae40 0x7fabcc06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabd4001820 tx=0x7fabd4001c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:13.599 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.598+0000 7fabc7fff640 1 -- 172.21.15.1:0/1066995267 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabd0076690 con 0x7fabc8003970 2023-12-02T01:30:13.776 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.775+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fabe009f040 con 0x7fabc8003970 2023-12-02T01:30:13.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.778+0000 7fabc7fff640 1 -- 172.21.15.1:0/1066995267 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fabd0079cb0 con 0x7fabc8003970 2023-12-02T01:30:13.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fabcc06ae40 msgr2=0x7fabcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fabcc06ae40 0x7fabcc06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabd4001820 tx=0x7fabd4001c80 comp rx=0 tx=0).stop 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 msgr2=0x7fabe01f5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabe01f5250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009be0 tx=0x7fabd0004730 comp rx=0 tx=0).stop 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 shutdown_connections 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabe015ca70 0x7fabe015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fabcc06ae40 0x7fabcc06d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabe01524e0 0x7fabe00c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 --2- 172.21.15.1:0/1066995267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fabc8003970 0x7fabe01f5250 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 >> 172.21.15.1:0/1066995267 conn(0x7fabe00b2a20 msgr2=0x7fabe00cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 shutdown_connections 2023-12-02T01:30:13.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:13.780+0000 7fabe5c10640 1 -- 172.21.15.1:0/1066995267 wait complete. 2023-12-02T01:30:13.792 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-02T01:30:13.792 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-02T01:30:13.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-02T01:30:13.895 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-02T01:30:13.895 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:30:13.895 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:13.911 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:30:13.911 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:13.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:14.114 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.113+0000 7fe3d033c640 1 Processor -- start 2023-12-02T01:30:14.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.113+0000 7fe3d033c640 1 -- start start 2023-12-02T01:30:14.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3d033c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe3c815d900 0x7fe3c8099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3d033c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe3c80b2610 0x7fe3c8099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3d033c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c80cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3d033c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c80b0660 con 0x7fe3c80b2610 2023-12-02T01:30:14.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3d033c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c806c900 con 0x7fe3c815d900 2023-12-02T01:30:14.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3d033c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c806cbe0 con 0x7fe3c80b00c0 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe3c80b2610 0x7fe3c8099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe3c80b2610 0x7fe3c8099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54800/0 (socket says 172.21.15.1:54800) 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 -- 172.21.15.1:0/9292095 learned_addr learned my addr 172.21.15.1:0/9292095 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3ce8d9640 1 --2- 172.21.15.1:0/9292095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c80cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 -- 172.21.15.1:0/9292095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 msgr2=0x7fe3c80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3ce0d8640 1 --2- 172.21.15.1:0/9292095 >> v2:172.21.15.167:3300/0 conn(0x7fe3c815d900 0x7fe3c8099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 --2- 172.21.15.1:0/9292095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c80cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 -- 172.21.15.1:0/9292095 >> v2:172.21.15.167:3300/0 conn(0x7fe3c815d900 msgr2=0x7fe3c8099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 --2- 172.21.15.1:0/9292095 >> v2:172.21.15.167:3300/0 conn(0x7fe3c815d900 0x7fe3c8099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3cd8d7640 1 -- 172.21.15.1:0/9292095 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c806cec0 con 0x7fe3c80b2610 2023-12-02T01:30:14.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.114+0000 7fe3ce0d8640 1 --2- 172.21.15.1:0/9292095 >> v2:172.21.15.167:3300/0 conn(0x7fe3c815d900 0x7fe3c8099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.115+0000 7fe3cd8d7640 1 --2- 172.21.15.1:0/9292095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c80b2610 0x7fe3c8099eb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80d0ee0 tx=0x7fe3bc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e1146ee88573d server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.115+0000 7fe3cd0d6640 1 -- 172.21.15.1:0/9292095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc031860 con 0x7fe3c80b2610 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.115+0000 7fe3cd0d6640 1 -- 172.21.15.1:0/9292095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0319c0 con 0x7fe3c80b2610 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.115+0000 7fe3cd0d6640 1 -- 172.21.15.1:0/9292095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc031d50 con 0x7fe3c80b2610 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 -- 172.21.15.1:0/9292095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c80b2610 msgr2=0x7fe3c8099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 --2- 172.21.15.1:0/9292095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c80b2610 0x7fe3c8099eb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80d0ee0 tx=0x7fe3bc02b900 comp rx=0 tx=0).stop 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 -- 172.21.15.1:0/9292095 shutdown_connections 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 --2- 172.21.15.1:0/9292095 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c80cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 --2- 172.21.15.1:0/9292095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c80b2610 0x7fe3c8099eb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 --2- 172.21.15.1:0/9292095 >> v2:172.21.15.167:3300/0 conn(0x7fe3c815d900 0x7fe3c8099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 -- 172.21.15.1:0/9292095 >> 172.21.15.1:0/9292095 conn(0x7fe3c80b2a70 msgr2=0x7fe3c80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:14.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 -- 172.21.15.1:0/9292095 shutdown_connections 2023-12-02T01:30:14.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.116+0000 7fe3d033c640 1 -- 172.21.15.1:0/9292095 wait complete. 2023-12-02T01:30:14.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.117+0000 7fe3d033c640 1 Processor -- start 2023-12-02T01:30:14.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.117+0000 7fe3d033c640 1 -- start start 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3d033c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c8148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3d033c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3c80b2610 0x7fe3c814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3d033c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c815d900 0x7fe3c8149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3d033c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80b59f0 con 0x7fe3c815d900 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3d033c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c814c5e0 con 0x7fe3c80b2610 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3d033c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80c7450 con 0x7fe3c80b00c0 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c815d900 0x7fe3c8149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c815d900 0x7fe3c8149600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54802/0 (socket says 172.21.15.1:54802) 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 -- 172.21.15.1:0/3989739752 learned_addr learned my addr 172.21.15.1:0/3989739752 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce0d8640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c8148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3cd8d7640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3c80b2610 0x7fe3c814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 -- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 msgr2=0x7fe3c8148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c8148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 -- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3c80b2610 msgr2=0x7fe3c814c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3c80b2610 0x7fe3c814c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.118+0000 7fe3ce8d9640 1 -- 172.21.15.1:0/3989739752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc0094d0 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.119+0000 7fe3ce8d9640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c815d900 0x7fe3c8149600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800ccf0 tx=0x7fe3b800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.119+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/3989739752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8003b90 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.119+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/3989739752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8003cf0 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.119+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/3989739752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8004240 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.119+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c80c7730 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.119+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c80b5370 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.120+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c80b5b60 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.120+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/3989739752 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3b80043a0 con 0x7fe3c815d900 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.121+0000 7fe3c6ffd640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe3b406ae70 0x7fe3b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.121+0000 7fe3ce0d8640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe3b406ae70 0x7fe3b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.121+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/3989739752 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3b8012070 con 0x7fe3c815d900 2023-12-02T01:30:14.125 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.121+0000 7fe3ce0d8640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe3b406ae70 0x7fe3b406d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000a950 tx=0x7fe3c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.126 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.125+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/3989739752 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3b8055060 con 0x7fe3c815d900 2023-12-02T01:30:14.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.301+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3c8067420 con 0x7fe3c815d900 2023-12-02T01:30:14.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.302+0000 7fe3c6ffd640 1 -- 172.21.15.1:0/3989739752 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fe3b8058680 con 0x7fe3c815d900 2023-12-02T01:30:14.304 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:14.304 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe3b406ae70 msgr2=0x7fe3b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe3b406ae70 0x7fe3b406d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000a950 tx=0x7fe3c0008040 comp rx=0 tx=0).stop 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c815d900 msgr2=0x7fe3c8149600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c815d900 0x7fe3c8149600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800ccf0 tx=0x7fe3b800a660 comp rx=0 tx=0).stop 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 shutdown_connections 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3c815d900 0x7fe3c8149600 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe3b406ae70 0x7fe3b406d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3c80b2610 0x7fe3c814c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 --2- 172.21.15.1:0/3989739752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3c80b00c0 0x7fe3c8148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 >> 172.21.15.1:0/3989739752 conn(0x7fe3c80b2a70 msgr2=0x7fe3c80b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 shutdown_connections 2023-12-02T01:30:14.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.304+0000 7fe3d033c640 1 -- 172.21.15.1:0/3989739752 wait complete. 2023-12-02T01:30:14.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:14.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:14.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.426+0000 7fcdd5b83640 1 Processor -- start 2023-12-02T01:30:14.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.426+0000 7fcdd5b83640 1 -- start start 2023-12-02T01:30:14.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdd5b83640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcdd015d7b0 0x7fcdd00cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdd5b83640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd00ced50 0x7fcdd00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdd5b83640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00b04d0 con 0x7fcdd00d0050 2023-12-02T01:30:14.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdd5b83640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd00d04d0 con 0x7fcdd015d7b0 2023-12-02T01:30:14.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdd5b83640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00d1e40 con 0x7fcdd00ced50 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdcf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcdd015d7b0 0x7fcdd00cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdcffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd00ced50 0x7fcdd00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdceffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcdd00d0050 0x7fcdd00b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:57106/0 (socket says 172.21.15.1:57106) 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdcf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcdd015d7b0 0x7fcdd00cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:54652/0 (socket says 172.21.15.1:54652) 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.427+0000 7fcdceffd640 1 -- 172.21.15.1:0/3693772405 learned_addr learned my addr 172.21.15.1:0/3693772405 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.428+0000 7fcdcf7fe640 1 -- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd00ced50 msgr2=0x7fcdd00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.428+0000 7fcdcf7fe640 1 --2- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd00ced50 0x7fcdd00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.428+0000 7fcdcf7fe640 1 -- 172.21.15.1:0/3693772405 >> v1:172.21.15.167:6789/0 conn(0x7fcdd00d0050 legacy=0x7fcdd00b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.428+0000 7fcdcf7fe640 1 -- 172.21.15.1:0/3693772405 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00afe80 con 0x7fcdd015d7b0 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.428+0000 7fcdce7fc640 1 -- 172.21.15.1:0/3693772405 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713080455 0 0) 0x7fcdd00b04d0 con 0x7fcdd00d0050 2023-12-02T01:30:14.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.428+0000 7fcdcffff640 1 --2- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd00ced50 0x7fcdd00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdcf7fe640 1 --2- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd015d7b0 0x7fcdd00cfb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00097a0 tx=0x7fcdc002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6505e2a336d6ded server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdce7fc640 1 -- 172.21.15.1:0/3693772405 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0031830 con 0x7fcdd015d7b0 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdce7fc640 1 -- 172.21.15.1:0/3693772405 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc0031990 con 0x7fcdd015d7b0 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdce7fc640 1 -- 172.21.15.1:0/3693772405 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0031d20 con 0x7fcdd015d7b0 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 -- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd015d7b0 msgr2=0x7fcdd00cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd015d7b0 0x7fcdd00cfb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00097a0 tx=0x7fcdc002b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 -- 172.21.15.1:0/3693772405 shutdown_connections 2023-12-02T01:30:14.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd00ced50 0x7fcdd00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/3693772405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd015d7b0 0x7fcdd00cfb10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 -- 172.21.15.1:0/3693772405 >> 172.21.15.1:0/3693772405 conn(0x7fcdd009c480 msgr2=0x7fcdd00d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:14.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 -- 172.21.15.1:0/3693772405 shutdown_connections 2023-12-02T01:30:14.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.429+0000 7fcdd5b83640 1 -- 172.21.15.1:0/3693772405 wait complete. 2023-12-02T01:30:14.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.431+0000 7fcdd5b83640 1 Processor -- start 2023-12-02T01:30:14.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.431+0000 7fcdd5b83640 1 -- start start 2023-12-02T01:30:14.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.431+0000 7fcdd5b83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdd00ced50 0x7fcdd014f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.431+0000 7fcdd5b83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd00d0050 0x7fcdd00b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.431+0000 7fcdd5b83640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd015d7b0 0x7fcdd00b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.431+0000 7fcdd5b83640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00ca220 con 0x7fcdd00ced50 2023-12-02T01:30:14.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdd5b83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00b6a10 con 0x7fcdd00d0050 2023-12-02T01:30:14.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdd5b83640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00b6cf0 con 0x7fcdd015d7b0 2023-12-02T01:30:14.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdd00ced50 0x7fcdd014f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdd00ced50 0x7fcdd014f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54806/0 (socket says 172.21.15.1:54806) 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 -- 172.21.15.1:0/4141061010 learned_addr learned my addr 172.21.15.1:0/4141061010 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdceffd640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd00d0050 0x7fcdd00b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcffff640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd015d7b0 0x7fcdd00b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 -- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd015d7b0 msgr2=0x7fcdd00b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd015d7b0 0x7fcdd00b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 -- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd00d0050 msgr2=0x7fcdd00b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd00d0050 0x7fcdd00b7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 -- 172.21.15.1:0/4141061010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8009a70 con 0x7fcdd00ced50 2023-12-02T01:30:14.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcffff640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd015d7b0 0x7fcdd00b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:14.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdcf7fe640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdd00ced50 0x7fcdd014f520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0000c00 tx=0x7fcdc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdb7fff640 1 -- 172.21.15.1:0/4141061010 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0004230 con 0x7fcdd00ced50 2023-12-02T01:30:14.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdb7fff640 1 -- 172.21.15.1:0/4141061010 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc0004390 con 0x7fcdd00ced50 2023-12-02T01:30:14.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdb7fff640 1 -- 172.21.15.1:0/4141061010 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc003a860 con 0x7fcdd00ced50 2023-12-02T01:30:14.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc0009400 con 0x7fcdd00ced50 2023-12-02T01:30:14.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.432+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd00ca4e0 con 0x7fcdd00ced50 2023-12-02T01:30:14.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.434+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd00a1160 con 0x7fcdd00ced50 2023-12-02T01:30:14.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.434+0000 7fcdb7fff640 1 -- 172.21.15.1:0/4141061010 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdc003a9c0 con 0x7fcdd00ced50 2023-12-02T01:30:14.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.434+0000 7fcdb7fff640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcdbc06ae40 0x7fcdbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.434+0000 7fcdb7fff640 1 -- 172.21.15.1:0/4141061010 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdc00abe70 con 0x7fcdd00ced50 2023-12-02T01:30:14.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.434+0000 7fcdceffd640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcdbc06ae40 0x7fcdbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.435+0000 7fcdceffd640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcdbc06ae40 0x7fcdbc06d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcdd006ca40 tx=0x7fcdc4007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.439+0000 7fcdb7fff640 1 -- 172.21.15.1:0/4141061010 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcdc00770d0 con 0x7fcdd00ced50 2023-12-02T01:30:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.616+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdd015cbf0 con 0x7fcdd00ced50 2023-12-02T01:30:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.617+0000 7fcdb7fff640 1 -- 172.21.15.1:0/4141061010 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdc00350a0 con 0x7fcdd00ced50 2023-12-02T01:30:14.619 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcdbc06ae40 msgr2=0x7fcdbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcdbc06ae40 0x7fcdbc06d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcdd006ca40 tx=0x7fcdc4007b70 comp rx=0 tx=0).stop 2023-12-02T01:30:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdd00ced50 msgr2=0x7fcdd014f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdd00ced50 0x7fcdd014f520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0000c00 tx=0x7fcdc00046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 shutdown_connections 2023-12-02T01:30:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdd015d7b0 0x7fcdd00b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcdbc06ae40 0x7fcdbc06d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdd00d0050 0x7fcdd00b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 --2- 172.21.15.1:0/4141061010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdd00ced50 0x7fcdd014f520 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 >> 172.21.15.1:0/4141061010 conn(0x7fcdd009c480 msgr2=0x7fcdd015fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:14.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 shutdown_connections 2023-12-02T01:30:14.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.619+0000 7fcdd5b83640 1 -- 172.21.15.1:0/4141061010 wait complete. 2023-12-02T01:30:14.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:14.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.739+0000 7f463fe56640 1 Processor -- start 2023-12-02T01:30:14.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.740+0000 7f463fe56640 1 -- start start 2023-12-02T01:30:14.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.740+0000 7f463fe56640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46380b6b50 0x7f46380cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.740+0000 7f463fe56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f4638099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.740+0000 7f463fe56640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f46380cc390 0x7f46380cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.740+0000 7f463fe56640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46380b3590 con 0x7f46380cc390 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.740+0000 7f463fe56640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463806b310 con 0x7f46380b6b50 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.740+0000 7f463fe56640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463809a2d0 con 0x7f4638099970 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f46380cc390 0x7f46380cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f46380cc390 0x7f46380cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54812/0 (socket says 172.21.15.1:54812) 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 -- 172.21.15.1:0/2253624644 learned_addr learned my addr 172.21.15.1:0/2253624644 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463dbf2640 1 --2- 172.21.15.1:0/2253624644 >> v2:172.21.15.167:3300/0 conn(0x7f46380b6b50 0x7f46380cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463d3f1640 1 --2- 172.21.15.1:0/2253624644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f4638099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 -- 172.21.15.1:0/2253624644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 msgr2=0x7f4638099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 --2- 172.21.15.1:0/2253624644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f4638099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 -- 172.21.15.1:0/2253624644 >> v2:172.21.15.167:3300/0 conn(0x7f46380b6b50 msgr2=0x7f46380cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:14.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 --2- 172.21.15.1:0/2253624644 >> v2:172.21.15.167:3300/0 conn(0x7f46380b6b50 0x7f46380cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463e3f3640 1 -- 172.21.15.1:0/2253624644 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380b37c0 con 0x7f46380cc390 2023-12-02T01:30:14.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.741+0000 7f463dbf2640 1 --2- 172.21.15.1:0/2253624644 >> v2:172.21.15.167:3300/0 conn(0x7f46380b6b50 0x7f46380cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:14.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463e3f3640 1 --2- 172.21.15.1:0/2253624644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f46380cc840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4638071790 tx=0x7f462802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638626a76a904f9a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463cbf0640 1 -- 172.21.15.1:0/2253624644 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462802cb00 con 0x7f46380cc390 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463cbf0640 1 -- 172.21.15.1:0/2253624644 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462802cc60 con 0x7f46380cc390 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463cbf0640 1 -- 172.21.15.1:0/2253624644 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280343f0 con 0x7f46380cc390 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463fe56640 1 -- 172.21.15.1:0/2253624644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 msgr2=0x7f46380cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463fe56640 1 --2- 172.21.15.1:0/2253624644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f46380cc840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4638071790 tx=0x7f462802bf60 comp rx=0 tx=0).stop 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463fe56640 1 -- 172.21.15.1:0/2253624644 shutdown_connections 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463fe56640 1 --2- 172.21.15.1:0/2253624644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f46380cc840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463fe56640 1 --2- 172.21.15.1:0/2253624644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f4638099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463fe56640 1 --2- 172.21.15.1:0/2253624644 >> v2:172.21.15.167:3300/0 conn(0x7f46380b6b50 0x7f46380cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.742+0000 7f463fe56640 1 -- 172.21.15.1:0/2253624644 >> 172.21.15.1:0/2253624644 conn(0x7f46380b2a70 msgr2=0x7f46380b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.743+0000 7f463fe56640 1 -- 172.21.15.1:0/2253624644 shutdown_connections 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.743+0000 7f463fe56640 1 -- 172.21.15.1:0/2253624644 wait complete. 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.744+0000 7f463fe56640 1 Processor -- start 2023-12-02T01:30:14.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.744+0000 7f463fe56640 1 -- start start 2023-12-02T01:30:14.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.744+0000 7f463fe56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f463815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.744+0000 7f463fe56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46380b6b50 0x7f463815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.744+0000 7f463fe56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f463815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.744+0000 7f463fe56640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638147010 con 0x7f46380cc390 2023-12-02T01:30:14.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463fe56640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638146d30 con 0x7f46380b6b50 2023-12-02T01:30:14.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463fe56640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4638144130 con 0x7f4638099970 2023-12-02T01:30:14.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f463815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f463815bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54828/0 (socket says 172.21.15.1:54828) 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 -- 172.21.15.1:0/4084958914 learned_addr learned my addr 172.21.15.1:0/4084958914 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463d3f1640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46380b6b50 0x7f463815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463dbf2640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f463815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 -- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 msgr2=0x7f463815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f463815aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 -- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46380b6b50 msgr2=0x7f463815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46380b6b50 0x7f463815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 -- 172.21.15.1:0/4084958914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628009b30 con 0x7f46380cc390 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463d3f1640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46380b6b50 0x7f463815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463e3f3640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f463815bf90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4628009f40 tx=0x7f4628004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f46367fc640 1 -- 172.21.15.1:0/4084958914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628040670 con 0x7f46380cc390 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f46367fc640 1 -- 172.21.15.1:0/4084958914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46280407f0 con 0x7f46380cc390 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4638144410 con 0x7f46380cc390 2023-12-02T01:30:14.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f46367fc640 1 -- 172.21.15.1:0/4084958914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628040ba0 con 0x7f46380cc390 2023-12-02T01:30:14.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.745+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463815b020 con 0x7f46380cc390 2023-12-02T01:30:14.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.746+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4638144930 con 0x7f46380cc390 2023-12-02T01:30:14.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.747+0000 7f46367fc640 1 -- 172.21.15.1:0/4084958914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4628040d00 con 0x7f46380cc390 2023-12-02T01:30:14.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.747+0000 7f46367fc640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f462406ae40 0x7f462406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:14.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.747+0000 7f46367fc640 1 -- 172.21.15.1:0/4084958914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46280ac770 con 0x7f46380cc390 2023-12-02T01:30:14.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.747+0000 7f463dbf2640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f462406ae40 0x7f462406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:14.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.748+0000 7f463dbf2640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f462406ae40 0x7f462406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f463000d8b0 tx=0x7f4630008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:14.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.751+0000 7f46367fc640 1 -- 172.21.15.1:0/4084958914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4638144930 con 0x7f46380cc390 2023-12-02T01:30:14.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.927+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4638144930 con 0x7f46380cc390 2023-12-02T01:30:14.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.927+0000 7f46367fc640 1 -- 172.21.15.1:0/4084958914 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4638144930 con 0x7f46380cc390 2023-12-02T01:30:14.929 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:14.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f462406ae40 msgr2=0x7f462406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f462406ae40 0x7f462406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f463000d8b0 tx=0x7f4630008040 comp rx=0 tx=0).stop 2023-12-02T01:30:14.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 msgr2=0x7f463815bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:14.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f463815bf90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4628009f40 tx=0x7f4628004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:14.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 shutdown_connections 2023-12-02T01:30:14.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46380cc390 0x7f463815bf90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f462406ae40 0x7f462406d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46380b6b50 0x7f463815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 --2- 172.21.15.1:0/4084958914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4638099970 0x7f463815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:14.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 >> 172.21.15.1:0/4084958914 conn(0x7f46380b2a70 msgr2=0x7f46380d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:14.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 shutdown_connections 2023-12-02T01:30:14.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:14.929+0000 7f463fe56640 1 -- 172.21.15.1:0/4084958914 wait complete. 2023-12-02T01:30:14.942 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:15.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.050+0000 7fc2cefd0640 1 Processor -- start 2023-12-02T01:30:15.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.050+0000 7fc2cefd0640 1 -- start start 2023-12-02T01:30:15.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.050+0000 7fc2cefd0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc2c80d1570 0x7fc2c80b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.050+0000 7fc2cefd0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2c80cef00 0x7fc2c8161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.050+0000 7fc2cefd0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80ce360 con 0x7fc2c8160b70 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.050+0000 7fc2cefd0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c80d19f0 con 0x7fc2c80d1570 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.050+0000 7fc2cefd0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c80cdd50 con 0x7fc2c80cef00 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2c7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc2c80d1570 0x7fc2c80b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2c7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc2c80d1570 0x7fc2c80b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54844/0 (socket says 172.21.15.1:54844) 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2c7fff640 1 -- 172.21.15.1:0/1767249605 learned_addr learned my addr 172.21.15.1:0/1767249605 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2cd56d640 1 --2- 172.21.15.1:0/1767249605 >> v2:172.21.15.167:3300/0 conn(0x7fc2c80cef00 0x7fc2c8161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2c7fff640 1 -- 172.21.15.1:0/1767249605 >> v2:172.21.15.167:3300/0 conn(0x7fc2c80cef00 msgr2=0x7fc2c8161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2c7fff640 1 --2- 172.21.15.1:0/1767249605 >> v2:172.21.15.167:3300/0 conn(0x7fc2c80cef00 0x7fc2c8161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2c7fff640 1 -- 172.21.15.1:0/1767249605 >> v1:172.21.15.167:6789/0 conn(0x7fc2c8160b70 legacy=0x7fc2c80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:15.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.051+0000 7fc2c7fff640 1 -- 172.21.15.1:0/1767249605 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80d1c70 con 0x7fc2c80d1570 2023-12-02T01:30:15.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2c7fff640 1 --2- 172.21.15.1:0/1767249605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c80d1570 0x7fc2c80b2aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8072b40 tx=0x7fc2b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f63a85d722fc2f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2c77fe640 1 -- 172.21.15.1:0/1767249605 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4031870 con 0x7fc2c80d1570 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2c77fe640 1 -- 172.21.15.1:0/1767249605 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b40319d0 con 0x7fc2c80d1570 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2c77fe640 1 -- 172.21.15.1:0/1767249605 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4031d60 con 0x7fc2c80d1570 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1767249605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c80d1570 msgr2=0x7fc2c80b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1767249605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c80d1570 0x7fc2c80b2aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8072b40 tx=0x7fc2b402b910 comp rx=0 tx=0).stop 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1767249605 shutdown_connections 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1767249605 >> v2:172.21.15.167:3300/0 conn(0x7fc2c80cef00 0x7fc2c8161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1767249605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c80d1570 0x7fc2c80b2aa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1767249605 >> 172.21.15.1:0/1767249605 conn(0x7fc2c809c470 msgr2=0x7fc2c80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1767249605 shutdown_connections 2023-12-02T01:30:15.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.052+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1767249605 wait complete. 2023-12-02T01:30:15.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.053+0000 7fc2cefd0640 1 Processor -- start 2023-12-02T01:30:15.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cefd0640 1 -- start start 2023-12-02T01:30:15.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cefd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c80cef00 0x7fc2c8156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cefd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2c80d1570 0x7fc2c80ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cefd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c8160b70 0x7fc2c81589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cefd0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80cb8e0 con 0x7fc2c8160b70 2023-12-02T01:30:15.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cefd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80cac60 con 0x7fc2c80cef00 2023-12-02T01:30:15.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cefd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80caf40 con 0x7fc2c80d1570 2023-12-02T01:30:15.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.054+0000 7fc2cd56d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c8160b70 0x7fc2c81589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c8160b70 0x7fc2c81589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54854/0 (socket says 172.21.15.1:54854) 2023-12-02T01:30:15.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 -- 172.21.15.1:0/1971935964 learned_addr learned my addr 172.21.15.1:0/1971935964 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:15.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2c7fff640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2c80d1570 0x7fc2c80ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2ccd6c640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c80cef00 0x7fc2c8156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 -- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2c80d1570 msgr2=0x7fc2c80ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2c80d1570 0x7fc2c80ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 -- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c80cef00 msgr2=0x7fc2c8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c80cef00 0x7fc2c8156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 -- 172.21.15.1:0/1971935964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b40094d0 con 0x7fc2c8160b70 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cd56d640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c8160b70 0x7fc2c81589e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0007e60 tx=0x7fc2c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2c57fa640 1 -- 172.21.15.1:0/1971935964 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0014420 con 0x7fc2c8160b70 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2c57fa640 1 -- 172.21.15.1:0/1971935964 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c00145a0 con 0x7fc2c8160b70 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c80cb220 con 0x7fc2c8160b70 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2c57fa640 1 -- 172.21.15.1:0/1971935964 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0014950 con 0x7fc2c8160b70 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.055+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c8158490 con 0x7fc2c8160b70 2023-12-02T01:30:15.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.056+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c80cba20 con 0x7fc2c8160b70 2023-12-02T01:30:15.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.057+0000 7fc2c57fa640 1 -- 172.21.15.1:0/1971935964 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2c0014ab0 con 0x7fc2c8160b70 2023-12-02T01:30:15.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.057+0000 7fc2c57fa640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2ac06ae70 0x7fc2ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.057+0000 7fc2c57fa640 1 -- 172.21.15.1:0/1971935964 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2c0089e40 con 0x7fc2c8160b70 2023-12-02T01:30:15.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.057+0000 7fc2ccd6c640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2ac06ae70 0x7fc2ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.058+0000 7fc2ccd6c640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2ac06ae70 0x7fc2ac06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc004f60 tx=0x7fc2bc007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.067 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.061+0000 7fc2c57fa640 1 -- 172.21.15.1:0/1971935964 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2c80cba20 con 0x7fc2c8160b70 2023-12-02T01:30:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.238+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2c80cba20 con 0x7fc2c8160b70 2023-12-02T01:30:15.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.239+0000 7fc2c57fa640 1 -- 172.21.15.1:0/1971935964 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2c80cba20 con 0x7fc2c8160b70 2023-12-02T01:30:15.240 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2ac06ae70 msgr2=0x7fc2ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2ac06ae70 0x7fc2ac06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc004f60 tx=0x7fc2bc007e30 comp rx=0 tx=0).stop 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c8160b70 msgr2=0x7fc2c81589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c8160b70 0x7fc2c81589e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0007e60 tx=0x7fc2c000e4b0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 shutdown_connections 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2c8160b70 0x7fc2c81589e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2c80d1570 0x7fc2c80ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2ac06ae70 0x7fc2ac06d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 --2- 172.21.15.1:0/1971935964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2c80cef00 0x7fc2c8156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 >> 172.21.15.1:0/1971935964 conn(0x7fc2c809c470 msgr2=0x7fc2c815bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 shutdown_connections 2023-12-02T01:30:15.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.241+0000 7fc2cefd0640 1 -- 172.21.15.1:0/1971935964 wait complete. 2023-12-02T01:30:15.254 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:15.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.360+0000 7f670637c640 1 Processor -- start 2023-12-02T01:30:15.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.360+0000 7f670637c640 1 -- start start 2023-12-02T01:30:15.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f670637c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f67000d1980 0x7f67000cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f670637c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f670015d6c0 0x7f67000d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f670637c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67000d11d0 con 0x7f67000d1d60 2023-12-02T01:30:15.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f670637c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67000ce2b0 con 0x7f670015d6c0 2023-12-02T01:30:15.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f670637c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67000ce590 con 0x7f67000d1980 2023-12-02T01:30:15.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f6704919640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f670015d6c0 0x7f67000d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f6704919640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f670015d6c0 0x7f67000d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54868/0 (socket says 172.21.15.1:54868) 2023-12-02T01:30:15.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.361+0000 7f6704919640 1 -- 172.21.15.1:0/1153906268 learned_addr learned my addr 172.21.15.1:0/1153906268 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:15.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.362+0000 7f6704919640 1 -- 172.21.15.1:0/1153906268 >> v2:172.21.15.167:3300/0 conn(0x7f67000d1980 msgr2=0x7f67000cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:15.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.362+0000 7f6704919640 1 --2- 172.21.15.1:0/1153906268 >> v2:172.21.15.167:3300/0 conn(0x7f67000d1980 0x7f67000cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.362+0000 7f6704919640 1 -- 172.21.15.1:0/1153906268 >> v1:172.21.15.167:6789/0 conn(0x7f67000d1d60 legacy=0x7f670015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:15.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.362+0000 7f6704919640 1 -- 172.21.15.1:0/1153906268 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000ce870 con 0x7f670015d6c0 2023-12-02T01:30:15.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.362+0000 7f6704919640 1 --2- 172.21.15.1:0/1153906268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f670015d6c0 0x7f67000d3bd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67000b5d20 tx=0x7f66f802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b8114a40119f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f66feffd640 1 -- 172.21.15.1:0/1153906268 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f802c9f0 con 0x7f670015d6c0 2023-12-02T01:30:15.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f66feffd640 1 -- 172.21.15.1:0/1153906268 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f802cb50 con 0x7f670015d6c0 2023-12-02T01:30:15.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f66feffd640 1 -- 172.21.15.1:0/1153906268 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80343f0 con 0x7f670015d6c0 2023-12-02T01:30:15.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 -- 172.21.15.1:0/1153906268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f670015d6c0 msgr2=0x7f67000d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 --2- 172.21.15.1:0/1153906268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f670015d6c0 0x7f67000d3bd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67000b5d20 tx=0x7f66f802be50 comp rx=0 tx=0).stop 2023-12-02T01:30:15.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 -- 172.21.15.1:0/1153906268 shutdown_connections 2023-12-02T01:30:15.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 --2- 172.21.15.1:0/1153906268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f670015d6c0 0x7f67000d3bd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 --2- 172.21.15.1:0/1153906268 >> v2:172.21.15.167:3300/0 conn(0x7f67000d1980 0x7f67000cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 -- 172.21.15.1:0/1153906268 >> 172.21.15.1:0/1153906268 conn(0x7f670009c470 msgr2=0x7f67000d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:15.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 -- 172.21.15.1:0/1153906268 shutdown_connections 2023-12-02T01:30:15.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.363+0000 7f670637c640 1 -- 172.21.15.1:0/1153906268 wait complete. 2023-12-02T01:30:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.364+0000 7f670637c640 1 Processor -- start 2023-12-02T01:30:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f670637c640 1 -- start start 2023-12-02T01:30:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f670637c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67000d1980 0x7f67001f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f670637c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67000d1d60 0x7f670014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f670637c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f670015d6c0 0x7f6700156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f670637c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67001f7bb0 con 0x7f67000d1d60 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f670637c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67001f3b70 con 0x7f67000d1980 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f670637c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67001f3e50 con 0x7f670015d6c0 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f66ff7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67000d1d60 0x7f670014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f66ff7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67000d1d60 0x7f670014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54878/0 (socket says 172.21.15.1:54878) 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f66ff7fe640 1 -- 172.21.15.1:0/1271609189 learned_addr learned my addr 172.21.15.1:0/1271609189 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f6704919640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f670015d6c0 0x7f6700156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.365+0000 7f66fffff640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67000d1980 0x7f67001f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66ff7fe640 1 -- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f670015d6c0 msgr2=0x7f6700156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66ff7fe640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f670015d6c0 0x7f6700156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66ff7fe640 1 -- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67000d1980 msgr2=0x7f67001f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66ff7fe640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67000d1980 0x7f67001f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66ff7fe640 1 -- 172.21.15.1:0/1271609189 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8009b30 con 0x7f67000d1d60 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66ff7fe640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67000d1d60 0x7f670014f720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c410 tx=0x7f66e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66fcff9640 1 -- 172.21.15.1:0/1271609189 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80035f0 con 0x7f67000d1d60 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66fcff9640 1 -- 172.21.15.1:0/1271609189 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8003770 con 0x7f67000d1d60 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67001f4130 con 0x7f67000d1d60 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f66fcff9640 1 -- 172.21.15.1:0/1271609189 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8003b60 con 0x7f67000d1d60 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.366+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67001f46f0 con 0x7f67000d1d60 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.367+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67000a10e0 con 0x7f67000d1d60 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.367+0000 7f66fcff9640 1 -- 172.21.15.1:0/1271609189 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66e8003cc0 con 0x7f67000d1d60 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.368+0000 7f66fcff9640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f66e006ae40 0x7f66e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.368+0000 7f66fcff9640 1 -- 172.21.15.1:0/1271609189 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66e8088b70 con 0x7f67000d1d60 2023-12-02T01:30:15.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.368+0000 7f66fffff640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f66e006ae40 0x7f66e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.368+0000 7f66fffff640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f66e006ae40 0x7f66e006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009990 tx=0x7f66f0009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.372+0000 7f66fcff9640 1 -- 172.21.15.1:0/1271609189 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f66e8053cd0 con 0x7f67000d1d60 2023-12-02T01:30:15.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.564+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67000d39b0 con 0x7f67000d1d60 2023-12-02T01:30:15.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.565+0000 7f66fcff9640 1 -- 172.21.15.1:0/1271609189 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f66e8017020 con 0x7f67000d1d60 2023-12-02T01:30:15.566 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:15.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.566+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f66e006ae40 msgr2=0x7f66e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.566+0000 7f670637c640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f66e006ae40 0x7f66e006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009990 tx=0x7f66f0009110 comp rx=0 tx=0).stop 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.566+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67000d1d60 msgr2=0x7f670014f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.566+0000 7f670637c640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67000d1d60 0x7f670014f720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c410 tx=0x7f66e800c810 comp rx=0 tx=0).stop 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.566+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 shutdown_connections 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.566+0000 7f670637c640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f670015d6c0 0x7f6700156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.566+0000 7f670637c640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67000d1d60 0x7f670014f720 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.567+0000 7f670637c640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f66e006ae40 0x7f66e006d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.567+0000 7f670637c640 1 --2- 172.21.15.1:0/1271609189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67000d1980 0x7f67001f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.567+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 >> 172.21.15.1:0/1271609189 conn(0x7f670009c470 msgr2=0x7f67000cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.567+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 shutdown_connections 2023-12-02T01:30:15.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.567+0000 7f670637c640 1 -- 172.21.15.1:0/1271609189 wait complete. 2023-12-02T01:30:15.579 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:30:15.579 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:15.595 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:15.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.740+0000 7f0745a4f640 1 Processor -- start 2023-12-02T01:30:15.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.740+0000 7f0745a4f640 1 -- start start 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f0745a4f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07400b2ee0 0x7f0740071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f0745a4f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07400b3300 con 0x7f07401465d0 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f0745a4f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07400cf790 con 0x7f074006abe0 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f0745a4f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0740161d80 con 0x7f07400b2ee0 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f073f7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07400b2ee0 0x7f0740071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f073effd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f07401465d0 0x7f074006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45586/0 (socket says 172.21.15.1:45586) 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f073effd640 1 -- 172.21.15.1:0/717892102 learned_addr learned my addr 172.21.15.1:0/717892102 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f073f7fe640 1 -- 172.21.15.1:0/717892102 >> v1:172.21.15.167:6789/0 conn(0x7f074006abe0 legacy=0x7f07400cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f073f7fe640 1 -- 172.21.15.1:0/717892102 >> v1:172.21.15.1:6789/0 conn(0x7f07401465d0 legacy=0x7f074006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.741+0000 7f073f7fe640 1 -- 172.21.15.1:0/717892102 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07401614e0 con 0x7f07400b2ee0 2023-12-02T01:30:15.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.742+0000 7f073f7fe640 1 --2- 172.21.15.1:0/717892102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740071d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07380097a0 tx=0x7f073802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66010c1005af6c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.742+0000 7f073dffb640 1 -- 172.21.15.1:0/717892102 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738031830 con 0x7f07400b2ee0 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.742+0000 7f073dffb640 1 -- 172.21.15.1:0/717892102 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738031990 con 0x7f07400b2ee0 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.742+0000 7f073dffb640 1 -- 172.21.15.1:0/717892102 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738031d20 con 0x7f07400b2ee0 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.743+0000 7f0745a4f640 1 -- 172.21.15.1:0/717892102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 msgr2=0x7f0740071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.743+0000 7f0745a4f640 1 --2- 172.21.15.1:0/717892102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740071d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07380097a0 tx=0x7f073802b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.743+0000 7f0745a4f640 1 -- 172.21.15.1:0/717892102 shutdown_connections 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.743+0000 7f0745a4f640 1 --2- 172.21.15.1:0/717892102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740071d40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.743+0000 7f0745a4f640 1 -- 172.21.15.1:0/717892102 >> 172.21.15.1:0/717892102 conn(0x7f07400cc930 msgr2=0x7f07400ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.743+0000 7f0745a4f640 1 -- 172.21.15.1:0/717892102 shutdown_connections 2023-12-02T01:30:15.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.743+0000 7f0745a4f640 1 -- 172.21.15.1:0/717892102 wait complete. 2023-12-02T01:30:15.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.744+0000 7f0745a4f640 1 Processor -- start 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.744+0000 7f0745a4f640 1 -- start start 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f0745a4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f074006abe0 0x7f07400b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f0745a4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f0745a4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07401465d0 0x7f07400b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f0745a4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07400b06e0 con 0x7f07400b2ee0 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f0745a4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07400aef50 con 0x7f07401465d0 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f0745a4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07400b2220 con 0x7f074006abe0 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740137670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54902/0 (socket says 172.21.15.1:54902) 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 -- 172.21.15.1:0/3123526033 learned_addr learned my addr 172.21.15.1:0/3123526033 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073f7fe640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07401465d0 0x7f07400b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073effd640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f074006abe0 0x7f07400b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 -- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f074006abe0 msgr2=0x7f07400b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f074006abe0 0x7f07400b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 -- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07401465d0 msgr2=0x7f07400b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07401465d0 0x7f07400b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.745+0000 7f073e7fc640 1 -- 172.21.15.1:0/3123526033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738009400 con 0x7f07400b2ee0 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.746+0000 7f073e7fc640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740137670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f072800c460 tx=0x7f072800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.746+0000 7f0737fff640 1 -- 172.21.15.1:0/3123526033 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728012830 con 0x7f07400b2ee0 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.746+0000 7f0737fff640 1 -- 172.21.15.1:0/3123526033 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07280129d0 con 0x7f07400b2ee0 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.746+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07400b0060 con 0x7f07400b2ee0 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.746+0000 7f0737fff640 1 -- 172.21.15.1:0/3123526033 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728012d80 con 0x7f07400b2ee0 2023-12-02T01:30:15.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.746+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07400b0300 con 0x7f07400b2ee0 2023-12-02T01:30:15.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.747+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074006b250 con 0x7f07400b2ee0 2023-12-02T01:30:15.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.747+0000 7f0737fff640 1 -- 172.21.15.1:0/3123526033 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f072801a3b0 con 0x7f07400b2ee0 2023-12-02T01:30:15.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.748+0000 7f0737fff640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f072006ae40 0x7f072006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:15.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.748+0000 7f0737fff640 1 -- 172.21.15.1:0/3123526033 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07280892b0 con 0x7f07400b2ee0 2023-12-02T01:30:15.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.748+0000 7f073effd640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f072006ae40 0x7f072006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:15.751 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.748+0000 7f073effd640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f072006ae40 0x7f072006d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0730005c00 tx=0x7f0730009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:15.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.752+0000 7f0737fff640 1 -- 172.21.15.1:0/3123526033 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0728054350 con 0x7f07400b2ee0 2023-12-02T01:30:15.866 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:30:15.869 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:30:15.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.930+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0740067420 con 0x7f07400b2ee0 2023-12-02T01:30:15.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.931+0000 7f0737fff640 1 -- 172.21.15.1:0/3123526033 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f0728057970 con 0x7f07400b2ee0 2023-12-02T01:30:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:15.934 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:15.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.933+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f072006ae40 msgr2=0x7f072006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.933+0000 7f0745a4f640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f072006ae40 0x7f072006d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0730005c00 tx=0x7f0730009040 comp rx=0 tx=0).stop 2023-12-02T01:30:15.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.933+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 msgr2=0x7f0740137670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:15.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.933+0000 7f0745a4f640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740137670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f072800c460 tx=0x7f072800c920 comp rx=0 tx=0).stop 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 shutdown_connections 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f072006ae40 0x7f072006d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07401465d0 0x7f07400b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07400b2ee0 0x7f0740137670 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 --2- 172.21.15.1:0/3123526033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f074006abe0 0x7f07400b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 >> 172.21.15.1:0/3123526033 conn(0x7f07400cc930 msgr2=0x7f07400b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 shutdown_connections 2023-12-02T01:30:15.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:15.934+0000 7f0745a4f640 1 -- 172.21.15.1:0/3123526033 wait complete. 2023-12-02T01:30:15.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:15.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:16.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.094+0000 7f2c38c43640 1 Processor -- start 2023-12-02T01:30:16.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.094+0000 7f2c38c43640 1 -- start start 2023-12-02T01:30:16.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c38c43640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c340d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c38c43640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c340b2aa0 0x7f2c340ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c38c43640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2c340ced30 0x7f2c340cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c38c43640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c340ce360 con 0x7f2c340ced30 2023-12-02T01:30:16.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c38c43640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c340b2f20 con 0x7f2c340b2aa0 2023-12-02T01:30:16.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c38c43640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340cdd50 con 0x7f2c34160b70 2023-12-02T01:30:16.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c32d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2c340ced30 0x7f2c340cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c32d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2c340ced30 0x7f2c340cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54908/0 (socket says 172.21.15.1:54908) 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.095+0000 7f2c32d9d640 1 -- 172.21.15.1:0/1446835262 learned_addr learned my addr 172.21.15.1:0/1446835262 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c31d9b640 1 --2- 172.21.15.1:0/1446835262 >> v2:172.21.15.167:3300/0 conn(0x7f2c340b2aa0 0x7f2c340ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c3259c640 1 --2- 172.21.15.1:0/1446835262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c340d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c32d9d640 1 -- 172.21.15.1:0/1446835262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 msgr2=0x7f2c340d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c32d9d640 1 --2- 172.21.15.1:0/1446835262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c340d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c32d9d640 1 -- 172.21.15.1:0/1446835262 >> v2:172.21.15.167:3300/0 conn(0x7f2c340b2aa0 msgr2=0x7f2c340ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c32d9d640 1 --2- 172.21.15.1:0/1446835262 >> v2:172.21.15.167:3300/0 conn(0x7f2c340b2aa0 0x7f2c340ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c32d9d640 1 -- 172.21.15.1:0/1446835262 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340d1c70 con 0x7f2c340ced30 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c3259c640 1 --2- 172.21.15.1:0/1446835262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c340d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.096+0000 7f2c32d9d640 1 --2- 172.21.15.1:0/1446835262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c340cfb50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2c3408b550 tx=0x7f2c2c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5a1141d2e0927f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c3159a640 1 -- 172.21.15.1:0/1446835262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c02ca70 con 0x7f2c340ced30 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c3159a640 1 -- 172.21.15.1:0/1446835262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c02cbd0 con 0x7f2c340ced30 2023-12-02T01:30:16.099 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c3159a640 1 -- 172.21.15.1:0/1446835262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0343f0 con 0x7f2c340ced30 2023-12-02T01:30:16.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 -- 172.21.15.1:0/1446835262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 msgr2=0x7f2c340cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 --2- 172.21.15.1:0/1446835262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c340cfb50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2c3408b550 tx=0x7f2c2c02bed0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 -- 172.21.15.1:0/1446835262 shutdown_connections 2023-12-02T01:30:16.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 --2- 172.21.15.1:0/1446835262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c340cfb50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 --2- 172.21.15.1:0/1446835262 >> v2:172.21.15.167:3300/0 conn(0x7f2c340b2aa0 0x7f2c340ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 --2- 172.21.15.1:0/1446835262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c340d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.103 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 -- 172.21.15.1:0/1446835262 >> 172.21.15.1:0/1446835262 conn(0x7f2c3409c470 msgr2=0x7f2c340d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:16.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 -- 172.21.15.1:0/1446835262 shutdown_connections 2023-12-02T01:30:16.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.097+0000 7f2c38c43640 1 -- 172.21.15.1:0/1446835262 wait complete. 2023-12-02T01:30:16.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 Processor -- start 2023-12-02T01:30:16.104 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 -- start start 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c340b2aa0 0x7f2c34146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c3415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c3415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340b6d40 con 0x7f2c340ced30 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340b6f90 con 0x7f2c340b2aa0 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c38c43640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c340b7270 con 0x7f2c34160b70 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c31d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c3415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.105 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c31d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c3415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54920/0 (socket says 172.21.15.1:54920) 2023-12-02T01:30:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.099+0000 7f2c31d9b640 1 -- 172.21.15.1:0/3759367894 learned_addr learned my addr 172.21.15.1:0/3759367894 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c31d9b640 1 -- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 msgr2=0x7f2c3415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c31d9b640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c3415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c31d9b640 1 -- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c340b2aa0 msgr2=0x7f2c34146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c3259c640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c340b2aa0 0x7f2c34146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c31d9b640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c340b2aa0 0x7f2c34146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.106 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c31d9b640 1 -- 172.21.15.1:0/3759367894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c009b30 con 0x7f2c340ced30 2023-12-02T01:30:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c3259c640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c340b2aa0 0x7f2c34146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c31d9b640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c3415cce0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800d800 tx=0x7f2c2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c22ffd640 1 -- 172.21.15.1:0/3759367894 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280096a0 con 0x7f2c340ced30 2023-12-02T01:30:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c22ffd640 1 -- 172.21.15.1:0/3759367894 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c28009800 con 0x7f2c340ced30 2023-12-02T01:30:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c340b7550 con 0x7f2c340ced30 2023-12-02T01:30:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c22ffd640 1 -- 172.21.15.1:0/3759367894 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28009b90 con 0x7f2c340ced30 2023-12-02T01:30:16.107 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.100+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c34146dd0 con 0x7f2c340ced30 2023-12-02T01:30:16.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.101+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c34146f90 con 0x7f2c340ced30 2023-12-02T01:30:16.108 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.101+0000 7f2c22ffd640 1 -- 172.21.15.1:0/3759367894 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c28009cf0 con 0x7f2c340ced30 2023-12-02T01:30:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.102+0000 7f2c22ffd640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1406ae40 0x7f2c1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.109 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.102+0000 7f2c22ffd640 1 -- 172.21.15.1:0/3759367894 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c28089d30 con 0x7f2c340ced30 2023-12-02T01:30:16.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.102+0000 7f2c3259c640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1406ae40 0x7f2c1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.102+0000 7f2c3259c640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1406ae40 0x7f2c1406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c24006fd0 tx=0x7f2c24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.110 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.106+0000 7f2c22ffd640 1 -- 172.21.15.1:0/3759367894 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c28054e70 con 0x7f2c340ced30 2023-12-02T01:30:16.284 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.283+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c340a1150 con 0x7f2c340ced30 2023-12-02T01:30:16.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.283+0000 7f2c22ffd640 1 -- 172.21.15.1:0/3759367894 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c2800b440 con 0x7f2c340ced30 2023-12-02T01:30:16.285 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.285+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1406ae40 msgr2=0x7f2c1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1406ae40 0x7f2c1406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c24006fd0 tx=0x7f2c24008040 comp rx=0 tx=0).stop 2023-12-02T01:30:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 msgr2=0x7f2c3415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c3415cce0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800d800 tx=0x7f2c2800dcc0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 shutdown_connections 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c34160b70 0x7f2c3415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c340ced30 0x7f2c3415cce0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1406ae40 0x7f2c1406d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 --2- 172.21.15.1:0/3759367894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c340b2aa0 0x7f2c34146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 >> 172.21.15.1:0/3759367894 conn(0x7f2c3409c470 msgr2=0x7f2c340d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 shutdown_connections 2023-12-02T01:30:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.286+0000 7f2c38c43640 1 -- 172.21.15.1:0/3759367894 wait complete. 2023-12-02T01:30:16.298 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:16.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.407+0000 7f2c29fd7640 1 Processor -- start 2023-12-02T01:30:16.409 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.407+0000 7f2c29fd7640 1 -- start start 2023-12-02T01:30:16.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c29fd7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c2415d6c0 0x7f2c240cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.411 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c29fd7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 0x7f2c240d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c29fd7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c240d11d0 con 0x7f2c240d1980 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c29fd7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c240ce2b0 con 0x7f2c2415d6c0 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c29fd7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240ce590 con 0x7f2c240d1d60 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c237fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2c240d1980 0x7f2c2415cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45590/0 (socket says 172.21.15.1:45590) 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c237fe640 1 -- 172.21.15.1:0/3133138089 learned_addr learned my addr 172.21.15.1:0/3133138089 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c23fff640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 0x7f2c240d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c22ffd640 1 --2- 172.21.15.1:0/3133138089 >> v2:172.21.15.167:3300/0 conn(0x7f2c2415d6c0 0x7f2c240cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093374303 0 0) 0x7f2c240d11d0 con 0x7f2c240d1980 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.408+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c003520 con 0x7f2c240d1980 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757291821 0 0) 0x7f2c0c003520 con 0x7f2c240d1980 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 msgr2=0x7f2c240d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 0x7f2c240d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.412 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 >> v2:172.21.15.167:3300/0 conn(0x7f2c2415d6c0 msgr2=0x7f2c240cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 --2- 172.21.15.1:0/3133138089 >> v2:172.21.15.167:3300/0 conn(0x7f2c2415d6c0 0x7f2c240cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240ce870 con 0x7f2c240d1980 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f2c14001670 con 0x7f2c240d1980 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 >> v1:172.21.15.1:6789/0 conn(0x7f2c240d1980 legacy=0x7f2c2415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 0x7f2c0c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c003ef0 0x7f2c0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c0c004d00 0x7f2c0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240ce2b0 con 0x7f2c0c004d00 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240ce590 con 0x7f2c0c003ef0 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00b9d0 con 0x7f2c240d1d60 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c23fff640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c0c004d00 0x7f2c0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c237fe640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 0x7f2c0c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c22ffd640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c003ef0 0x7f2c0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.413 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c23fff640 1 -- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 msgr2=0x7f2c0c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c23fff640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240d1d60 0x7f2c0c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c23fff640 1 -- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c003ef0 msgr2=0x7f2c0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c23fff640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c003ef0 0x7f2c0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.409+0000 7f2c23fff640 1 -- 172.21.15.1:0/3133138089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c003520 con 0x7f2c0c004d00 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.410+0000 7f2c23fff640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c0c004d00 0x7f2c0c005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00e170 tx=0x7f2c0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4b8c70acb7ed82 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.410+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c02cbf0 con 0x7f2c0c004d00 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.410+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c00f040 con 0x7f2c0c004d00 2023-12-02T01:30:16.414 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.410+0000 7f2c227fc640 1 -- 172.21.15.1:0/3133138089 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c034440 con 0x7f2c0c004d00 2023-12-02T01:30:16.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.410+0000 7f2c29fd7640 1 -- 172.21.15.1:0/3133138089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c0c004d00 msgr2=0x7f2c0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.410+0000 7f2c29fd7640 1 --2- 172.21.15.1:0/3133138089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c0c004d00 0x7f2c0c005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00e170 tx=0x7f2c0c0057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.411+0000 7f2c23fff640 1 -- 172.21.15.1:0/3133138089 reap_dead start 2023-12-02T01:30:16.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.411+0000 7f2c29fd7640 1 -- 172.21.15.1:0/3133138089 shutdown_connections 2023-12-02T01:30:16.417 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.411+0000 7f2c29fd7640 1 -- 172.21.15.1:0/3133138089 >> 172.21.15.1:0/3133138089 conn(0x7f2c2409c470 msgr2=0x7f2c240d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.411+0000 7f2c29fd7640 1 -- 172.21.15.1:0/3133138089 shutdown_connections 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.411+0000 7f2c29fd7640 1 -- 172.21.15.1:0/3133138089 wait complete. 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.412+0000 7f2c29fd7640 1 Processor -- start 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.412+0000 7f2c29fd7640 1 -- start start 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c29fd7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c24154870 0x7f2c240c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c29fd7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c24154c50 0x7f2c240cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c29fd7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c240c8ca0 0x7f2c240cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c29fd7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24157300 con 0x7f2c240c8ca0 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c29fd7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241f79c0 con 0x7f2c24154c50 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c29fd7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241f6c00 con 0x7f2c24154870 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c240c8ca0 0x7f2c240cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.418 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c240c8ca0 0x7f2c240cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54934/0 (socket says 172.21.15.1:54934) 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 -- 172.21.15.1:0/1999604570 learned_addr learned my addr 172.21.15.1:0/1999604570 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c22ffd640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c24154c50 0x7f2c240cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c237fe640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c24154870 0x7f2c240c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 -- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c24154870 msgr2=0x7f2c240c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c24154870 0x7f2c240c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 -- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c24154c50 msgr2=0x7f2c240cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c24154c50 0x7f2c240cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 -- 172.21.15.1:0/1999604570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c241f6ee0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c22ffd640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c24154c50 0x7f2c240cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c23fff640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c240c8ca0 0x7f2c240cce40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00e170 tx=0x7f2c1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.413+0000 7f2c0bfff640 1 -- 172.21.15.1:0/1999604570 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c034cd0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.414+0000 7f2c0bfff640 1 -- 172.21.15.1:0/1999604570 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c02ce90 con 0x7f2c240c8ca0 2023-12-02T01:30:16.419 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.414+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c241f71c0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.414+0000 7f2c0bfff640 1 -- 172.21.15.1:0/1999604570 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c003bd0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.414+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c240c9810 con 0x7f2c240c8ca0 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.415+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c241f76e0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.415+0000 7f2c0bfff640 1 -- 172.21.15.1:0/1999604570 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c1c003d30 con 0x7f2c240c8ca0 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.416+0000 7f2c0bfff640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1006ae70 0x7f2c1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.416+0000 7f2c237fe640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1006ae70 0x7f2c1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.416+0000 7f2c0bfff640 1 -- 172.21.15.1:0/1999604570 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c1c0aadc0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.416+0000 7f2c237fe640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1006ae70 0x7f2c1006d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c14004840 tx=0x7f2c14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.420+0000 7f2c0bfff640 1 -- 172.21.15.1:0/1999604570 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c241f76e0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.599+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c241f76e0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.601 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.600+0000 7f2c0bfff640 1 -- 172.21.15.1:0/1999604570 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c241f76e0 con 0x7f2c240c8ca0 2023-12-02T01:30:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:16.603 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.601+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1006ae70 msgr2=0x7f2c1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.601+0000 7f2c29fd7640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1006ae70 0x7f2c1006d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c14004840 tx=0x7f2c14009040 comp rx=0 tx=0).stop 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c240c8ca0 msgr2=0x7f2c240cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c240c8ca0 0x7f2c240cce40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00e170 tx=0x7f2c1c009750 comp rx=0 tx=0).stop 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 shutdown_connections 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c240c8ca0 0x7f2c240cce40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2c1006ae70 0x7f2c1006d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c24154c50 0x7f2c240cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 --2- 172.21.15.1:0/1999604570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c24154870 0x7f2c240c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 >> 172.21.15.1:0/1999604570 conn(0x7f2c2409c470 msgr2=0x7f2c240afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 shutdown_connections 2023-12-02T01:30:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.602+0000 7f2c29fd7640 1 -- 172.21.15.1:0/1999604570 wait complete. 2023-12-02T01:30:16.613 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:16.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.721+0000 7f482321c640 1 Processor -- start 2023-12-02T01:30:16.723 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.721+0000 7f482321c640 1 -- start start 2023-12-02T01:30:16.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f482321c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f481c13f750 0x7f481c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f482321c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13fb30 0x7f481c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f482321c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f481c15db40 0x7f481c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f482321c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c0cec70 con 0x7f481c13f750 2023-12-02T01:30:16.724 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f482321c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c0ce060 con 0x7f481c15db40 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f482321c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0ce340 con 0x7f481c13fb30 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f481c13f750 0x7f481c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f481c13f750 0x7f481c15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54938/0 (socket says 172.21.15.1:54938) 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 -- 172.21.15.1:0/2747058996 learned_addr learned my addr 172.21.15.1:0/2747058996 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 -- 172.21.15.1:0/2747058996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13fb30 msgr2=0x7f481c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 --2- 172.21.15.1:0/2747058996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13fb30 0x7f481c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 -- 172.21.15.1:0/2747058996 >> v2:172.21.15.167:3300/0 conn(0x7f481c15db40 msgr2=0x7f481c15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 --2- 172.21.15.1:0/2747058996 >> v2:172.21.15.167:3300/0 conn(0x7f481c15db40 0x7f481c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.725 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.722+0000 7f4820fb8640 1 -- 172.21.15.1:0/2747058996 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0ce620 con 0x7f481c13f750 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.723+0000 7f4820fb8640 1 --2- 172.21.15.1:0/2747058996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13f750 0x7f481c15b0d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f481c0723b0 tx=0x7f481402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6418eb2bafca77a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.723+0000 7f481b7fe640 1 -- 172.21.15.1:0/2747058996 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481402ec80 con 0x7f481c13f750 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.723+0000 7f481b7fe640 1 -- 172.21.15.1:0/2747058996 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481402ede0 con 0x7f481c13f750 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.723+0000 7f481b7fe640 1 -- 172.21.15.1:0/2747058996 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814036610 con 0x7f481c13f750 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 -- 172.21.15.1:0/2747058996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13f750 msgr2=0x7f481c15b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 --2- 172.21.15.1:0/2747058996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13f750 0x7f481c15b0d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f481c0723b0 tx=0x7f481402e0e0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 -- 172.21.15.1:0/2747058996 shutdown_connections 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 --2- 172.21.15.1:0/2747058996 >> v2:172.21.15.167:3300/0 conn(0x7f481c15db40 0x7f481c15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 --2- 172.21.15.1:0/2747058996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13fb30 0x7f481c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 --2- 172.21.15.1:0/2747058996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13f750 0x7f481c15b0d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.727 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 -- 172.21.15.1:0/2747058996 >> 172.21.15.1:0/2747058996 conn(0x7f481c06a8f0 msgr2=0x7f481c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:16.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 -- 172.21.15.1:0/2747058996 shutdown_connections 2023-12-02T01:30:16.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.724+0000 7f482321c640 1 -- 172.21.15.1:0/2747058996 wait complete. 2023-12-02T01:30:16.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.725+0000 7f482321c640 1 Processor -- start 2023-12-02T01:30:16.728 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.725+0000 7f482321c640 1 -- start start 2023-12-02T01:30:16.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f482321c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13f750 0x7f481c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f482321c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13fb30 0x7f481c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f482321c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c15db40 0x7f481c0b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f482321c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c15a980 con 0x7f481c13fb30 2023-12-02T01:30:16.730 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f482321c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c15ac60 con 0x7f481c15db40 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f482321c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0aec50 con 0x7f481c13f750 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13fb30 0x7f481c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13fb30 0x7f481c0b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54948/0 (socket says 172.21.15.1:54948) 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 -- 172.21.15.1:0/1061991938 learned_addr learned my addr 172.21.15.1:0/1061991938 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f4820fb8640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13f750 0x7f481c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f48217b9640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c15db40 0x7f481c0b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 -- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13f750 msgr2=0x7f481c15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13f750 0x7f481c15d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 -- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c15db40 msgr2=0x7f481c0b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c15db40 0x7f481c0b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.726+0000 7f481bfff640 1 -- 172.21.15.1:0/1061991938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4814009b30 con 0x7f481c13fb30 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.727+0000 7f481bfff640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13fb30 0x7f481c0b13a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f481000b410 tx=0x7f481000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.731 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.727+0000 7f48197fa640 1 -- 172.21.15.1:0/1061991938 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810011830 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.727+0000 7f48197fa640 1 -- 172.21.15.1:0/1061991938 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48100119b0 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.727+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c0aef30 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.727+0000 7f48197fa640 1 -- 172.21.15.1:0/1061991938 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810011d60 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.727+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c152900 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.728+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c0af120 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.728+0000 7f48197fa640 1 -- 172.21.15.1:0/1061991938 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f481001a400 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.729+0000 7f48197fa640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.729+0000 7f48197fa640 1 -- 172.21.15.1:0/1061991938 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48100897b0 con 0x7f481c13fb30 2023-12-02T01:30:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.729+0000 7f4820fb8640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:16.733 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.729+0000 7f4820fb8640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4814037000 tx=0x7f4814032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:16.734 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.733+0000 7f48197fa640 1 -- 172.21.15.1:0/1061991938 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4810054860 con 0x7f481c13fb30 2023-12-02T01:30:16.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.909+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f481c072ae0 con 0x7f481c13fb30 2023-12-02T01:30:16.912 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.910+0000 7f48197fa640 1 -- 172.21.15.1:0/1061991938 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48100150a0 con 0x7f481c13fb30 2023-12-02T01:30:16.912 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:16.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.911+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 msgr2=0x7f480806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.911+0000 7f482321c640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4814037000 tx=0x7f4814032000 comp rx=0 tx=0).stop 2023-12-02T01:30:16.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13fb30 msgr2=0x7f481c0b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:16.913 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13fb30 0x7f481c0b13a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f481000b410 tx=0x7f481000b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 shutdown_connections 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f480806ae40 0x7f480806d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c15db40 0x7f481c0b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f481c13fb30 0x7f481c0b13a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 --2- 172.21.15.1:0/1061991938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c13f750 0x7f481c15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 >> 172.21.15.1:0/1061991938 conn(0x7f481c06a8f0 msgr2=0x7f481c13ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 shutdown_connections 2023-12-02T01:30:16.914 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:16.912+0000 7f482321c640 1 -- 172.21.15.1:0/1061991938 wait complete. 2023-12-02T01:30:16.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:17.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.030+0000 7fd6e03b6640 1 Processor -- start 2023-12-02T01:30:17.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.030+0000 7fd6e03b6640 1 -- start start 2023-12-02T01:30:17.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6e03b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 0x7fd6d8071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6e03b6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80b3300 con 0x7fd6d806abe0 2023-12-02T01:30:17.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6e03b6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80cf790 con 0x7fd6d81465d0 2023-12-02T01:30:17.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6e03b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8161d80 con 0x7fd6d80b2ee0 2023-12-02T01:30:17.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd951640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd6d806abe0 0x7fd6d80cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45596/0 (socket says 172.21.15.1:45596) 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd951640 1 -- 172.21.15.1:0/1303905223 learned_addr learned my addr 172.21.15.1:0/1303905223 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6de953640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 0x7fd6d8071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901046129 0 0) 0x7fd6d80b3300 con 0x7fd6d806abe0 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c4003520 con 0x7fd6d806abe0 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 506195530 0 0) 0x7fd6c4003520 con 0x7fd6d806abe0 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 msgr2=0x7fd6d8071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 0x7fd6d8071d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 >> v1:172.21.15.167:6789/0 conn(0x7fd6d81465d0 legacy=0x7fd6d806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d81614e0 con 0x7fd6d806abe0 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fd6c8001670 con 0x7fd6d806abe0 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 >> v1:172.21.15.1:6789/0 conn(0x7fd6d806abe0 legacy=0x7fd6d80cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6c40039a0 0x7fd6c4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6c4004350 0x7fd6c4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 0x7fd6c4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.031+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8161d80 con 0x7fd6c40039a0 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c400b9b0 con 0x7fd6c4004350 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c400bb70 con 0x7fd6d80b2ee0 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6de152640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6c40039a0 0x7fd6c4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6dd951640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6c4004350 0x7fd6c4004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6de953640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 0x7fd6c4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6de152640 1 -- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 msgr2=0x7fd6c4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6de152640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d80b2ee0 0x7fd6c4005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6de152640 1 -- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6c4004350 msgr2=0x7fd6c4004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:17.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6de152640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6c4004350 0x7fd6c4004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.032+0000 7fd6de152640 1 -- 172.21.15.1:0/1303905223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4003520 con 0x7fd6c40039a0 2023-12-02T01:30:17.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6de152640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6c40039a0 0x7fd6c4003d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4001860 tx=0x7fd6c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7804c5492290d86 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4033630 con 0x7fd6c40039a0 2023-12-02T01:30:17.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d40337b0 con 0x7fd6c40039a0 2023-12-02T01:30:17.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6dd150640 1 -- 172.21.15.1:0/1303905223 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4033b60 con 0x7fd6c40039a0 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6e03b6640 1 -- 172.21.15.1:0/1303905223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6c40039a0 msgr2=0x7fd6c4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6e03b6640 1 --2- 172.21.15.1:0/1303905223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6c40039a0 0x7fd6c4003d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4001860 tx=0x7fd6c40057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6de953640 1 -- 172.21.15.1:0/1303905223 reap_dead start 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6e03b6640 1 -- 172.21.15.1:0/1303905223 shutdown_connections 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6e03b6640 1 -- 172.21.15.1:0/1303905223 >> 172.21.15.1:0/1303905223 conn(0x7fd6d80cc930 msgr2=0x7fd6d80ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6e03b6640 1 -- 172.21.15.1:0/1303905223 shutdown_connections 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.033+0000 7fd6e03b6640 1 -- 172.21.15.1:0/1303905223 wait complete. 2023-12-02T01:30:17.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.034+0000 7fd6e03b6640 1 Processor -- start 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6e03b6640 1 -- start start 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6e03b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6c40039a0 0x7fd6d80c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6e03b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d80c4e50 0x7fd6d8144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6e03b6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d80c8650 0x7fd6d81606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6e03b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80c5fd0 con 0x7fd6d80c4e50 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6e03b6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80c69a0 con 0x7fd6d80c8650 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6e03b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80c53c0 con 0x7fd6c40039a0 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6dd951640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d80c4e50 0x7fd6d8144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6dd951640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d80c4e50 0x7fd6d8144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54962/0 (socket says 172.21.15.1:54962) 2023-12-02T01:30:17.042 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.035+0000 7fd6dd951640 1 -- 172.21.15.1:0/3394416661 learned_addr learned my addr 172.21.15.1:0/3394416661 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6de953640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d80c8650 0x7fd6d81606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6de152640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6c40039a0 0x7fd6d80c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6dd951640 1 -- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6c40039a0 msgr2=0x7fd6d80c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6dd951640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6c40039a0 0x7fd6d80c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6dd951640 1 -- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d80c8650 msgr2=0x7fd6d81606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6dd951640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d80c8650 0x7fd6d81606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6dd951640 1 -- 172.21.15.1:0/3394416661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80c56a0 con 0x7fd6d80c4e50 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6de152640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6c40039a0 0x7fd6d80c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6dd951640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d80c4e50 0x7fd6d8144720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8001200 tx=0x7fd6c800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6ceffd640 1 -- 172.21.15.1:0/3394416661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800ee00 con 0x7fd6d80c4e50 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6ceffd640 1 -- 172.21.15.1:0/3394416661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c800c8d0 con 0x7fd6d80c4e50 2023-12-02T01:30:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80c5980 con 0x7fd6d80c4e50 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6ceffd640 1 -- 172.21.15.1:0/3394416661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800cc80 con 0x7fd6d80c4e50 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.036+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d8144c60 con 0x7fd6d80c4e50 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.037+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80c6180 con 0x7fd6d80c4e50 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.037+0000 7fd6ceffd640 1 -- 172.21.15.1:0/3394416661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6c801d460 con 0x7fd6d80c4e50 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.038+0000 7fd6ceffd640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.038+0000 7fd6ceffd640 1 -- 172.21.15.1:0/3394416661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6c8089400 con 0x7fd6d80c4e50 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.038+0000 7fd6de152640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.038+0000 7fd6de152640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd6bc06ae70 0x7fd6bc06d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4036000 tx=0x7fd6d4031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.042+0000 7fd6ceffd640 1 -- 172.21.15.1:0/3394416661 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6d80c6180 con 0x7fd6d80c4e50 2023-12-02T01:30:17.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.230+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6d8071cc0 con 0x7fd6d80c4e50 2023-12-02T01:30:17.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.230+0000 7fd6ceffd640 1 -- 172.21.15.1:0/3394416661 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6c8057fd0 con 0x7fd6d80c4e50 2023-12-02T01:30:17.232 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:17.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd6bc06ae70 msgr2=0x7fd6bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd6bc06ae70 0x7fd6bc06d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4036000 tx=0x7fd6d4031000 comp rx=0 tx=0).stop 2023-12-02T01:30:17.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d80c4e50 msgr2=0x7fd6d8144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d80c4e50 0x7fd6d8144720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8001200 tx=0x7fd6c800ec10 comp rx=0 tx=0).stop 2023-12-02T01:30:17.234 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 shutdown_connections 2023-12-02T01:30:17.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d80c8650 0x7fd6d81606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6d80c4e50 0x7fd6d8144720 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 --2- 172.21.15.1:0/3394416661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6c40039a0 0x7fd6d80c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 >> 172.21.15.1:0/3394416661 conn(0x7fd6d80cc930 msgr2=0x7fd6d80ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:17.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 shutdown_connections 2023-12-02T01:30:17.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.232+0000 7fd6e03b6640 1 -- 172.21.15.1:0/3394416661 wait complete. 2023-12-02T01:30:17.244 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi001.front.sepia.ceph.com... 2023-12-02T01:30:17.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:17.245 DEBUG:teuthology.orchestra.run.smithi001:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:17.276 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:17.276 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:30:17.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:17.277 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-02T01:30:17.341 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:30:17.341 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:17.361 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:30:17.361 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:17.420 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:17.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.525+0000 7f6f1637d640 1 Processor -- start 2023-12-02T01:30:17.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.525+0000 7f6f1637d640 1 -- start start 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1637d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f100b4810 0x7f6f1015b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1637d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6f1015bd90 0x7f6f100cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1637d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1006de80 con 0x7f6f1013e2d0 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1637d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1015fc60 con 0x7f6f1015bd90 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1637d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1006d5c0 con 0x7f6f100b4810 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1491a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6f1015bd90 0x7f6f100cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f0ffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6f1013e2d0 0x7f6f100b4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45608/0 (socket says 172.21.15.1:45608) 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f0ffff640 1 -- 172.21.15.1:0/406119863 learned_addr learned my addr 172.21.15.1:0/406119863 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1491a640 1 -- 172.21.15.1:0/406119863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f100b4810 msgr2=0x7f6f1015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f0f7fe640 1 --2- 172.21.15.1:0/406119863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f100b4810 0x7f6f1015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1491a640 1 --2- 172.21.15.1:0/406119863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f100b4810 0x7f6f1015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f0effd640 1 -- 172.21.15.1:0/406119863 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641565992 0 0) 0x7f6f1006de80 con 0x7f6f1013e2d0 2023-12-02T01:30:17.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1491a640 1 -- 172.21.15.1:0/406119863 >> v1:172.21.15.1:6789/0 conn(0x7f6f1013e2d0 legacy=0x7f6f100b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f1491a640 1 -- 172.21.15.1:0/406119863 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1006d830 con 0x7f6f1015bd90 2023-12-02T01:30:17.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.526+0000 7f6f0f7fe640 1 --2- 172.21.15.1:0/406119863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f100b4810 0x7f6f1015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.527+0000 7f6f1491a640 1 --2- 172.21.15.1:0/406119863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1015bd90 0x7f6f100cd810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009d90 tx=0x7f6f0802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc53cce4721589a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.527+0000 7f6f0effd640 1 -- 172.21.15.1:0/406119863 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0802cc50 con 0x7f6f1015bd90 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.527+0000 7f6f0effd640 1 -- 172.21.15.1:0/406119863 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0802cdb0 con 0x7f6f1015bd90 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.527+0000 7f6f0effd640 1 -- 172.21.15.1:0/406119863 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08034660 con 0x7f6f1015bd90 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 -- 172.21.15.1:0/406119863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1015bd90 msgr2=0x7f6f100cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 --2- 172.21.15.1:0/406119863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1015bd90 0x7f6f100cd810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009d90 tx=0x7f6f0802bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 -- 172.21.15.1:0/406119863 shutdown_connections 2023-12-02T01:30:17.530 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 --2- 172.21.15.1:0/406119863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f100b4810 0x7f6f1015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 --2- 172.21.15.1:0/406119863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f1015bd90 0x7f6f100cd810 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 -- 172.21.15.1:0/406119863 >> 172.21.15.1:0/406119863 conn(0x7f6f100b0af0 msgr2=0x7f6f100b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:17.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 -- 172.21.15.1:0/406119863 shutdown_connections 2023-12-02T01:30:17.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.528+0000 7f6f1637d640 1 -- 172.21.15.1:0/406119863 wait complete. 2023-12-02T01:30:17.531 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.529+0000 7f6f1637d640 1 Processor -- start 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.529+0000 7f6f1637d640 1 -- start start 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f1637d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f100b4810 0x7f6f101f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f1637d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f1013e2d0 0x7f6f10152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f1637d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f1015bd90 0x7f6f10153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f1637d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100ad510 con 0x7f6f100b4810 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f1637d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f101f3e60 con 0x7f6f1013e2d0 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f1637d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100ac900 con 0x7f6f1015bd90 2023-12-02T01:30:17.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f100b4810 0x7f6f101f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f100b4810 0x7f6f101f3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54976/0 (socket says 172.21.15.1:54976) 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 -- 172.21.15.1:0/759013597 learned_addr learned my addr 172.21.15.1:0/759013597 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0f7fe640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f1013e2d0 0x7f6f10152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f1491a640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f1015bd90 0x7f6f10153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 -- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f1015bd90 msgr2=0x7f6f10153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f1015bd90 0x7f6f10153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 -- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f1013e2d0 msgr2=0x7f6f10152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f1013e2d0 0x7f6f10152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 -- 172.21.15.1:0/759013597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f08009a70 con 0x7f6f100b4810 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0ffff640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f100b4810 0x7f6f101f3920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c4d0 tx=0x7f6f0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0cff9640 1 -- 172.21.15.1:0/759013597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000074e0 con 0x7f6f100b4810 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.530+0000 7f6f0cff9640 1 -- 172.21.15.1:0/759013597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00007660 con 0x7f6f100b4810 2023-12-02T01:30:17.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.531+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1006e490 con 0x7f6f100b4810 2023-12-02T01:30:17.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.531+0000 7f6f0cff9640 1 -- 172.21.15.1:0/759013597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00004a20 con 0x7f6f100b4810 2023-12-02T01:30:17.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.531+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f100acec0 con 0x7f6f100b4810 2023-12-02T01:30:17.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.532+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1006e2f0 con 0x7f6f100b4810 2023-12-02T01:30:17.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.532+0000 7f6f0cff9640 1 -- 172.21.15.1:0/759013597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f00004b80 con 0x7f6f100b4810 2023-12-02T01:30:17.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.533+0000 7f6f0cff9640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6efc06ae40 0x7f6efc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.533+0000 7f6f0f7fe640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6efc06ae40 0x7f6efc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.533+0000 7f6f0cff9640 1 -- 172.21.15.1:0/759013597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f00088b40 con 0x7f6f100b4810 2023-12-02T01:30:17.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.533+0000 7f6f0f7fe640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6efc06ae40 0x7f6efc06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f100714d0 tx=0x7f6f04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.538 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.537+0000 7f6f0cff9640 1 -- 172.21.15.1:0/759013597 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f1006e2f0 con 0x7f6f100b4810 2023-12-02T01:30:17.717 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.715+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f1006e2f0 con 0x7f6f100b4810 2023-12-02T01:30:17.718 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.716+0000 7f6f0cff9640 1 -- 172.21.15.1:0/759013597 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f6f1006e2f0 con 0x7f6f100b4810 2023-12-02T01:30:17.718 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:17.718 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6efc06ae40 msgr2=0x7f6efc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6efc06ae40 0x7f6efc06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f100714d0 tx=0x7f6f04008040 comp rx=0 tx=0).stop 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f100b4810 msgr2=0x7f6f101f3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f100b4810 0x7f6f101f3920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c4d0 tx=0x7f6f0000c990 comp rx=0 tx=0).stop 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 shutdown_connections 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f1015bd90 0x7f6f10153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f6efc06ae40 0x7f6efc06d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f1013e2d0 0x7f6f10152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.720 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 --2- 172.21.15.1:0/759013597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f100b4810 0x7f6f101f3920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 >> 172.21.15.1:0/759013597 conn(0x7f6f100b0af0 msgr2=0x7f6f1015cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 shutdown_connections 2023-12-02T01:30:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.718+0000 7f6f1637d640 1 -- 172.21.15.1:0/759013597 wait complete. 2023-12-02T01:30:17.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:17.731 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:17.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.839+0000 7f916ad4c640 1 Processor -- start 2023-12-02T01:30:17.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.839+0000 7f916ad4c640 1 -- start start 2023-12-02T01:30:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.839+0000 7f916ad4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91640b6b50 0x7f91640cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.839+0000 7f916ad4c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91640b3590 con 0x7f9164099970 2023-12-02T01:30:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.839+0000 7f916ad4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916406b310 con 0x7f916406bc50 2023-12-02T01:30:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.839+0000 7f916ad4c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640cd3a0 con 0x7f91640b6b50 2023-12-02T01:30:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f9163fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9164099970 0x7f9164099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45620/0 (socket says 172.21.15.1:45620) 2023-12-02T01:30:17.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f9163fff640 1 -- 172.21.15.1:0/3271058854 learned_addr learned my addr 172.21.15.1:0/3271058854 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f9168ae8640 1 --2- 172.21.15.1:0/3271058854 >> v2:172.21.15.167:3300/0 conn(0x7f91640b6b50 0x7f91640cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362888455 0 0) 0x7f91640b3590 con 0x7f9164099970 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9154003520 con 0x7f9164099970 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1368400258 0 0) 0x7f9154003520 con 0x7f9164099970 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 >> v2:172.21.15.167:3300/0 conn(0x7f91640b6b50 msgr2=0x7f91640cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 --2- 172.21.15.1:0/3271058854 >> v2:172.21.15.167:3300/0 conn(0x7f91640b6b50 0x7f91640cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 >> v1:172.21.15.167:6789/0 conn(0x7f916406bc50 legacy=0x7f916406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640b37c0 con 0x7f9164099970 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f9150001670 con 0x7f9164099970 2023-12-02T01:30:17.846 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 >> v1:172.21.15.1:6789/0 conn(0x7f9164099970 legacy=0x7f9164099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154003970 0x7f9154003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91540047c0 0x7f9154004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9154005180 0x7f915400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640cd3a0 con 0x7f9154005180 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915400c030 con 0x7f91540047c0 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915400c1f0 con 0x7f9154003970 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f91692e9640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9154005180 0x7f915400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.840+0000 7f9163fff640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91540047c0 0x7f9154004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f9168ae8640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154003970 0x7f9154003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f91692e9640 1 -- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154003970 msgr2=0x7f9154003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f91692e9640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154003970 0x7f9154003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.847 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f91692e9640 1 -- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91540047c0 msgr2=0x7f9154004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:17.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f91692e9640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91540047c0 0x7f9154004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f91692e9640 1 -- 172.21.15.1:0/3271058854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154003520 con 0x7f9154005180 2023-12-02T01:30:17.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f91692e9640 1 -- 172.21.15.1:0/3271058854 reap_dead start 2023-12-02T01:30:17.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.841+0000 7f91692e9640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9154005180 0x7f915400b980 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f915c001e50 tx=0x7f91540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cddab7bc6f1e2b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c003b70 con 0x7f9154005180 2023-12-02T01:30:17.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c003d10 con 0x7f9154005180 2023-12-02T01:30:17.848 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f91637fe640 1 -- 172.21.15.1:0/3271058854 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c005310 con 0x7f9154005180 2023-12-02T01:30:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f916ad4c640 1 -- 172.21.15.1:0/3271058854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9154005180 msgr2=0x7f915400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f916ad4c640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9154005180 0x7f915400b980 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f915c001e50 tx=0x7f91540057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f916ad4c640 1 -- 172.21.15.1:0/3271058854 shutdown_connections 2023-12-02T01:30:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f916ad4c640 1 --2- 172.21.15.1:0/3271058854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9154005180 0x7f915400b980 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f916ad4c640 1 -- 172.21.15.1:0/3271058854 >> 172.21.15.1:0/3271058854 conn(0x7f91640b2a70 msgr2=0x7f91640b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f916ad4c640 1 -- 172.21.15.1:0/3271058854 shutdown_connections 2023-12-02T01:30:17.849 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.842+0000 7f916ad4c640 1 -- 172.21.15.1:0/3271058854 wait complete. 2023-12-02T01:30:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.843+0000 7f916ad4c640 1 Processor -- start 2023-12-02T01:30:17.850 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.843+0000 7f916ad4c640 1 -- start start 2023-12-02T01:30:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f916ad4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154005180 0x7f91640adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f916ad4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91640af240 0x7f91640b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f916ad4c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91640cc450 0x7f91640c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f916ad4c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640b0bd0 con 0x7f91640cc450 2023-12-02T01:30:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f916ad4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916415ac50 con 0x7f91640af240 2023-12-02T01:30:17.854 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f916ad4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640ae1a0 con 0x7f9154005180 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f91692e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91640cc450 0x7f91640c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f91692e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91640cc450 0x7f91640c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54994/0 (socket says 172.21.15.1:54994) 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f91692e9640 1 -- 172.21.15.1:0/61783505 learned_addr learned my addr 172.21.15.1:0/61783505 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.844+0000 7f9163fff640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91640af240 0x7f91640b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f9168ae8640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154005180 0x7f91640adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91692e9640 1 -- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154005180 msgr2=0x7f91640adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91692e9640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154005180 0x7f91640adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.855 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91692e9640 1 -- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91640af240 msgr2=0x7f91640b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91692e9640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91640af240 0x7f91640b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91692e9640 1 -- 172.21.15.1:0/61783505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640ae480 con 0x7f91640cc450 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f9168ae8640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154005180 0x7f91640adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91692e9640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91640cc450 0x7f91640c90a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f915c001f70 tx=0x7f915c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91617fa640 1 -- 172.21.15.1:0/61783505 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c006d50 con 0x7f91640cc450 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91617fa640 1 -- 172.21.15.1:0/61783505 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c003b80 con 0x7f91640cc450 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91640ae760 con 0x7f91640cc450 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f91617fa640 1 -- 172.21.15.1:0/61783505 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c0396a0 con 0x7f91640cc450 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.845+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91640aed20 con 0x7f91640cc450 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.846+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916409ef40 con 0x7f91640cc450 2023-12-02T01:30:17.856 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.847+0000 7f91617fa640 1 -- 172.21.15.1:0/61783505 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f915c039800 con 0x7f91640cc450 2023-12-02T01:30:17.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.847+0000 7f91617fa640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f914806ae40 0x7f914806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:17.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.847+0000 7f91617fa640 1 -- 172.21.15.1:0/61783505 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f915c0ab220 con 0x7f91640cc450 2023-12-02T01:30:17.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.847+0000 7f9168ae8640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f914806ae40 0x7f914806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:17.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.847+0000 7f9168ae8640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f914806ae40 0x7f914806d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9158009b40 tx=0x7f9158008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:17.857 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:17.851+0000 7f91617fa640 1 -- 172.21.15.1:0/61783505 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f915c0762d0 con 0x7f91640cc450 2023-12-02T01:30:18.026 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.025+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f916404e920 con 0x7f91640cc450 2023-12-02T01:30:18.027 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.025+0000 7f91617fa640 1 -- 172.21.15.1:0/61783505 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f915c0798f0 con 0x7f91640cc450 2023-12-02T01:30:18.027 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:18.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f914806ae40 msgr2=0x7f914806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f914806ae40 0x7f914806d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9158009b40 tx=0x7f9158008040 comp rx=0 tx=0).stop 2023-12-02T01:30:18.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91640cc450 msgr2=0x7f91640c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91640cc450 0x7f91640c90a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f915c001f70 tx=0x7f915c0014a0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 shutdown_connections 2023-12-02T01:30:18.029 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91640cc450 0x7f91640c90a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f914806ae40 0x7f914806d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91640af240 0x7f91640b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 --2- 172.21.15.1:0/61783505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9154005180 0x7f91640adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 >> 172.21.15.1:0/61783505 conn(0x7f91640b2a70 msgr2=0x7f916406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:18.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 shutdown_connections 2023-12-02T01:30:18.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.027+0000 7f916ad4c640 1 -- 172.21.15.1:0/61783505 wait complete. 2023-12-02T01:30:18.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:18.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.147+0000 7f8bc849b640 1 Processor -- start 2023-12-02T01:30:18.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.147+0000 7f8bc849b640 1 -- start start 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.148+0000 7f8bc849b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 0x7f8bc00cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.148+0000 7f8bc849b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8bc006bc50 0x7f8bc006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.148+0000 7f8bc849b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc00b3590 con 0x7f8bc00b6b50 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.148+0000 7f8bc849b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc006b310 con 0x7f8bc006bc50 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.148+0000 7f8bc849b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00cd3a0 con 0x7f8bc009a080 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.148+0000 7f8bc6237640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8bc00b6b50 0x7f8bc0099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45624/0 (socket says 172.21.15.1:45624) 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.148+0000 7f8bc6237640 1 -- 172.21.15.1:0/2631927201 learned_addr learned my addr 172.21.15.1:0/2631927201 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 0x7f8bc00cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc6a38640 1 --2- 172.21.15.1:0/2631927201 >> v2:172.21.15.167:3300/0 conn(0x7f8bc006bc50 0x7f8bc006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767396293 0 0) 0x7f8bc00b3590 con 0x7f8bc00b6b50 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba8003520 con 0x7f8bc00b6b50 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2293890687 0 0) 0x7f8ba8003520 con 0x7f8bc00b6b50 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 msgr2=0x7f8bc00cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 0x7f8bc00cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 >> v2:172.21.15.167:3300/0 conn(0x7f8bc006bc50 msgr2=0x7f8bc006c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 --2- 172.21.15.1:0/2631927201 >> v2:172.21.15.167:3300/0 conn(0x7f8bc006bc50 0x7f8bc006c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00b37c0 con 0x7f8bc00b6b50 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f8bb8001670 con 0x7f8bc00b6b50 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 >> v1:172.21.15.1:6789/0 conn(0x7f8bc00b6b50 legacy=0x7f8bc0099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba8003970 0x7f8ba8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ba80047c0 0x7f8ba8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 0x7f8ba8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc006b310 con 0x7f8ba80047c0 2023-12-02T01:30:18.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00cd3a0 con 0x7f8ba8003970 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba800b980 con 0x7f8bc009a080 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ba80047c0 0x7f8ba8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc6237640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba8003970 0x7f8ba8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc6a38640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 0x7f8ba8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5a36640 1 -- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 msgr2=0x7f8ba8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bc009a080 0x7f8ba8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5a36640 1 -- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba8003970 msgr2=0x7f8ba8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba8003970 0x7f8ba8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.149+0000 7f8bc5a36640 1 -- 172.21.15.1:0/2631927201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8003520 con 0x7f8ba80047c0 2023-12-02T01:30:18.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.150+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ba80047c0 0x7f8ba8004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009a90 tx=0x7f8ba80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6308e8a0af9f0db9 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.150+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb402c680 con 0x7f8ba80047c0 2023-12-02T01:30:18.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.150+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb402c7e0 con 0x7f8ba80047c0 2023-12-02T01:30:18.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.150+0000 7f8bc5235640 1 -- 172.21.15.1:0/2631927201 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb402cb90 con 0x7f8ba80047c0 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.151+0000 7f8bc849b640 1 -- 172.21.15.1:0/2631927201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ba80047c0 msgr2=0x7f8ba8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.151+0000 7f8bc849b640 1 --2- 172.21.15.1:0/2631927201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ba80047c0 0x7f8ba8004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009a90 tx=0x7f8ba80057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.151+0000 7f8bc6a38640 1 -- 172.21.15.1:0/2631927201 reap_dead start 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.151+0000 7f8bc849b640 1 -- 172.21.15.1:0/2631927201 shutdown_connections 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.151+0000 7f8bc849b640 1 -- 172.21.15.1:0/2631927201 >> 172.21.15.1:0/2631927201 conn(0x7f8bc00b2a70 msgr2=0x7f8bc00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.151+0000 7f8bc849b640 1 -- 172.21.15.1:0/2631927201 shutdown_connections 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.151+0000 7f8bc849b640 1 -- 172.21.15.1:0/2631927201 wait complete. 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.152+0000 7f8bc849b640 1 Processor -- start 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.152+0000 7f8bc849b640 1 -- start start 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc849b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80047c0 0x7f8bc01f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc849b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bc015aa30 0x7f8bc015f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc849b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bc01f6c10 0x7f8bc01f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc849b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01f75e0 con 0x7f8bc015aa30 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc849b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01f4650 con 0x7f8bc01f6c10 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc849b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01606a0 con 0x7f8ba80047c0 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bc015aa30 0x7f8bc015f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bc015aa30 0x7f8bc015f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55006/0 (socket says 172.21.15.1:55006) 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 -- 172.21.15.1:0/2564667427 learned_addr learned my addr 172.21.15.1:0/2564667427 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc6237640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80047c0 0x7f8bc01f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc6a38640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bc01f6c10 0x7f8bc01f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 -- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80047c0 msgr2=0x7f8bc01f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80047c0 0x7f8bc01f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 -- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bc01f6c10 msgr2=0x7f8bc01f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.159 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bc01f6c10 0x7f8bc01f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.153+0000 7f8bc5a36640 1 -- 172.21.15.1:0/2564667427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc015f840 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.154+0000 7f8bc5a36640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bc015aa30 0x7f8bc015f300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009bb0 tx=0x7f8bb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.154+0000 7f8bbeffd640 1 -- 172.21.15.1:0/2564667427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4034a10 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.154+0000 7f8bbeffd640 1 -- 172.21.15.1:0/2564667427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb4034b90 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.154+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc015fa90 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.154+0000 7f8bbeffd640 1 -- 172.21.15.1:0/2564667427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb403e400 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.154+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc0160050 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.155+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc00c7ea0 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.155+0000 7f8bbeffd640 1 -- 172.21.15.1:0/2564667427 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8bb403e560 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.156+0000 7f8bbeffd640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8bac06ae70 0x7f8bac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.156+0000 7f8bbeffd640 1 -- 172.21.15.1:0/2564667427 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bb40ab740 con 0x7f8bc015aa30 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.156+0000 7f8bc6237640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8bac06ae70 0x7f8bac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.156+0000 7f8bc6237640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8bac06ae70 0x7f8bac06d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bc014e9f0 tx=0x7f8bb8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.160+0000 7f8bbeffd640 1 -- 172.21.15.1:0/2564667427 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8bb40769c0 con 0x7f8bc015aa30 2023-12-02T01:30:18.339 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.338+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bc009ef40 con 0x7f8bc015aa30 2023-12-02T01:30:18.340 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.338+0000 7f8bbeffd640 1 -- 172.21.15.1:0/2564667427 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8bb404c020 con 0x7f8bc015aa30 2023-12-02T01:30:18.340 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8bac06ae70 msgr2=0x7f8bac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8bac06ae70 0x7f8bac06d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bc014e9f0 tx=0x7f8bb8009040 comp rx=0 tx=0).stop 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bc015aa30 msgr2=0x7f8bc015f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bc015aa30 0x7f8bc015f300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009bb0 tx=0x7f8bb4004730 comp rx=0 tx=0).stop 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 shutdown_connections 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8bac06ae70 0x7f8bac06d330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bc01f6c10 0x7f8bc01f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.342 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bc015aa30 0x7f8bc015f300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 --2- 172.21.15.1:0/2564667427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80047c0 0x7f8bc01f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 >> 172.21.15.1:0/2564667427 conn(0x7f8bc00b2a70 msgr2=0x7f8bc006c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:18.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 shutdown_connections 2023-12-02T01:30:18.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.340+0000 7f8bc849b640 1 -- 172.21.15.1:0/2564667427 wait complete. 2023-12-02T01:30:18.353 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.460+0000 7f06db64f640 1 Processor -- start 2023-12-02T01:30:18.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.460+0000 7f06db64f640 1 -- start start 2023-12-02T01:30:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06db64f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d409a080 0x7f06d40cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06db64f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f06d406bc50 0x7f06d406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06db64f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40b3590 con 0x7f06d40b6b50 2023-12-02T01:30:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06db64f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d406b310 con 0x7f06d406bc50 2023-12-02T01:30:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06db64f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40cd3a0 con 0x7f06d409a080 2023-12-02T01:30:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06d9bec640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f06d406bc50 0x7f06d406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06d9bec640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f06d406bc50 0x7f06d406c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55008/0 (socket says 172.21.15.1:55008) 2023-12-02T01:30:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.461+0000 7f06d9bec640 1 -- 172.21.15.1:0/3615185601 learned_addr learned my addr 172.21.15.1:0/3615185601 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.462+0000 7f06d8bea640 1 --2- 172.21.15.1:0/3615185601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d409a080 0x7f06d40cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.462+0000 7f06d9bec640 1 -- 172.21.15.1:0/3615185601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d409a080 msgr2=0x7f06d40cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.462+0000 7f06d9bec640 1 --2- 172.21.15.1:0/3615185601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d409a080 0x7f06d40cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.462+0000 7f06d9bec640 1 -- 172.21.15.1:0/3615185601 >> v1:172.21.15.167:6789/0 conn(0x7f06d40b6b50 legacy=0x7f06d4099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.462+0000 7f06d9bec640 1 -- 172.21.15.1:0/3615185601 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40b37c0 con 0x7f06d406bc50 2023-12-02T01:30:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.462+0000 7f06d9bec640 1 --2- 172.21.15.1:0/3615185601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d406bc50 0x7f06d406c100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009e50 tx=0x7f06c402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35b19b5567fc212 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06d3fff640 1 -- 172.21.15.1:0/3615185601 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c402cb00 con 0x7f06d406bc50 2023-12-02T01:30:18.465 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06d3fff640 1 -- 172.21.15.1:0/3615185601 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c402cc60 con 0x7f06d406bc50 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06d3fff640 1 -- 172.21.15.1:0/3615185601 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40343f0 con 0x7f06d406bc50 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 -- 172.21.15.1:0/3615185601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d406bc50 msgr2=0x7f06d406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 --2- 172.21.15.1:0/3615185601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d406bc50 0x7f06d406c100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009e50 tx=0x7f06c402bf60 comp rx=0 tx=0).stop 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 -- 172.21.15.1:0/3615185601 shutdown_connections 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 --2- 172.21.15.1:0/3615185601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d406bc50 0x7f06d406c100 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 --2- 172.21.15.1:0/3615185601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d409a080 0x7f06d40cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 -- 172.21.15.1:0/3615185601 >> 172.21.15.1:0/3615185601 conn(0x7f06d40b2a70 msgr2=0x7f06d40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 -- 172.21.15.1:0/3615185601 shutdown_connections 2023-12-02T01:30:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.463+0000 7f06db64f640 1 -- 172.21.15.1:0/3615185601 wait complete. 2023-12-02T01:30:18.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 Processor -- start 2023-12-02T01:30:18.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 -- start start 2023-12-02T01:30:18.468 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d406bc50 0x7f06d41f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d409a080 0x7f06d415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40b6b50 0x7f06d415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d409af50 con 0x7f06d409a080 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40c9140 con 0x7f06d406bc50 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06db64f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d415ff00 con 0x7f06d40b6b50 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06d8bea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d409a080 0x7f06d415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06d8bea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d409a080 0x7f06d415f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55012/0 (socket says 172.21.15.1:55012) 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06d8bea640 1 -- 172.21.15.1:0/3375058038 learned_addr learned my addr 172.21.15.1:0/3375058038 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.465+0000 7f06d93eb640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d406bc50 0x7f06d41f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d9bec640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40b6b50 0x7f06d415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d8bea640 1 -- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40b6b50 msgr2=0x7f06d415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d8bea640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40b6b50 0x7f06d415c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d8bea640 1 -- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d406bc50 msgr2=0x7f06d41f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.469 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d8bea640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d406bc50 0x7f06d41f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d8bea640 1 -- 172.21.15.1:0/3375058038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4009b30 con 0x7f06d409a080 2023-12-02T01:30:18.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d8bea640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d409a080 0x7f06d415f9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c820 tx=0x7f06c800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d1ffb640 1 -- 172.21.15.1:0/3375058038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004220 con 0x7f06d409a080 2023-12-02T01:30:18.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d1ffb640 1 -- 172.21.15.1:0/3375058038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8004380 con 0x7f06d409a080 2023-12-02T01:30:18.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d41f3870 con 0x7f06d409a080 2023-12-02T01:30:18.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06d1ffb640 1 -- 172.21.15.1:0/3375058038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8007a70 con 0x7f06d409a080 2023-12-02T01:30:18.470 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.466+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d41f3e30 con 0x7f06d409a080 2023-12-02T01:30:18.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.467+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d41f35f0 con 0x7f06d409a080 2023-12-02T01:30:18.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.468+0000 7f06d1ffb640 1 -- 172.21.15.1:0/3375058038 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06c8007bd0 con 0x7f06d409a080 2023-12-02T01:30:18.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.468+0000 7f06d1ffb640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.468+0000 7f06d1ffb640 1 -- 172.21.15.1:0/3375058038 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06c80892d0 con 0x7f06d409a080 2023-12-02T01:30:18.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.468+0000 7f06d93eb640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.471 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.469+0000 7f06d93eb640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f06c006ae40 0x7f06c006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f06d41f6490 tx=0x7f06cc009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.473 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.472+0000 7f06d1ffb640 1 -- 172.21.15.1:0/3375058038 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06c8054430 con 0x7f06d409a080 2023-12-02T01:30:18.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.648+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06d409ef40 con 0x7f06d409a080 2023-12-02T01:30:18.649 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.648+0000 7f06d1ffb640 1 -- 172.21.15.1:0/3375058038 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06c8057a50 con 0x7f06d409a080 2023-12-02T01:30:18.650 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:18.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f06c006ae40 msgr2=0x7f06c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f06c006ae40 0x7f06c006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f06d41f6490 tx=0x7f06cc009060 comp rx=0 tx=0).stop 2023-12-02T01:30:18.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d409a080 msgr2=0x7f06d415f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d409a080 0x7f06d415f9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c820 tx=0x7f06c800cce0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 shutdown_connections 2023-12-02T01:30:18.653 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40b6b50 0x7f06d415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f06d409a080 0x7f06d415f9c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 --2- 172.21.15.1:0/3375058038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d406bc50 0x7f06d41f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 >> 172.21.15.1:0/3375058038 conn(0x7f06d40b2a70 msgr2=0x7f06d40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:18.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 shutdown_connections 2023-12-02T01:30:18.654 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.650+0000 7f06db64f640 1 -- 172.21.15.1:0/3375058038 wait complete. 2023-12-02T01:30:18.663 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:18.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.768+0000 7f9d3d0d3640 1 Processor -- start 2023-12-02T01:30:18.770 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.768+0000 7f9d3d0d3640 1 -- start start 2023-12-02T01:30:18.771 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d3d0d3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d38160b70 0x7f9d380d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d3d0d3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d3d0d3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380ce360 con 0x7f9d380ced30 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d3d0d3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380b2f20 con 0x7f9d38160b70 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d3d0d3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380cdd50 con 0x7f9d380b2aa0 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d36d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d38160b70 0x7f9d380d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d36d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9d38160b70 0x7f9d380d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55014/0 (socket says 172.21.15.1:55014) 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.769+0000 7f9d36d9d640 1 -- 172.21.15.1:0/3351291982 learned_addr learned my addr 172.21.15.1:0/3351291982 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.770+0000 7f9d3659c640 1 --2- 172.21.15.1:0/3351291982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.770+0000 7f9d36d9d640 1 -- 172.21.15.1:0/3351291982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 msgr2=0x7f9d380ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.770+0000 7f9d36d9d640 1 --2- 172.21.15.1:0/3351291982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.770+0000 7f9d36d9d640 1 -- 172.21.15.1:0/3351291982 >> v1:172.21.15.167:6789/0 conn(0x7f9d380ced30 legacy=0x7f9d380cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.770+0000 7f9d36d9d640 1 -- 172.21.15.1:0/3351291982 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380d1c70 con 0x7f9d38160b70 2023-12-02T01:30:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.770+0000 7f9d3659c640 1 --2- 172.21.15.1:0/3351291982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:18.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.770+0000 7f9d36d9d640 1 --2- 172.21.15.1:0/3351291982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380d1570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009870 tx=0x7f9d3002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5a43e136d6d421 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d35d9b640 1 -- 172.21.15.1:0/3351291982 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30030840 con 0x7f9d38160b70 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d35d9b640 1 -- 172.21.15.1:0/3351291982 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300309a0 con 0x7f9d38160b70 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d35d9b640 1 -- 172.21.15.1:0/3351291982 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30030d30 con 0x7f9d38160b70 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/3351291982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 msgr2=0x7f9d380d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/3351291982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380d1570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009870 tx=0x7f9d3002b980 comp rx=0 tx=0).stop 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/3351291982 shutdown_connections 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/3351291982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/3351291982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380d1570 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/3351291982 >> 172.21.15.1:0/3351291982 conn(0x7f9d3809c470 msgr2=0x7f9d380d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:18.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/3351291982 shutdown_connections 2023-12-02T01:30:18.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.771+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/3351291982 wait complete. 2023-12-02T01:30:18.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 Processor -- start 2023-12-02T01:30:18.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 -- start start 2023-12-02T01:30:18.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d380ced30 0x7f9d38158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d381590f0 con 0x7f9d38160b70 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d381593d0 con 0x7f9d380ced30 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3d0d3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d381596b0 con 0x7f9d380b2aa0 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55030/0 (socket says 172.21.15.1:55030) 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.773+0000 7f9d3759e640 1 -- 172.21.15.1:0/1158576542 learned_addr learned my addr 172.21.15.1:0/1158576542 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3659c640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d380ced30 0x7f9d38158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d36d9d640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3759e640 1 -- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 msgr2=0x7f9d380c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3759e640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3759e640 1 -- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d380ced30 msgr2=0x7f9d38158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3759e640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d380ced30 0x7f9d38158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3759e640 1 -- 172.21.15.1:0/1158576542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d300094d0 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3659c640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d380ced30 0x7f9d38158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d36d9d640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3759e640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380cc220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800c7a0 tx=0x7f9d2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d1f7fe640 1 -- 172.21.15.1:0/1158576542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28003b70 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d1f7fe640 1 -- 172.21.15.1:0/1158576542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d28003cf0 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d38159990 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d1f7fe640 1 -- 172.21.15.1:0/1158576542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28003ea0 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.774+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d38158bb0 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.775+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380a1150 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.776+0000 7f9d1f7fe640 1 -- 172.21.15.1:0/1158576542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d2800aa90 con 0x7f9d38160b70 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.776+0000 7f9d1f7fe640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9d2406ae40 0x7f9d2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:18.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.776+0000 7f9d1f7fe640 1 -- 172.21.15.1:0/1158576542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d280893b0 con 0x7f9d38160b70 2023-12-02T01:30:18.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.776+0000 7f9d36d9d640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9d2406ae40 0x7f9d2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:18.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.777+0000 7f9d36d9d640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9d2406ae40 0x7f9d2406d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d30036000 tx=0x7f9d3003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:18.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.780+0000 7f9d1f7fe640 1 -- 172.21.15.1:0/1158576542 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d280544f0 con 0x7f9d38160b70 2023-12-02T01:30:18.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.972+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d380b22d0 con 0x7f9d38160b70 2023-12-02T01:30:18.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.972+0000 7f9d1f7fe640 1 -- 172.21.15.1:0/1158576542 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d28057b10 con 0x7f9d38160b70 2023-12-02T01:30:18.974 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:18.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9d2406ae40 msgr2=0x7f9d2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9d2406ae40 0x7f9d2406d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d30036000 tx=0x7f9d3003b040 comp rx=0 tx=0).stop 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 msgr2=0x7f9d380cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380cc220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800c7a0 tx=0x7f9d2800cc60 comp rx=0 tx=0).stop 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 shutdown_connections 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d38160b70 0x7f9d380cc220 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9d2406ae40 0x7f9d2406d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d380ced30 0x7f9d38158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 --2- 172.21.15.1:0/1158576542 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d380b2aa0 0x7f9d380c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 >> 172.21.15.1:0/1158576542 conn(0x7f9d3809c470 msgr2=0x7f9d3806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 shutdown_connections 2023-12-02T01:30:18.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:18.975+0000 7f9d3d0d3640 1 -- 172.21.15.1:0/1158576542 wait complete. 2023-12-02T01:30:18.988 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:30:18.988 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:19.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:19.115 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.114+0000 7f8ddf939640 1 Processor -- start 2023-12-02T01:30:19.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.114+0000 7f8ddf939640 1 -- start start 2023-12-02T01:30:19.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddf939640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8dd8158e50 0x7f8dd815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddf939640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 0x7f8dd815f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddf939640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd815d230 con 0x7f8dd8071a40 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddf939640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd815f960 con 0x7f8dd8158e50 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddf939640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815fe20 con 0x7f8dd80c9880 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddded6640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8dd8071a40 0x7f8dd8071ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45628/0 (socket says 172.21.15.1:45628) 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddded6640 1 -- 172.21.15.1:0/3844901080 learned_addr learned my addr 172.21.15.1:0/3844901080 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddced4640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 0x7f8dd815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805254790 0 0) 0x7f8dd815d230 con 0x7f8dd8071a40 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/3844901080 >> v2:172.21.15.167:3300/0 conn(0x7f8dd8158e50 0x7f8dd815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc4003520 con 0x7f8dd8071a40 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207960766 0 0) 0x7f8dc4003520 con 0x7f8dd8071a40 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.115+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 msgr2=0x7f8dd815f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:19.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 0x7f8dd815f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 >> v2:172.21.15.167:3300/0 conn(0x7f8dd8158e50 msgr2=0x7f8dd815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 --2- 172.21.15.1:0/3844901080 >> v2:172.21.15.167:3300/0 conn(0x7f8dd8158e50 0x7f8dd815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd815fb40 con 0x7f8dd8071a40 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f8dd00019f0 con 0x7f8dd8071a40 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 >> v1:172.21.15.1:6789/0 conn(0x7f8dd8071a40 legacy=0x7f8dd8071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 0x7f8dc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dc4004d00 0x7f8dc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815f960 con 0x7f8dc4003970 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815fe20 con 0x7f8dc4004d00 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc400b980 con 0x7f8dd80c9880 2023-12-02T01:30:19.121 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddced4640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 0x7f8dc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddded6640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dc4004d00 0x7f8dc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddd6d5640 1 -- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 msgr2=0x7f8dc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:19.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd80c9880 0x7f8dc40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddd6d5640 1 -- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dc4004d00 msgr2=0x7f8dc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:19.122 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dc4004d00 0x7f8dc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddd6d5640 1 -- 172.21.15.1:0/3844901080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc4003520 con 0x7f8dc4003970 2023-12-02T01:30:19.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.116+0000 7f8ddded6640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dc4004d00 0x7f8dc4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:19.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009ac0 tx=0x7f8dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec53b55325ffa78a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd402c710 con 0x7f8dc4003970 2023-12-02T01:30:19.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd402c870 con 0x7f8dc4003970 2023-12-02T01:30:19.123 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8dcffff640 1 -- 172.21.15.1:0/3844901080 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd402cc00 con 0x7f8dc4003970 2023-12-02T01:30:19.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddf939640 1 -- 172.21.15.1:0/3844901080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 msgr2=0x7f8dc4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddf939640 1 --2- 172.21.15.1:0/3844901080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dc4003d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009ac0 tx=0x7f8dc40057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddded6640 1 -- 172.21.15.1:0/3844901080 reap_dead start 2023-12-02T01:30:19.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddf939640 1 -- 172.21.15.1:0/3844901080 shutdown_connections 2023-12-02T01:30:19.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddf939640 1 -- 172.21.15.1:0/3844901080 >> 172.21.15.1:0/3844901080 conn(0x7f8dd80b0d20 msgr2=0x7f8dd80b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:19.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddf939640 1 -- 172.21.15.1:0/3844901080 shutdown_connections 2023-12-02T01:30:19.124 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.117+0000 7f8ddf939640 1 -- 172.21.15.1:0/3844901080 wait complete. 2023-12-02T01:30:19.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 Processor -- start 2023-12-02T01:30:19.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 -- start start 2023-12-02T01:30:19.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dd80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.127 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dd81f4390 0x7f8dd81f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd809c370 0x7f8dd809c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd81f5100 con 0x7f8dc4003970 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd8159e80 con 0x7f8dd81f4390 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddf939640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd8159550 con 0x7f8dd809c370 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddd6d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dd80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddd6d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dd80b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55050/0 (socket says 172.21.15.1:55050) 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.119+0000 7f8ddd6d5640 1 -- 172.21.15.1:0/4115360637 learned_addr learned my addr 172.21.15.1:0/4115360637 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:19.128 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddded6640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd809c370 0x7f8dd809c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddced4640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dd81f4390 0x7f8dd81f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddd6d5640 1 -- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd809c370 msgr2=0x7f8dd809c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd809c370 0x7f8dd809c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddd6d5640 1 -- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dd81f4390 msgr2=0x7f8dd81f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dd81f4390 0x7f8dd81f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddd6d5640 1 -- 172.21.15.1:0/4115360637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8159830 con 0x7f8dc4003970 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddced4640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dd81f4390 0x7f8dd81f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddd6d5640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dd80b3690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8dd402c2b0 tx=0x7f8dd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8dcdffb640 1 -- 172.21.15.1:0/4115360637 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4003810 con 0x7f8dc4003970 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8dcdffb640 1 -- 172.21.15.1:0/4115360637 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd402de90 con 0x7f8dc4003970 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd8159b10 con 0x7f8dc4003970 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8dcdffb640 1 -- 172.21.15.1:0/4115360637 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4003b70 con 0x7f8dc4003970 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.120+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd81f4d50 con 0x7f8dc4003970 2023-12-02T01:30:19.129 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.121+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd815a4f0 con 0x7f8dc4003970 2023-12-02T01:30:19.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.122+0000 7f8dcdffb640 1 -- 172.21.15.1:0/4115360637 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8dd4003cd0 con 0x7f8dc4003970 2023-12-02T01:30:19.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.122+0000 7f8dcdffb640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8dbc06ae40 0x7f8dbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.122+0000 7f8dcdffb640 1 -- 172.21.15.1:0/4115360637 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dd40ab470 con 0x7f8dc4003970 2023-12-02T01:30:19.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.122+0000 7f8ddced4640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8dbc06ae40 0x7f8dbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.123+0000 7f8ddced4640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8dbc06ae40 0x7f8dbc06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b41a0 tx=0x7f8dc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.130 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.126+0000 7f8dcdffb640 1 -- 172.21.15.1:0/4115360637 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8dd4076640 con 0x7f8dc4003970 2023-12-02T01:30:19.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.301+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dd815c8d0 con 0x7f8dc4003970 2023-12-02T01:30:19.306 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.303+0000 7f8dcdffb640 1 -- 172.21.15.1:0/4115360637 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f8dd4079c60 con 0x7f8dc4003970 2023-12-02T01:30:19.306 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:19.306 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:19.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8dbc06ae40 msgr2=0x7f8dbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8dbc06ae40 0x7f8dbc06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b41a0 tx=0x7f8dc8008040 comp rx=0 tx=0).stop 2023-12-02T01:30:19.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 msgr2=0x7f8dd80b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dd80b3690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8dd402c2b0 tx=0x7f8dd4004730 comp rx=0 tx=0).stop 2023-12-02T01:30:19.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 shutdown_connections 2023-12-02T01:30:19.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8dd809c370 0x7f8dd809c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8dbc06ae40 0x7f8dbc06d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dd81f4390 0x7f8dd81f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 --2- 172.21.15.1:0/4115360637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4003970 0x7f8dd80b3690 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.304+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 >> 172.21.15.1:0/4115360637 conn(0x7f8dd80b0d20 msgr2=0x7f8dd80c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:19.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.305+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 shutdown_connections 2023-12-02T01:30:19.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.305+0000 7f8ddf939640 1 -- 172.21.15.1:0/4115360637 wait complete. 2023-12-02T01:30:19.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:19.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:19.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.425+0000 7f9b41383640 1 Processor -- start 2023-12-02T01:30:19.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.426+0000 7f9b41383640 1 -- start start 2023-12-02T01:30:19.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.426+0000 7f9b41383640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.426+0000 7f9b41383640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c0ce060 con 0x7f9b3c13fb30 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.426+0000 7f9b41383640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c0ce340 con 0x7f9b3c070630 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.426+0000 7f9b41383640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0cec70 con 0x7f9b3c13f750 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b3a7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9b3c13fb30 0x7f9b3c0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45630/0 (socket says 172.21.15.1:45630) 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b3a7fc640 1 -- 172.21.15.1:0/4196271472 learned_addr learned my addr 172.21.15.1:0/4196271472 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b3affd640 1 --2- 172.21.15.1:0/4196271472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b39ffb640 1 -- 172.21.15.1:0/4196271472 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079518432 0 0) 0x7f9b3c0ce060 con 0x7f9b3c13fb30 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b39ffb640 1 -- 172.21.15.1:0/4196271472 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b24005730 con 0x7f9b3c13fb30 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b39ffb640 1 -- 172.21.15.1:0/4196271472 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842499510 0 0) 0x7f9b3c0ce340 con 0x7f9b3c070630 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b3affd640 1 -- 172.21.15.1:0/4196271472 >> v1:172.21.15.167:6789/0 conn(0x7f9b3c070630 legacy=0x7f9b3c070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b3affd640 1 -- 172.21.15.1:0/4196271472 >> v1:172.21.15.1:6789/0 conn(0x7f9b3c13fb30 legacy=0x7f9b3c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.427+0000 7f9b3affd640 1 -- 172.21.15.1:0/4196271472 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0ce620 con 0x7f9b3c13f750 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.428+0000 7f9b3affd640 1 --2- 172.21.15.1:0/4196271472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15b0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0097d0 tx=0x7f9b2c02b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=469459acd0c6805b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.428+0000 7f9b39ffb640 1 -- 172.21.15.1:0/4196271472 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30001670 con 0x7f9b3c13f750 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.428+0000 7f9b39ffb640 1 -- 172.21.15.1:0/4196271472 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c02e050 con 0x7f9b3c13f750 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.428+0000 7f9b39ffb640 1 -- 172.21.15.1:0/4196271472 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c030710 con 0x7f9b3c13f750 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.429+0000 7f9b41383640 1 -- 172.21.15.1:0/4196271472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 msgr2=0x7f9b3c15b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.429+0000 7f9b41383640 1 --2- 172.21.15.1:0/4196271472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15b0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0097d0 tx=0x7f9b2c02b730 comp rx=0 tx=0).stop 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.429+0000 7f9b41383640 1 -- 172.21.15.1:0/4196271472 shutdown_connections 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.429+0000 7f9b41383640 1 --2- 172.21.15.1:0/4196271472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15b0d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.429+0000 7f9b41383640 1 -- 172.21.15.1:0/4196271472 >> 172.21.15.1:0/4196271472 conn(0x7f9b3c06a8f0 msgr2=0x7f9b3c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.429+0000 7f9b41383640 1 -- 172.21.15.1:0/4196271472 shutdown_connections 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.429+0000 7f9b41383640 1 -- 172.21.15.1:0/4196271472 wait complete. 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.430+0000 7f9b41383640 1 Processor -- start 2023-12-02T01:30:19.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.430+0000 7f9b41383640 1 -- start start 2023-12-02T01:30:19.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b41383640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b3c070630 0x7f9b3c12f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b41383640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b41383640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3c13fb30 0x7f9b3c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b41383640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0ad9d0 con 0x7f9b3c070630 2023-12-02T01:30:19.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b41383640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0acd50 con 0x7f9b3c13fb30 2023-12-02T01:30:19.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b41383640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0ad030 con 0x7f9b3c13f750 2023-12-02T01:30:19.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b3c070630 0x7f9b3c12f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b3c070630 0x7f9b3c12f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55054/0 (socket says 172.21.15.1:55054) 2023-12-02T01:30:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 -- 172.21.15.1:0/2084423005 learned_addr learned my addr 172.21.15.1:0/2084423005 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 -- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 msgr2=0x7f9b3c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3a7fc640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3b7fe640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3c13fb30 0x7f9b3c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 -- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3c13fb30 msgr2=0x7f9b3c15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3c13fb30 0x7f9b3c15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 -- 172.21.15.1:0/2084423005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009400 con 0x7f9b3c070630 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3a7fc640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3b7fe640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3c13fb30 0x7f9b3c15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.431+0000 7f9b3affd640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b3c070630 0x7f9b3c12f510 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c02b770 tx=0x7f9b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.432+0000 7f9b237fe640 1 -- 172.21.15.1:0/2084423005 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c03d890 con 0x7f9b3c070630 2023-12-02T01:30:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.432+0000 7f9b237fe640 1 -- 172.21.15.1:0/2084423005 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c03d9f0 con 0x7f9b3c070630 2023-12-02T01:30:19.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.432+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c0ad310 con 0x7f9b3c070630 2023-12-02T01:30:19.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.432+0000 7f9b237fe640 1 -- 172.21.15.1:0/2084423005 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c03dda0 con 0x7f9b3c070630 2023-12-02T01:30:19.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.432+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c15d9f0 con 0x7f9b3c070630 2023-12-02T01:30:19.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.433+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c13ff70 con 0x7f9b3c070630 2023-12-02T01:30:19.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.433+0000 7f9b237fe640 1 -- 172.21.15.1:0/2084423005 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b2c039040 con 0x7f9b3c070630 2023-12-02T01:30:19.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.434+0000 7f9b237fe640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9b2806ae40 0x7f9b2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.434+0000 7f9b237fe640 1 -- 172.21.15.1:0/2084423005 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b2c0ab6f0 con 0x7f9b3c070630 2023-12-02T01:30:19.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.434+0000 7f9b3a7fc640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9b2806ae40 0x7f9b2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.434+0000 7f9b3a7fc640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9b2806ae40 0x7f9b2806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c13cdd0 tx=0x7f9b30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.438+0000 7f9b237fe640 1 -- 172.21.15.1:0/2084423005 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b3c13ff70 con 0x7f9b3c070630 2023-12-02T01:30:19.617 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.616+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b3c13ff70 con 0x7f9b3c070630 2023-12-02T01:30:19.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.616+0000 7f9b237fe640 1 -- 172.21.15.1:0/2084423005 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b3c13ff70 con 0x7f9b3c070630 2023-12-02T01:30:19.618 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:19.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9b2806ae40 msgr2=0x7f9b2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9b2806ae40 0x7f9b2806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c13cdd0 tx=0x7f9b30009040 comp rx=0 tx=0).stop 2023-12-02T01:30:19.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b3c070630 msgr2=0x7f9b3c12f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b3c070630 0x7f9b3c12f510 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c02b770 tx=0x7f9b2c0046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 shutdown_connections 2023-12-02T01:30:19.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9b2806ae40 0x7f9b2806d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3c13fb30 0x7f9b3c15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b3c13f750 0x7f9b3c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 --2- 172.21.15.1:0/2084423005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b3c070630 0x7f9b3c12f510 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 >> 172.21.15.1:0/2084423005 conn(0x7f9b3c06a8f0 msgr2=0x7f9b3c13de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:19.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 shutdown_connections 2023-12-02T01:30:19.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.618+0000 7f9b41383640 1 -- 172.21.15.1:0/2084423005 wait complete. 2023-12-02T01:30:19.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:19.739 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.738+0000 7f22227b6640 1 Processor -- start 2023-12-02T01:30:19.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.738+0000 7f22227b6640 1 -- start start 2023-12-02T01:30:19.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f22227b6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f221c1465d0 0x7f221c0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f22227b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c06abe0 0x7f221c160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f22227b6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0721d0 con 0x7f221c071d40 2023-12-02T01:30:19.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f22227b6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c161d80 con 0x7f221c1465d0 2023-12-02T01:30:19.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f22227b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1612d0 con 0x7f221c06abe0 2023-12-02T01:30:19.741 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f221bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f221c1465d0 0x7f221c0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f2220d53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c06abe0 0x7f221c160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f221b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f221c071d40 0x7f221c06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:57170/0 (socket says 172.21.15.1:57170) 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f221b7fe640 1 -- 172.21.15.1:0/3247155752 learned_addr learned my addr 172.21.15.1:0/3247155752 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f221bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f221c1465d0 0x7f221c0b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:54878/0 (socket says 172.21.15.1:54878) 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.739+0000 7f2220d53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c06abe0 0x7f221c160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:35366/0 (socket says 172.21.15.1:35366) 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f221affd640 1 -- 172.21.15.1:0/3247155752 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669545654 0 0) 0x7f221c0721d0 con 0x7f221c071d40 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f221affd640 1 -- 172.21.15.1:0/3247155752 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2208003520 con 0x7f221c071d40 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f2220d53640 1 -- 172.21.15.1:0/3247155752 >> v2:172.21.15.167:3300/0 conn(0x7f221c1465d0 msgr2=0x7f221c0b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f2220d53640 1 --2- 172.21.15.1:0/3247155752 >> v2:172.21.15.167:3300/0 conn(0x7f221c1465d0 0x7f221c0b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f2220d53640 1 -- 172.21.15.1:0/3247155752 >> v1:172.21.15.167:6789/0 conn(0x7f221c071d40 legacy=0x7f221c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f2220d53640 1 -- 172.21.15.1:0/3247155752 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0cf790 con 0x7f221c06abe0 2023-12-02T01:30:19.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f221bfff640 1 --2- 172.21.15.1:0/3247155752 >> v2:172.21.15.167:3300/0 conn(0x7f221c1465d0 0x7f221c0b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:19.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.740+0000 7f2220d53640 1 --2- 172.21.15.1:0/3247155752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c06abe0 0x7f221c160d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2214009d90 tx=0x7f221402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde8a905b3c261d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f221affd640 1 -- 172.21.15.1:0/3247155752 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221402cc50 con 0x7f221c06abe0 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f221affd640 1 -- 172.21.15.1:0/3247155752 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221402cdb0 con 0x7f221c06abe0 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f221affd640 1 -- 172.21.15.1:0/3247155752 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214034660 con 0x7f221c06abe0 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 -- 172.21.15.1:0/3247155752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c06abe0 msgr2=0x7f221c160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 --2- 172.21.15.1:0/3247155752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c06abe0 0x7f221c160d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2214009d90 tx=0x7f221402bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 -- 172.21.15.1:0/3247155752 shutdown_connections 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 --2- 172.21.15.1:0/3247155752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c06abe0 0x7f221c160d90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 --2- 172.21.15.1:0/3247155752 >> v2:172.21.15.167:3300/0 conn(0x7f221c1465d0 0x7f221c0b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 -- 172.21.15.1:0/3247155752 >> 172.21.15.1:0/3247155752 conn(0x7f221c0cc930 msgr2=0x7f221c0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 -- 172.21.15.1:0/3247155752 shutdown_connections 2023-12-02T01:30:19.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.741+0000 7f22227b6640 1 -- 172.21.15.1:0/3247155752 wait complete. 2023-12-02T01:30:19.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.742+0000 7f22227b6640 1 Processor -- start 2023-12-02T01:30:19.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.743+0000 7f22227b6640 1 -- start start 2023-12-02T01:30:19.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.743+0000 7f22227b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f221c06abe0 0x7f221c0ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.743+0000 7f22227b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c071d40 0x7f221c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.743+0000 7f22227b6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f221c1465d0 0x7f221c0c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.746 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.743+0000 7f22227b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1f3300 con 0x7f221c06abe0 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.743+0000 7f22227b6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0af1c0 con 0x7f221c1465d0 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.743+0000 7f22227b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0af4a0 con 0x7f221c071d40 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f221c06abe0 0x7f221c0ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f221c06abe0 0x7f221c0ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55064/0 (socket says 172.21.15.1:55064) 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 -- 172.21.15.1:0/1971772577 learned_addr learned my addr 172.21.15.1:0/1971772577 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221b7fe640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c071d40 0x7f221c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f2220d53640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f221c1465d0 0x7f221c0c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 -- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c071d40 msgr2=0x7f221c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c071d40 0x7f221c0c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 -- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f221c1465d0 msgr2=0x7f221c0c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f221c1465d0 0x7f221c0c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 -- 172.21.15.1:0/1971772577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2204009400 con 0x7f221c06abe0 2023-12-02T01:30:19.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f221bfff640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f221c06abe0 0x7f221c0ae7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f220400e960 tx=0x7f220400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f2218ff9640 1 -- 172.21.15.1:0/1971772577 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400ca00 con 0x7f221c06abe0 2023-12-02T01:30:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f2218ff9640 1 -- 172.21.15.1:0/1971772577 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400cb60 con 0x7f221c06abe0 2023-12-02T01:30:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2214009a70 con 0x7f221c06abe0 2023-12-02T01:30:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f2218ff9640 1 -- 172.21.15.1:0/1971772577 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204013470 con 0x7f221c06abe0 2023-12-02T01:30:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.744+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c0afa60 con 0x7f221c06abe0 2023-12-02T01:30:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.745+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c06e6a0 con 0x7f221c06abe0 2023-12-02T01:30:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.746+0000 7f2218ff9640 1 -- 172.21.15.1:0/1971772577 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22040135d0 con 0x7f221c06abe0 2023-12-02T01:30:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.746+0000 7f2218ff9640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f21fc06ae70 0x7f21fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.746+0000 7f2218ff9640 1 -- 172.21.15.1:0/1971772577 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2204089770 con 0x7f221c06abe0 2023-12-02T01:30:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.746+0000 7f221b7fe640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f21fc06ae70 0x7f21fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.747+0000 7f221b7fe640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f21fc06ae70 0x7f21fc06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f221c142010 tx=0x7f220c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:19.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.750+0000 7f2218ff9640 1 -- 172.21.15.1:0/1971772577 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22040548d0 con 0x7f221c06abe0 2023-12-02T01:30:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.924+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f221c04e920 con 0x7f221c06abe0 2023-12-02T01:30:19.925 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.924+0000 7f2218ff9640 1 -- 172.21.15.1:0/1971772577 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2204057ef0 con 0x7f221c06abe0 2023-12-02T01:30:19.926 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f21fc06ae70 msgr2=0x7f21fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f21fc06ae70 0x7f21fc06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f221c142010 tx=0x7f220c009040 comp rx=0 tx=0).stop 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f221c06abe0 msgr2=0x7f221c0ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f221c06abe0 0x7f221c0ae7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f220400e960 tx=0x7f220400ee20 comp rx=0 tx=0).stop 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 shutdown_connections 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f21fc06ae70 0x7f21fc06d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f221c1465d0 0x7f221c0c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221c071d40 0x7f221c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 --2- 172.21.15.1:0/1971772577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f221c06abe0 0x7f221c0ae7e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 >> 172.21.15.1:0/1971772577 conn(0x7f221c0cc930 msgr2=0x7f221c1605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 shutdown_connections 2023-12-02T01:30:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:19.926+0000 7f22227b6640 1 -- 172.21.15.1:0/1971772577 wait complete. 2023-12-02T01:30:19.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.046+0000 7faf72c56640 1 Processor -- start 2023-12-02T01:30:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.046+0000 7faf72c56640 1 -- start start 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf72c56640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7faf6c0b6b50 0x7faf6c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf72c56640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c0b3590 con 0x7faf6c099970 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf72c56640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c06b310 con 0x7faf6c06bc50 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf72c56640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c0cd3a0 con 0x7faf6c0b6b50 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf709f2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7faf6c0b6b50 0x7faf6c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf6bfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7faf6c099970 0x7faf6c099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45634/0 (socket says 172.21.15.1:45634) 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf6bfff640 1 -- 172.21.15.1:0/3997546521 learned_addr learned my addr 172.21.15.1:0/3997546521 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf709f2640 1 -- 172.21.15.1:0/3997546521 >> v1:172.21.15.167:6789/0 conn(0x7faf6c06bc50 legacy=0x7faf6c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf709f2640 1 -- 172.21.15.1:0/3997546521 >> v1:172.21.15.1:6789/0 conn(0x7faf6c099970 legacy=0x7faf6c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf6b7fe640 1 -- 172.21.15.1:0/3997546521 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427082534 0 0) 0x7faf6c0b3590 con 0x7faf6c099970 2023-12-02T01:30:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.047+0000 7faf709f2640 1 -- 172.21.15.1:0/3997546521 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0b37c0 con 0x7faf6c0b6b50 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.048+0000 7faf709f2640 1 --2- 172.21.15.1:0/3997546521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c0b6b50 0x7faf6c0cfd40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0097a0 tx=0x7faf5c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e252696197d401d server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.048+0000 7faf6b7fe640 1 -- 172.21.15.1:0/3997546521 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c030610 con 0x7faf6c0b6b50 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.048+0000 7faf6b7fe640 1 -- 172.21.15.1:0/3997546521 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c030770 con 0x7faf6c0b6b50 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.048+0000 7faf6b7fe640 1 -- 172.21.15.1:0/3997546521 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c030b00 con 0x7faf6c0b6b50 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.049+0000 7faf72c56640 1 -- 172.21.15.1:0/3997546521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c0b6b50 msgr2=0x7faf6c0cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.049+0000 7faf72c56640 1 --2- 172.21.15.1:0/3997546521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c0b6b50 0x7faf6c0cfd40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0097a0 tx=0x7faf5c02b960 comp rx=0 tx=0).stop 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.049+0000 7faf72c56640 1 -- 172.21.15.1:0/3997546521 shutdown_connections 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.049+0000 7faf72c56640 1 --2- 172.21.15.1:0/3997546521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c0b6b50 0x7faf6c0cfd40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.049+0000 7faf72c56640 1 -- 172.21.15.1:0/3997546521 >> 172.21.15.1:0/3997546521 conn(0x7faf6c0b2a70 msgr2=0x7faf6c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.049+0000 7faf72c56640 1 -- 172.21.15.1:0/3997546521 shutdown_connections 2023-12-02T01:30:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.049+0000 7faf72c56640 1 -- 172.21.15.1:0/3997546521 wait complete. 2023-12-02T01:30:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.050+0000 7faf72c56640 1 Processor -- start 2023-12-02T01:30:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.050+0000 7faf72c56640 1 -- start start 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf72c56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c06bc50 0x7faf6c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf72c56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf6c099970 0x7faf6c0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf72c56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf6c0b6b50 0x7faf6c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf72c56640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0b4a80 con 0x7faf6c06bc50 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf72c56640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c158cc0 con 0x7faf6c099970 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf72c56640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c158fa0 con 0x7faf6c0b6b50 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c06bc50 0x7faf6c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c06bc50 0x7faf6c0b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55086/0 (socket says 172.21.15.1:55086) 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 -- 172.21.15.1:0/3555716096 learned_addr learned my addr 172.21.15.1:0/3555716096 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 -- 172.21.15.1:0/3555716096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf6c0b6b50 msgr2=0x7faf6c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf6c0b6b50 0x7faf6c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 -- 172.21.15.1:0/3555716096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf6c099970 msgr2=0x7faf6c0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf6c099970 0x7faf6c0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.051+0000 7faf709f2640 1 -- 172.21.15.1:0/3555716096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009400 con 0x7faf6c06bc50 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.052+0000 7faf709f2640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c06bc50 0x7faf6c0b1530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0098c0 tx=0x7faf5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.052+0000 7faf697fa640 1 -- 172.21.15.1:0/3555716096 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c03e070 con 0x7faf6c06bc50 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.052+0000 7faf697fa640 1 -- 172.21.15.1:0/3555716096 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c039a10 con 0x7faf6c06bc50 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.052+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c0b4cd0 con 0x7faf6c06bc50 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.052+0000 7faf697fa640 1 -- 172.21.15.1:0/3555716096 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c039da0 con 0x7faf6c06bc50 2023-12-02T01:30:20.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.052+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c0b1a70 con 0x7faf6c06bc50 2023-12-02T01:30:20.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.053+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c0b51f0 con 0x7faf6c06bc50 2023-12-02T01:30:20.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.053+0000 7faf697fa640 1 -- 172.21.15.1:0/3555716096 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf5c04b400 con 0x7faf6c06bc50 2023-12-02T01:30:20.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.053+0000 7faf697fa640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faf5806ae40 0x7faf5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.054+0000 7faf697fa640 1 -- 172.21.15.1:0/3555716096 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf5c0aba70 con 0x7faf6c06bc50 2023-12-02T01:30:20.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.054+0000 7faf6bfff640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faf5806ae40 0x7faf5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.054+0000 7faf6bfff640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faf5806ae40 0x7faf5806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf60007fd0 tx=0x7faf60007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.058+0000 7faf697fa640 1 -- 172.21.15.1:0/3555716096 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf5c076bb0 con 0x7faf6c06bc50 2023-12-02T01:30:20.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.233+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf6c06ef50 con 0x7faf6c06bc50 2023-12-02T01:30:20.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.234+0000 7faf697fa640 1 -- 172.21.15.1:0/3555716096 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf5c0340a0 con 0x7faf6c06bc50 2023-12-02T01:30:20.236 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:20.237 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faf5806ae40 msgr2=0x7faf5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faf5806ae40 0x7faf5806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf60007fd0 tx=0x7faf60007920 comp rx=0 tx=0).stop 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c06bc50 msgr2=0x7faf6c0b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c06bc50 0x7faf6c0b1530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0098c0 tx=0x7faf5c0046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 shutdown_connections 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faf6c0b6b50 0x7faf6c15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7faf5806ae40 0x7faf5806d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf6c099970 0x7faf6c0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 --2- 172.21.15.1:0/3555716096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf6c06bc50 0x7faf6c0b1530 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 >> 172.21.15.1:0/3555716096 conn(0x7faf6c0b2a70 msgr2=0x7faf6c06ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 shutdown_connections 2023-12-02T01:30:20.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.236+0000 7faf72c56640 1 -- 172.21.15.1:0/3555716096 wait complete. 2023-12-02T01:30:20.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:20.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.354+0000 7fb134f97640 1 Processor -- start 2023-12-02T01:30:20.356 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.354+0000 7fb134f97640 1 -- start start 2023-12-02T01:30:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.355+0000 7fb134f97640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1300cfd50 0x7fb1300cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.355+0000 7fb134f97640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1300cc080 con 0x7fb13006fd30 2023-12-02T01:30:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.355+0000 7fb134f97640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1300ccec0 con 0x7fb13009a080 2023-12-02T01:30:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.355+0000 7fb134f97640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb130070110 con 0x7fb1300cfd50 2023-12-02T01:30:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.355+0000 7fb12e59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb13006fd30 0x7fb130099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45638/0 (socket says 172.21.15.1:45638) 2023-12-02T01:30:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12e59c640 1 -- 172.21.15.1:0/1622930077 learned_addr learned my addr 172.21.15.1:0/1622930077 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12ed9d640 1 --2- 172.21.15.1:0/1622930077 >> v2:172.21.15.167:3300/0 conn(0x7fb1300cfd50 0x7fb1300cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294629117 0 0) 0x7fb1300cc080 con 0x7fb13006fd30 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb11c003520 con 0x7fb13006fd30 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785780045 0 0) 0x7fb1300ccec0 con 0x7fb13009a080 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1300cc080 con 0x7fb13009a080 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 697010713 0 0) 0x7fb11c003520 con 0x7fb13006fd30 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 >> v2:172.21.15.167:3300/0 conn(0x7fb1300cfd50 msgr2=0x7fb1300cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 --2- 172.21.15.1:0/1622930077 >> v2:172.21.15.167:3300/0 conn(0x7fb1300cfd50 0x7fb1300cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 >> v1:172.21.15.167:6789/0 conn(0x7fb13009a080 legacy=0x7fb13015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300cc2b0 con 0x7fb13006fd30 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fb128001670 con 0x7fb13006fd30 2023-12-02T01:30:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 >> v1:172.21.15.1:6789/0 conn(0x7fb13006fd30 legacy=0x7fb130099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb11c003b50 0x7fb11c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb11c0047c0 0x7fb11c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0051d0 0x7fb11c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb130070110 con 0x7fb11c0047c0 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c00c100 con 0x7fb11c003b50 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c00c2c0 con 0x7fb11c0051d0 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12dd9b640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb11c0047c0 0x7fb11c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.356+0000 7fb12e59c640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb11c003b50 0x7fb11c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12ed9d640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0051d0 0x7fb11c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12dd9b640 1 -- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0051d0 msgr2=0x7fb11c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12dd9b640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0051d0 0x7fb11c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12dd9b640 1 -- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb11c003b50 msgr2=0x7fb11c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12dd9b640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb11c003b50 0x7fb11c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12dd9b640 1 -- 172.21.15.1:0/1622930077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c003520 con 0x7fb11c0047c0 2023-12-02T01:30:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12e59c640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb11c003b50 0x7fb11c003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12ed9d640 1 -- 172.21.15.1:0/1622930077 reap_dead start 2023-12-02T01:30:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12dd9b640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb11c0047c0 0x7fb11c004c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1180018d0 tx=0x7fb11c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3a11c28be068bf server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180052d0 con 0x7fb11c0047c0 2023-12-02T01:30:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.357+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb118005430 con 0x7fb11c0047c0 2023-12-02T01:30:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb12d59a640 1 -- 172.21.15.1:0/1622930077 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118003810 con 0x7fb11c0047c0 2023-12-02T01:30:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb134f97640 1 -- 172.21.15.1:0/1622930077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb11c0047c0 msgr2=0x7fb11c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb134f97640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb11c0047c0 0x7fb11c004c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1180018d0 tx=0x7fb11c0057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb134f97640 1 -- 172.21.15.1:0/1622930077 shutdown_connections 2023-12-02T01:30:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb134f97640 1 --2- 172.21.15.1:0/1622930077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb11c0047c0 0x7fb11c004c40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb134f97640 1 -- 172.21.15.1:0/1622930077 >> 172.21.15.1:0/1622930077 conn(0x7fb1300b2a20 msgr2=0x7fb1300b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb134f97640 1 -- 172.21.15.1:0/1622930077 shutdown_connections 2023-12-02T01:30:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.358+0000 7fb134f97640 1 -- 172.21.15.1:0/1622930077 wait complete. 2023-12-02T01:30:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.359+0000 7fb134f97640 1 Processor -- start 2023-12-02T01:30:20.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb134f97640 1 -- start start 2023-12-02T01:30:20.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb134f97640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0047c0 0x7fb1300c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb134f97640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1300c6ae0 0x7fb1300c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb134f97640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb130158a20 0x7fb1300c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb134f97640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300c51c0 con 0x7fb1300c6ae0 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb134f97640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300c59f0 con 0x7fb130158a20 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb134f97640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb130158eb0 con 0x7fb11c0047c0 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb12dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1300c6ae0 0x7fb1300c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb12dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1300c6ae0 0x7fb1300c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55090/0 (socket says 172.21.15.1:55090) 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.360+0000 7fb12dd9b640 1 -- 172.21.15.1:0/3097439863 learned_addr learned my addr 172.21.15.1:0/3097439863 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12e59c640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0047c0 0x7fb1300c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.371 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12ed9d640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb130158a20 0x7fb1300c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12dd9b640 1 -- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0047c0 msgr2=0x7fb1300c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12dd9b640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0047c0 0x7fb1300c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12dd9b640 1 -- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb130158a20 msgr2=0x7fb1300c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12dd9b640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb130158a20 0x7fb1300c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12dd9b640 1 -- 172.21.15.1:0/3097439863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300c6f80 con 0x7fb1300c6ae0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12ed9d640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb130158a20 0x7fb1300c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb12dd9b640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1300c6ae0 0x7fb1300c5e80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb118035040 tx=0x7fb1180012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb126ffd640 1 -- 172.21.15.1:0/3097439863 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118007250 con 0x7fb1300c6ae0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb126ffd640 1 -- 172.21.15.1:0/3097439863 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1180073b0 con 0x7fb1300c6ae0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1300c53a0 con 0x7fb1300c6ae0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb126ffd640 1 -- 172.21.15.1:0/3097439863 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118007720 con 0x7fb1300c6ae0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.361+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1301597c0 con 0x7fb1300c6ae0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.362+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb130067940 con 0x7fb1300c6ae0 2023-12-02T01:30:20.372 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.363+0000 7fb126ffd640 1 -- 172.21.15.1:0/3097439863 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1180035f0 con 0x7fb1300c6ae0 2023-12-02T01:30:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.363+0000 7fb126ffd640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb11006ae40 0x7fb11006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.363+0000 7fb126ffd640 1 -- 172.21.15.1:0/3097439863 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1180aaf90 con 0x7fb1300c6ae0 2023-12-02T01:30:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.363+0000 7fb12e59c640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb11006ae40 0x7fb11006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.363+0000 7fb12e59c640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb11006ae40 0x7fb11006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb128001eb0 tx=0x7fb128007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.373 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.367+0000 7fb126ffd640 1 -- 172.21.15.1:0/3097439863 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1180dde90 con 0x7fb1300c6ae0 2023-12-02T01:30:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.557+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1300c7260 con 0x7fb1300c6ae0 2023-12-02T01:30:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.557+0000 7fb126ffd640 1 -- 172.21.15.1:0/3097439863 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb118076070 con 0x7fb1300c6ae0 2023-12-02T01:30:20.559 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb11006ae40 msgr2=0x7fb11006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb11006ae40 0x7fb11006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb128001eb0 tx=0x7fb128007040 comp rx=0 tx=0).stop 2023-12-02T01:30:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1300c6ae0 msgr2=0x7fb1300c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1300c6ae0 0x7fb1300c5e80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb118035040 tx=0x7fb1180012d0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 shutdown_connections 2023-12-02T01:30:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb11006ae40 0x7fb11006d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb130158a20 0x7fb1300c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1300c6ae0 0x7fb1300c5e80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 --2- 172.21.15.1:0/3097439863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb11c0047c0 0x7fb1300c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 >> 172.21.15.1:0/3097439863 conn(0x7fb1300b2a20 msgr2=0x7fb1300b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:20.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 shutdown_connections 2023-12-02T01:30:20.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.559+0000 7fb134f97640 1 -- 172.21.15.1:0/3097439863 wait complete. 2023-12-02T01:30:20.571 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2023-12-02T01:30:20.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:20.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-02T01:30:20.605 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:20.605 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:30:20.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:20.605 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-02T01:30:20.736 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:30:20.736 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:20.752 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:30:20.752 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:20.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.953+0000 7f02f78ad640 1 Processor -- start 2023-12-02T01:30:20.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.953+0000 7f02f78ad640 1 -- start start 2023-12-02T01:30:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f78ad640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02f00d1720 0x7f02f00d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f78ad640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f02f00b3db0 0x7f02f00b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.958 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f78ad640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f00b5f90 con 0x7f02f015d3e0 2023-12-02T01:30:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f78ad640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f00d20a0 con 0x7f02f00d1720 2023-12-02T01:30:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f78ad640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f00b61e0 con 0x7f02f00b3db0 2023-12-02T01:30:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f4e48640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f02f00d1720 0x7f02f00d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f5649640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f02f015d3e0 0x7f02f00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45654/0 (socket says 172.21.15.1:45654) 2023-12-02T01:30:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.954+0000 7f02f5649640 1 -- 172.21.15.1:0/4140540767 learned_addr learned my addr 172.21.15.1:0/4140540767 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.955+0000 7f02f5e4a640 1 --2- 172.21.15.1:0/4140540767 >> v2:172.21.15.167:3300/0 conn(0x7f02f00b3db0 0x7f02f00b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.955+0000 7f02f4e48640 1 -- 172.21.15.1:0/4140540767 >> v2:172.21.15.167:3300/0 conn(0x7f02f00b3db0 msgr2=0x7f02f00b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.955+0000 7f02f4e48640 1 --2- 172.21.15.1:0/4140540767 >> v2:172.21.15.167:3300/0 conn(0x7f02f00b3db0 0x7f02f00b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.955+0000 7f02f4e48640 1 -- 172.21.15.1:0/4140540767 >> v1:172.21.15.1:6789/0 conn(0x7f02f015d3e0 legacy=0x7f02f00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.955+0000 7f02f4e48640 1 -- 172.21.15.1:0/4140540767 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00b64c0 con 0x7f02f00d1720 2023-12-02T01:30:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.955+0000 7f02effff640 1 -- 172.21.15.1:0/4140540767 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158607645 0 0) 0x7f02f00b5f90 con 0x7f02f015d3e0 2023-12-02T01:30:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f4e48640 1 --2- 172.21.15.1:0/4140540767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00d1b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f02f00cdc30 tx=0x7f02e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da98a3944bd7b724 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02effff640 1 -- 172.21.15.1:0/4140540767 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4031830 con 0x7f02f00d1720 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02effff640 1 -- 172.21.15.1:0/4140540767 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e4031990 con 0x7f02f00d1720 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02effff640 1 -- 172.21.15.1:0/4140540767 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4031d20 con 0x7f02f00d1720 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 -- 172.21.15.1:0/4140540767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 msgr2=0x7f02f00d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 --2- 172.21.15.1:0/4140540767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00d1b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f02f00cdc30 tx=0x7f02e402b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 -- 172.21.15.1:0/4140540767 shutdown_connections 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 --2- 172.21.15.1:0/4140540767 >> v2:172.21.15.167:3300/0 conn(0x7f02f00b3db0 0x7f02f00b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 --2- 172.21.15.1:0/4140540767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00d1b60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 -- 172.21.15.1:0/4140540767 >> 172.21.15.1:0/4140540767 conn(0x7f02f009c480 msgr2=0x7f02f00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 -- 172.21.15.1:0/4140540767 shutdown_connections 2023-12-02T01:30:20.962 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.956+0000 7f02f78ad640 1 -- 172.21.15.1:0/4140540767 wait complete. 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 Processor -- start 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 -- start start 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f00b3db0 0x7f02f0150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f015d3e0 0x7f02f015fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00afd70 con 0x7f02f00d1720 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00affc0 con 0x7f02f00b3db0 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f78ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00b02a0 con 0x7f02f015d3e0 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f4e48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f4e48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55098/0 (socket says 172.21.15.1:55098) 2023-12-02T01:30:20.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.958+0000 7f02f4e48640 1 -- 172.21.15.1:0/650211754 learned_addr learned my addr 172.21.15.1:0/650211754 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f5649640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f00b3db0 0x7f02f0150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f4e48640 1 -- 172.21.15.1:0/650211754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f015d3e0 msgr2=0x7f02f015fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f4e48640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f015d3e0 0x7f02f015fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f4e48640 1 -- 172.21.15.1:0/650211754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f00b3db0 msgr2=0x7f02f0150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f4e48640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f00b3db0 0x7f02f0150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f4e48640 1 -- 172.21.15.1:0/650211754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e4009400 con 0x7f02f00d1720 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f4e48640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00b3470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009890 tx=0x7f02e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02edffb640 1 -- 172.21.15.1:0/650211754 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e403ba70 con 0x7f02f00d1720 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02edffb640 1 -- 172.21.15.1:0/650211754 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e403bbf0 con 0x7f02f00d1720 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f00b0580 con 0x7f02f00d1720 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02edffb640 1 -- 172.21.15.1:0/650211754 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4045400 con 0x7f02f00d1720 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.959+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f00b0b40 con 0x7f02f00d1720 2023-12-02T01:30:20.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.960+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f0067420 con 0x7f02f00d1720 2023-12-02T01:30:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.961+0000 7f02edffb640 1 -- 172.21.15.1:0/650211754 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02e404e440 con 0x7f02f00d1720 2023-12-02T01:30:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.961+0000 7f02edffb640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02dc06ae40 0x7f02dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.961+0000 7f02edffb640 1 -- 172.21.15.1:0/650211754 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02e40ab8e0 con 0x7f02f00d1720 2023-12-02T01:30:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.961+0000 7f02f5649640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02dc06ae40 0x7f02dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.962+0000 7f02f5649640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02dc06ae40 0x7f02dc06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f02e8000f60 tx=0x7f02e8007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:20.968 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:20.966+0000 7f02edffb640 1 -- 172.21.15.1:0/650211754 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f02e4076a20 con 0x7f02f00d1720 2023-12-02T01:30:21.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.141+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02f00d1500 con 0x7f02f00d1720 2023-12-02T01:30:21.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.143+0000 7f02edffb640 1 -- 172.21.15.1:0/650211754 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f02e407a040 con 0x7f02f00d1720 2023-12-02T01:30:21.144 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:21.145 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:21.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02dc06ae40 msgr2=0x7f02dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02dc06ae40 0x7f02dc06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f02e8000f60 tx=0x7f02e8007b50 comp rx=0 tx=0).stop 2023-12-02T01:30:21.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 msgr2=0x7f02f00b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00b3470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009890 tx=0x7f02e40046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 shutdown_connections 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f015d3e0 0x7f02f015fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f00d1720 0x7f02f00b3470 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f02dc06ae40 0x7f02dc06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.144+0000 7f02f78ad640 1 --2- 172.21.15.1:0/650211754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f00b3db0 0x7f02f0150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.145+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 >> 172.21.15.1:0/650211754 conn(0x7f02f009c480 msgr2=0x7f02f00d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.145+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 shutdown_connections 2023-12-02T01:30:21.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.145+0000 7f02f78ad640 1 -- 172.21.15.1:0/650211754 wait complete. 2023-12-02T01:30:21.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:21.158 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:21.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.265+0000 7f35cf59e640 1 Processor -- start 2023-12-02T01:30:21.267 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.265+0000 7f35cf59e640 1 -- start start 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35cf59e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35d013df90 0x7f35d015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35cf59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d00cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35cf59e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35d00ce1f0 0x7f35d015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35cf59e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d006a4d0 con 0x7f35d013df90 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35cf59e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d015f420 con 0x7f35d00ce1f0 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35cf59e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d013e370 con 0x7f35d015efc0 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35ce59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35d013df90 0x7f35d015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35ce59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f35d013df90 0x7f35d015ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55100/0 (socket says 172.21.15.1:55100) 2023-12-02T01:30:21.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35ce59c640 1 -- 172.21.15.1:0/4039438300 learned_addr learned my addr 172.21.15.1:0/4039438300 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35cdd9b640 1 --2- 172.21.15.1:0/4039438300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d00cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35ced9d640 1 --2- 172.21.15.1:0/4039438300 >> v2:172.21.15.167:3300/0 conn(0x7f35d00ce1f0 0x7f35d015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35ce59c640 1 -- 172.21.15.1:0/4039438300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 msgr2=0x7f35d00cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.266+0000 7f35ce59c640 1 --2- 172.21.15.1:0/4039438300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d00cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.267+0000 7f35ce59c640 1 -- 172.21.15.1:0/4039438300 >> v2:172.21.15.167:3300/0 conn(0x7f35d00ce1f0 msgr2=0x7f35d015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.267+0000 7f35ce59c640 1 --2- 172.21.15.1:0/4039438300 >> v2:172.21.15.167:3300/0 conn(0x7f35d00ce1f0 0x7f35d015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.267+0000 7f35ce59c640 1 -- 172.21.15.1:0/4039438300 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00ceac0 con 0x7f35d013df90 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.267+0000 7f35ce59c640 1 --2- 172.21.15.1:0/4039438300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d015ea80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f35d0070980 tx=0x7f35c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6010eeb06f0ab9a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.267+0000 7f35cd59a640 1 -- 172.21.15.1:0/4039438300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0031870 con 0x7f35d013df90 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.267+0000 7f35cd59a640 1 -- 172.21.15.1:0/4039438300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c00319d0 con 0x7f35d013df90 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.267+0000 7f35cd59a640 1 -- 172.21.15.1:0/4039438300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0031d60 con 0x7f35d013df90 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 -- 172.21.15.1:0/4039438300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 msgr2=0x7f35d015ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 --2- 172.21.15.1:0/4039438300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d015ea80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f35d0070980 tx=0x7f35c002b910 comp rx=0 tx=0).stop 2023-12-02T01:30:21.271 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 -- 172.21.15.1:0/4039438300 shutdown_connections 2023-12-02T01:30:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 --2- 172.21.15.1:0/4039438300 >> v2:172.21.15.167:3300/0 conn(0x7f35d00ce1f0 0x7f35d015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 --2- 172.21.15.1:0/4039438300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d00cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 --2- 172.21.15.1:0/4039438300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d015ea80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 -- 172.21.15.1:0/4039438300 >> 172.21.15.1:0/4039438300 conn(0x7f35d00b17b0 msgr2=0x7f35d00cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 -- 172.21.15.1:0/4039438300 shutdown_connections 2023-12-02T01:30:21.272 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.268+0000 7f35cf59e640 1 -- 172.21.15.1:0/4039438300 wait complete. 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.269+0000 7f35cf59e640 1 Processor -- start 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.269+0000 7f35cf59e640 1 -- start start 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cf59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d00ce1f0 0x7f35d0153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cf59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d0155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cf59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cf59e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d006cbf0 con 0x7f35d013df90 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cf59e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0156480 con 0x7f35d00ce1f0 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cf59e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0156760 con 0x7f35d015efc0 2023-12-02T01:30:21.275 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cdd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d0155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cdd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d0155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55112/0 (socket says 172.21.15.1:55112) 2023-12-02T01:30:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.270+0000 7f35cdd9b640 1 -- 172.21.15.1:0/1818486455 learned_addr learned my addr 172.21.15.1:0/1818486455 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35ce59c640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d00ce1f0 0x7f35d0153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35ced9d640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cdd9b640 1 -- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 msgr2=0x7f35d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cdd9b640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.276 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cdd9b640 1 -- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d00ce1f0 msgr2=0x7f35d0153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cdd9b640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d00ce1f0 0x7f35d0153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cdd9b640 1 -- 172.21.15.1:0/1818486455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00094d0 con 0x7f35d013df90 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35ce59c640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d00ce1f0 0x7f35d0153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35ced9d640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cdd9b640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d0155b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35c400e870 tx=0x7f35c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35beffd640 1 -- 172.21.15.1:0/1818486455 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40094f0 con 0x7f35d013df90 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35beffd640 1 -- 172.21.15.1:0/1818486455 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400c940 con 0x7f35d013df90 2023-12-02T01:30:21.277 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35beffd640 1 -- 172.21.15.1:0/1818486455 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400ccf0 con 0x7f35d013df90 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d006c810 con 0x7f35d013df90 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.271+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d0156050 con 0x7f35d013df90 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.272+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d0067630 con 0x7f35d013df90 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.273+0000 7f35beffd640 1 -- 172.21.15.1:0/1818486455 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35c4013470 con 0x7f35d013df90 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.273+0000 7f35beffd640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f35b006ae40 0x7f35b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.273+0000 7f35beffd640 1 -- 172.21.15.1:0/1818486455 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35c4089640 con 0x7f35d013df90 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.273+0000 7f35ce59c640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f35b006ae40 0x7f35b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.274+0000 7f35ce59c640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f35b006ae40 0x7f35b006d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35c0036000 tx=0x7f35c003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.279 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.277+0000 7f35beffd640 1 -- 172.21.15.1:0/1818486455 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35c4054780 con 0x7f35d013df90 2023-12-02T01:30:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.451+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35d004e840 con 0x7f35d013df90 2023-12-02T01:30:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.451+0000 7f35beffd640 1 -- 172.21.15.1:0/1818486455 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35c4057da0 con 0x7f35d013df90 2023-12-02T01:30:21.453 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f35b006ae40 msgr2=0x7f35b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f35b006ae40 0x7f35b006d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35c0036000 tx=0x7f35c003c040 comp rx=0 tx=0).stop 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 msgr2=0x7f35d0155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d0155b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35c400e870 tx=0x7f35c400ed30 comp rx=0 tx=0).stop 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 shutdown_connections 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35d015efc0 0x7f35d015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35d013df90 0x7f35d0155b10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f35b006ae40 0x7f35b006d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 --2- 172.21.15.1:0/1818486455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35d00ce1f0 0x7f35d0153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 >> 172.21.15.1:0/1818486455 conn(0x7f35d00b17b0 msgr2=0x7f35d00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 shutdown_connections 2023-12-02T01:30:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.453+0000 7f35cf59e640 1 -- 172.21.15.1:0/1818486455 wait complete. 2023-12-02T01:30:21.465 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:21.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.572+0000 7fbbd7f00640 1 Processor -- start 2023-12-02T01:30:21.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.573+0000 7fbbd7f00640 1 -- start start 2023-12-02T01:30:21.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.573+0000 7fbbd7f00640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbbd0160b70 0x7fbbd00d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.573+0000 7fbbd7f00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00cef00 0x7fbbd0161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.573+0000 7fbbd7f00640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd00ce360 con 0x7fbbd00b2aa0 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.573+0000 7fbbd7f00640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00b2f20 con 0x7fbbd0160b70 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.573+0000 7fbbd7f00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00cdd50 con 0x7fbbd00cef00 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd5c9c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbbd0160b70 0x7fbbd00d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd5c9c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbbd0160b70 0x7fbbd00d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34652/0 (socket says 172.21.15.1:34652) 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd5c9c640 1 -- 172.21.15.1:0/862387606 learned_addr learned my addr 172.21.15.1:0/862387606 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd549b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbbd00b2aa0 0x7fbbd00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51178/0 (socket says 172.21.15.1:51178) 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd649d640 1 --2- 172.21.15.1:0/862387606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00cef00 0x7fbbd0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd5c9c640 1 -- 172.21.15.1:0/862387606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00cef00 msgr2=0x7fbbd0161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd5c9c640 1 --2- 172.21.15.1:0/862387606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00cef00 0x7fbbd0161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd5c9c640 1 -- 172.21.15.1:0/862387606 >> v1:172.21.15.1:6789/0 conn(0x7fbbd00b2aa0 legacy=0x7fbbd00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd5c9c640 1 -- 172.21.15.1:0/862387606 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00d1c70 con 0x7fbbd0160b70 2023-12-02T01:30:21.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.574+0000 7fbbd4c9a640 1 -- 172.21.15.1:0/862387606 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438909687 0 0) 0x7fbbd00ce360 con 0x7fbbd00b2aa0 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd5c9c640 1 --2- 172.21.15.1:0/862387606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd0160b70 0x7fbbd00d1570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991bc00a754d4b21 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd4c9a640 1 -- 172.21.15.1:0/862387606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc030840 con 0x7fbbd0160b70 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd4c9a640 1 -- 172.21.15.1:0/862387606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc0309a0 con 0x7fbbd0160b70 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd4c9a640 1 -- 172.21.15.1:0/862387606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc030d30 con 0x7fbbd0160b70 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd7f00640 1 -- 172.21.15.1:0/862387606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd0160b70 msgr2=0x7fbbd00d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/862387606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd0160b70 0x7fbbd00d1570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc02b980 comp rx=0 tx=0).stop 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd7f00640 1 -- 172.21.15.1:0/862387606 shutdown_connections 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/862387606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00cef00 0x7fbbd0161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/862387606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd0160b70 0x7fbbd00d1570 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.575+0000 7fbbd7f00640 1 -- 172.21.15.1:0/862387606 >> 172.21.15.1:0/862387606 conn(0x7fbbd009c470 msgr2=0x7fbbd00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.576+0000 7fbbd7f00640 1 -- 172.21.15.1:0/862387606 shutdown_connections 2023-12-02T01:30:21.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.576+0000 7fbbd7f00640 1 -- 172.21.15.1:0/862387606 wait complete. 2023-12-02T01:30:21.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 Processor -- start 2023-12-02T01:30:21.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 -- start start 2023-12-02T01:30:21.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00b2aa0 0x7fbbd01f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd00cef00 0x7fbbd009f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbd0160b70 0x7fbbd015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.581 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0149520 con 0x7fbbd00cef00 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd01f4af0 con 0x7fbbd0160b70 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.577+0000 7fbbd7f00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd01488a0 con 0x7fbbd00b2aa0 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd00cef00 0x7fbbd009f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd00cef00 0x7fbbd009f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34662/0 (socket says 172.21.15.1:34662) 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 -- 172.21.15.1:0/762359794 learned_addr learned my addr 172.21.15.1:0/762359794 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd5c9c640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00b2aa0 0x7fbbd01f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd649d640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbd0160b70 0x7fbbd015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 -- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00b2aa0 msgr2=0x7fbbd01f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00b2aa0 0x7fbbd01f45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 -- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbd0160b70 msgr2=0x7fbbd015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbd0160b70 0x7fbbd015ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 -- 172.21.15.1:0/762359794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0094d0 con 0x7fbbd00cef00 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd549b640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd00cef00 0x7fbbd009f940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c430 tx=0x7fbbc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbc67fc640 1 -- 172.21.15.1:0/762359794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00074e0 con 0x7fbbd00cef00 2023-12-02T01:30:21.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbc67fc640 1 -- 172.21.15.1:0/762359794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc0007660 con 0x7fbbd00cef00 2023-12-02T01:30:21.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd0148b80 con 0x7fbbd00cef00 2023-12-02T01:30:21.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbc67fc640 1 -- 172.21.15.1:0/762359794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0004a20 con 0x7fbbd00cef00 2023-12-02T01:30:21.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.578+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd0149140 con 0x7fbbd00cef00 2023-12-02T01:30:21.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.579+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd0149660 con 0x7fbbd00cef00 2023-12-02T01:30:21.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.580+0000 7fbbc67fc640 1 -- 172.21.15.1:0/762359794 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbc0004b80 con 0x7fbbd00cef00 2023-12-02T01:30:21.583 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.580+0000 7fbbc67fc640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbbb406ae70 0x7fbbb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.580+0000 7fbbc67fc640 1 -- 172.21.15.1:0/762359794 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc0089390 con 0x7fbbd00cef00 2023-12-02T01:30:21.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.580+0000 7fbbd5c9c640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbbb406ae70 0x7fbbb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.584 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.581+0000 7fbbd5c9c640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbbb406ae70 0x7fbbb406d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc036000 tx=0x7fbbcc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.586 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.584+0000 7fbbc67fc640 1 -- 172.21.15.1:0/762359794 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbd0149660 con 0x7fbbd00cef00 2023-12-02T01:30:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.760+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbd0149660 con 0x7fbbd00cef00 2023-12-02T01:30:21.762 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.761+0000 7fbbc67fc640 1 -- 172.21.15.1:0/762359794 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbd0149660 con 0x7fbbd00cef00 2023-12-02T01:30:21.762 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbbb406ae70 msgr2=0x7fbbb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbbb406ae70 0x7fbbb406d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc036000 tx=0x7fbbcc008030 comp rx=0 tx=0).stop 2023-12-02T01:30:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd00cef00 msgr2=0x7fbbd009f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd00cef00 0x7fbbd009f940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c430 tx=0x7fbbc000c8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 shutdown_connections 2023-12-02T01:30:21.764 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbbb406ae70 0x7fbbb406d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbd0160b70 0x7fbbd015ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbbd00cef00 0x7fbbd009f940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 --2- 172.21.15.1:0/762359794 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbd00b2aa0 0x7fbbd01f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 >> 172.21.15.1:0/762359794 conn(0x7fbbd009c470 msgr2=0x7fbbd00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.762+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 shutdown_connections 2023-12-02T01:30:21.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.763+0000 7fbbd7f00640 1 -- 172.21.15.1:0/762359794 wait complete. 2023-12-02T01:30:21.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:21.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.882+0000 7fa41541e640 1 Processor -- start 2023-12-02T01:30:21.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.882+0000 7fa41541e640 1 -- start start 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.883+0000 7fa41541e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa41009a080 0x7fa4100cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.883+0000 7fa41541e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4100cf470 0x7fa4100b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.883+0000 7fa41541e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4100cfca0 con 0x7fa41015d8d0 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.883+0000 7fa41541e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100b0720 con 0x7fa41009a080 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.883+0000 7fa41541e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100b0a00 con 0x7fa4100cf470 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4100cf470 0x7fa4100b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40e7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa41009a080 0x7fa4100cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40effd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa41015d8d0 0x7fa410099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:54310/0 (socket says 172.21.15.1:54310) 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40e7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa41009a080 0x7fa4100cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:57706/0 (socket says 172.21.15.1:57706) 2023-12-02T01:30:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4100cf470 0x7fa4100b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:56598/0 (socket says 172.21.15.1:56598) 2023-12-02T01:30:21.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40effd640 1 -- 172.21.15.1:0/2226450704 learned_addr learned my addr 172.21.15.1:0/2226450704 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:21.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40f7fe640 1 -- 172.21.15.1:0/2226450704 >> v2:172.21.15.167:3300/0 conn(0x7fa41009a080 msgr2=0x7fa4100cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40f7fe640 1 --2- 172.21.15.1:0/2226450704 >> v2:172.21.15.167:3300/0 conn(0x7fa41009a080 0x7fa4100cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40f7fe640 1 -- 172.21.15.1:0/2226450704 >> v1:172.21.15.167:6789/0 conn(0x7fa41015d8d0 legacy=0x7fa410099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40f7fe640 1 -- 172.21.15.1:0/2226450704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100b0ce0 con 0x7fa4100cf470 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.884+0000 7fa40e7fc640 1 --2- 172.21.15.1:0/2226450704 >> v2:172.21.15.167:3300/0 conn(0x7fa41009a080 0x7fa4100cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.885+0000 7fa40f7fe640 1 --2- 172.21.15.1:0/2226450704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4100cf470 0x7fa4100b1200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa400009d90 tx=0x7fa40002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a73f3bd7b45335 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.885+0000 7fa40dffb640 1 -- 172.21.15.1:0/2226450704 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40002cc50 con 0x7fa4100cf470 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.885+0000 7fa40dffb640 1 -- 172.21.15.1:0/2226450704 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40002cdb0 con 0x7fa4100cf470 2023-12-02T01:30:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.885+0000 7fa40dffb640 1 -- 172.21.15.1:0/2226450704 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400034660 con 0x7fa4100cf470 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.885+0000 7fa41541e640 1 -- 172.21.15.1:0/2226450704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4100cf470 msgr2=0x7fa4100b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.885+0000 7fa41541e640 1 --2- 172.21.15.1:0/2226450704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4100cf470 0x7fa4100b1200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa400009d90 tx=0x7fa40002bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.886+0000 7fa41541e640 1 -- 172.21.15.1:0/2226450704 shutdown_connections 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.886+0000 7fa41541e640 1 --2- 172.21.15.1:0/2226450704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4100cf470 0x7fa4100b1200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.886+0000 7fa41541e640 1 --2- 172.21.15.1:0/2226450704 >> v2:172.21.15.167:3300/0 conn(0x7fa41009a080 0x7fa4100cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.886+0000 7fa41541e640 1 -- 172.21.15.1:0/2226450704 >> 172.21.15.1:0/2226450704 conn(0x7fa4100b2ab0 msgr2=0x7fa4100b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.886+0000 7fa41541e640 1 -- 172.21.15.1:0/2226450704 shutdown_connections 2023-12-02T01:30:21.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.886+0000 7fa41541e640 1 -- 172.21.15.1:0/2226450704 wait complete. 2023-12-02T01:30:21.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.887+0000 7fa41541e640 1 Processor -- start 2023-12-02T01:30:21.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.887+0000 7fa41541e640 1 -- start start 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa41541e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa41009a080 0x7fa410159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa41541e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4100cf470 0x7fa4100c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa41541e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa41015d8d0 0x7fa4100ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa41541e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100c5c50 con 0x7fa4100cf470 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa41541e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101f3700 con 0x7fa41009a080 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa41541e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101f39e0 con 0x7fa41015d8d0 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4100cf470 0x7fa4100c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4100cf470 0x7fa4100c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34674/0 (socket says 172.21.15.1:34674) 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 -- 172.21.15.1:0/2605324429 learned_addr learned my addr 172.21.15.1:0/2605324429 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40effd640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa41009a080 0x7fa410159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40f7fe640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa41015d8d0 0x7fa4100ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 -- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa41015d8d0 msgr2=0x7fa4100ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa41015d8d0 0x7fa4100ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 -- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa41009a080 msgr2=0x7fa410159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa41009a080 0x7fa410159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 -- 172.21.15.1:0/2605324429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8009400 con 0x7fa4100cf470 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.888+0000 7fa40e7fc640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4100cf470 0x7fa4100c72b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800ebe0 tx=0x7fa3f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.889+0000 7fa4077fe640 1 -- 172.21.15.1:0/2605324429 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8009760 con 0x7fa4100cf470 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.889+0000 7fa4077fe640 1 -- 172.21.15.1:0/2605324429 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f800cc30 con 0x7fa4100cf470 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.889+0000 7fa4077fe640 1 -- 172.21.15.1:0/2605324429 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800eee0 con 0x7fa4100cf470 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.889+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa400009a70 con 0x7fa4100cf470 2023-12-02T01:30:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.889+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4101f3fa0 con 0x7fa4100cf470 2023-12-02T01:30:21.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.890+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41009f0b0 con 0x7fa4100cf470 2023-12-02T01:30:21.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.890+0000 7fa4077fe640 1 -- 172.21.15.1:0/2605324429 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3f8013470 con 0x7fa4100cf470 2023-12-02T01:30:21.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.890+0000 7fa4077fe640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa3f006ae40 0x7fa3f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.891+0000 7fa4077fe640 1 -- 172.21.15.1:0/2605324429 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3f8089780 con 0x7fa4100cf470 2023-12-02T01:30:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.891+0000 7fa40effd640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa3f006ae40 0x7fa3f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.891+0000 7fa40effd640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa3f006ae40 0x7fa3f006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa408000f60 tx=0x7fa408009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:21.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:21.895+0000 7fa4077fe640 1 -- 172.21.15.1:0/2605324429 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3f8054970 con 0x7fa4100cf470 2023-12-02T01:30:22.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.072+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa41004e920 con 0x7fa4100cf470 2023-12-02T01:30:22.074 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.072+0000 7fa4077fe640 1 -- 172.21.15.1:0/2605324429 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3f8057f90 con 0x7fa4100cf470 2023-12-02T01:30:22.074 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa3f006ae40 msgr2=0x7fa3f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa3f006ae40 0x7fa3f006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa408000f60 tx=0x7fa408009040 comp rx=0 tx=0).stop 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4100cf470 msgr2=0x7fa4100c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4100cf470 0x7fa4100c72b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800ebe0 tx=0x7fa3f800c520 comp rx=0 tx=0).stop 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 shutdown_connections 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa41015d8d0 0x7fa4100ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4100cf470 0x7fa4100c72b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.076 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa3f006ae40 0x7fa3f006d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 --2- 172.21.15.1:0/2605324429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa41009a080 0x7fa410159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 >> 172.21.15.1:0/2605324429 conn(0x7fa4100b2ab0 msgr2=0x7fa410099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 shutdown_connections 2023-12-02T01:30:22.077 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.074+0000 7fa41541e640 1 -- 172.21.15.1:0/2605324429 wait complete. 2023-12-02T01:30:22.087 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:22.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.193+0000 7f0e65151640 1 Processor -- start 2023-12-02T01:30:22.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.193+0000 7f0e65151640 1 -- start start 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e65151640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e6015ef60 0x7f0e600ae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e65151640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6006ae00 con 0x7f0e600cc7f0 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e65151640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600ccc70 con 0x7f0e6015eb80 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e65151640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600cf3a0 con 0x7f0e6015ef60 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e5f59e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e6015ef60 0x7f0e600ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e57fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0e600cc7f0 0x7f0e600cebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51184/0 (socket says 172.21.15.1:51184) 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e57fff640 1 -- 172.21.15.1:0/698086774 learned_addr learned my addr 172.21.15.1:0/698086774 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e5f59e640 1 -- 172.21.15.1:0/698086774 >> v1:172.21.15.167:6789/0 conn(0x7f0e6015eb80 legacy=0x7f0e6015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e5f59e640 1 -- 172.21.15.1:0/698086774 >> v1:172.21.15.1:6789/0 conn(0x7f0e600cc7f0 legacy=0x7f0e600cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e5e59c640 1 -- 172.21.15.1:0/698086774 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190316343 0 0) 0x7f0e6006ae00 con 0x7f0e600cc7f0 2023-12-02T01:30:22.196 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.194+0000 7f0e5f59e640 1 -- 172.21.15.1:0/698086774 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6006a4d0 con 0x7f0e6015ef60 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.195+0000 7f0e5f59e640 1 --2- 172.21.15.1:0/698086774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015ef60 0x7f0e600ae430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009d90 tx=0x7f0e5802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb98c108050b673 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.195+0000 7f0e5e59c640 1 -- 172.21.15.1:0/698086774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5802cc60 con 0x7f0e6015ef60 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.195+0000 7f0e5e59c640 1 -- 172.21.15.1:0/698086774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5802cdc0 con 0x7f0e6015ef60 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.195+0000 7f0e5e59c640 1 -- 172.21.15.1:0/698086774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58034660 con 0x7f0e6015ef60 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.196+0000 7f0e65151640 1 -- 172.21.15.1:0/698086774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015ef60 msgr2=0x7f0e600ae430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.196+0000 7f0e65151640 1 --2- 172.21.15.1:0/698086774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015ef60 0x7f0e600ae430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009d90 tx=0x7f0e5802beb0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.196+0000 7f0e65151640 1 -- 172.21.15.1:0/698086774 shutdown_connections 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.196+0000 7f0e65151640 1 --2- 172.21.15.1:0/698086774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015ef60 0x7f0e600ae430 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.196+0000 7f0e65151640 1 -- 172.21.15.1:0/698086774 >> 172.21.15.1:0/698086774 conn(0x7f0e600b1670 msgr2=0x7f0e600b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.196+0000 7f0e65151640 1 -- 172.21.15.1:0/698086774 shutdown_connections 2023-12-02T01:30:22.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.196+0000 7f0e65151640 1 -- 172.21.15.1:0/698086774 wait complete. 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.197+0000 7f0e65151640 1 Processor -- start 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.197+0000 7f0e65151640 1 -- start start 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e65151640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e600cc7f0 0x7f0e601f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e65151640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015eb80 0x7f0e601f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e65151640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e6015ef60 0x7f0e601f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e65151640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600acf20 con 0x7f0e6015eb80 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e65151640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b3e70 con 0x7f0e6015ef60 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e65151640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600ac910 con 0x7f0e600cc7f0 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015eb80 0x7f0e601f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015eb80 0x7f0e601f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34686/0 (socket says 172.21.15.1:34686) 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 -- 172.21.15.1:0/4174358537 learned_addr learned my addr 172.21.15.1:0/4174358537 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:22.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e5ed9d640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e600cc7f0 0x7f0e601f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e5f59e640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e6015ef60 0x7f0e601f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 -- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e600cc7f0 msgr2=0x7f0e601f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e600cc7f0 0x7f0e601f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 -- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e6015ef60 msgr2=0x7f0e601f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e6015ef60 0x7f0e601f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e57fff640 1 -- 172.21.15.1:0/4174358537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e58009a70 con 0x7f0e6015eb80 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.198+0000 7f0e5f59e640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e6015ef60 0x7f0e601f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.199+0000 7f0e57fff640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015eb80 0x7f0e601f2b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800c4d0 tx=0x7f0e4800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.199+0000 7f0e577fe640 1 -- 172.21.15.1:0/4174358537 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480074e0 con 0x7f0e6015eb80 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.199+0000 7f0e577fe640 1 -- 172.21.15.1:0/4174358537 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48007660 con 0x7f0e6015eb80 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.199+0000 7f0e577fe640 1 -- 172.21.15.1:0/4174358537 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48004a20 con 0x7f0e6015eb80 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.199+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600b3b90 con 0x7f0e6015eb80 2023-12-02T01:30:22.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.199+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e601f4090 con 0x7f0e6015eb80 2023-12-02T01:30:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.200+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60067940 con 0x7f0e6015eb80 2023-12-02T01:30:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.200+0000 7f0e577fe640 1 -- 172.21.15.1:0/4174358537 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e48004b80 con 0x7f0e6015eb80 2023-12-02T01:30:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.201+0000 7f0e577fe640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0e4006ae40 0x7f0e4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.201+0000 7f0e5ed9d640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0e4006ae40 0x7f0e4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.201+0000 7f0e577fe640 1 -- 172.21.15.1:0/4174358537 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e480886c0 con 0x7f0e6015eb80 2023-12-02T01:30:22.204 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.201+0000 7f0e5ed9d640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0e4006ae40 0x7f0e4006d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0e50004f60 tx=0x7f0e50007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.205+0000 7f0e577fe640 1 -- 172.21.15.1:0/4174358537 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e480538b0 con 0x7f0e6015eb80 2023-12-02T01:30:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.393+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0e60072720 con 0x7f0e6015eb80 2023-12-02T01:30:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.394+0000 7f0e577fe640 1 -- 172.21.15.1:0/4174358537 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0e48018080 con 0x7f0e6015eb80 2023-12-02T01:30:22.395 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.395+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0e4006ae40 msgr2=0x7f0e4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.395+0000 7f0e65151640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0e4006ae40 0x7f0e4006d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0e50004f60 tx=0x7f0e50007e30 comp rx=0 tx=0).stop 2023-12-02T01:30:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.395+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015eb80 msgr2=0x7f0e601f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.395+0000 7f0e65151640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015eb80 0x7f0e601f2b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800c4d0 tx=0x7f0e4800c990 comp rx=0 tx=0).stop 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 shutdown_connections 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f0e4006ae40 0x7f0e4006d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e6015ef60 0x7f0e601f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e6015eb80 0x7f0e601f2b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 --2- 172.21.15.1:0/4174358537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e600cc7f0 0x7f0e601f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 >> 172.21.15.1:0/4174358537 conn(0x7f0e600b1670 msgr2=0x7f0e60141040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 shutdown_connections 2023-12-02T01:30:22.398 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.396+0000 7f0e65151640 1 -- 172.21.15.1:0/4174358537 wait complete. 2023-12-02T01:30:22.408 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:30:22.408 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:22.424 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.569+0000 7fc315d5a640 1 Processor -- start 2023-12-02T01:30:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.569+0000 7fc315d5a640 1 -- start start 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc315d5a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3100b2610 0x7fc3100b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc315d5a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3100b0660 con 0x7fc31015d900 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc315d5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31006c900 con 0x7fc31009a080 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc315d5a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31006cbe0 con 0x7fc3100b2610 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc30ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3100b2610 0x7fc3100b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc30f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc31015d900 0x7fc310099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51186/0 (socket says 172.21.15.1:51186) 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc30f7fe640 1 -- 172.21.15.1:0/2826506245 learned_addr learned my addr 172.21.15.1:0/2826506245 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc30ffff640 1 -- 172.21.15.1:0/2826506245 >> v1:172.21.15.167:6789/0 conn(0x7fc31009a080 legacy=0x7fc3100b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc30ffff640 1 -- 172.21.15.1:0/2826506245 >> v1:172.21.15.1:6789/0 conn(0x7fc31015d900 legacy=0x7fc310099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc30e7fc640 1 -- 172.21.15.1:0/2826506245 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170509732 0 0) 0x7fc3100b0660 con 0x7fc31015d900 2023-12-02T01:30:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.570+0000 7fc30ffff640 1 -- 172.21.15.1:0/2826506245 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31006cec0 con 0x7fc3100b2610 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.571+0000 7fc30ffff640 1 --2- 172.21.15.1:0/2826506245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100b2610 0x7fc3100b14e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc308009d90 tx=0x7fc30802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8706ff97a0db2b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.571+0000 7fc30e7fc640 1 -- 172.21.15.1:0/2826506245 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30802cc60 con 0x7fc3100b2610 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.571+0000 7fc30e7fc640 1 -- 172.21.15.1:0/2826506245 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30802cdc0 con 0x7fc3100b2610 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.571+0000 7fc30e7fc640 1 -- 172.21.15.1:0/2826506245 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308034660 con 0x7fc3100b2610 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.572+0000 7fc315d5a640 1 -- 172.21.15.1:0/2826506245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100b2610 msgr2=0x7fc3100b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.572+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2826506245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100b2610 0x7fc3100b14e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc308009d90 tx=0x7fc30802beb0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.572+0000 7fc315d5a640 1 -- 172.21.15.1:0/2826506245 shutdown_connections 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.572+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2826506245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100b2610 0x7fc3100b14e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.572+0000 7fc315d5a640 1 -- 172.21.15.1:0/2826506245 >> 172.21.15.1:0/2826506245 conn(0x7fc3100b2a70 msgr2=0x7fc3100b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.572+0000 7fc315d5a640 1 -- 172.21.15.1:0/2826506245 shutdown_connections 2023-12-02T01:30:22.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.572+0000 7fc315d5a640 1 -- 172.21.15.1:0/2826506245 wait complete. 2023-12-02T01:30:22.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.573+0000 7fc315d5a640 1 Processor -- start 2023-12-02T01:30:22.575 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.573+0000 7fc315d5a640 1 -- start start 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc315d5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31009a080 0x7fc310157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc315d5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3100b2610 0x7fc3100c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc315d5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc31015d900 0x7fc3100c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc315d5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310157c50 con 0x7fc31009a080 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc315d5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100b5640 con 0x7fc3100b2610 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc315d5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100b4a30 con 0x7fc31015d900 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31009a080 0x7fc310157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31009a080 0x7fc310157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34714/0 (socket says 172.21.15.1:34714) 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 -- 172.21.15.1:0/2897431267 learned_addr learned my addr 172.21.15.1:0/2897431267 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 -- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc31015d900 msgr2=0x7fc3100c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30ffff640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc31015d900 0x7fc3100c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc31015d900 0x7fc3100c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30effd640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3100b2610 0x7fc3100c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 -- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3100b2610 msgr2=0x7fc3100c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3100b2610 0x7fc3100c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.574+0000 7fc30f7fe640 1 -- 172.21.15.1:0/2897431267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308009a70 con 0x7fc31009a080 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.575+0000 7fc30f7fe640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31009a080 0x7fc310157710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c430 tx=0x7fc30000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.575+0000 7fc2f7fff640 1 -- 172.21.15.1:0/2897431267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000074e0 con 0x7fc31009a080 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.575+0000 7fc2f7fff640 1 -- 172.21.15.1:0/2897431267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300007660 con 0x7fc31009a080 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.575+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3100b4d10 con 0x7fc31009a080 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.575+0000 7fc2f7fff640 1 -- 172.21.15.1:0/2897431267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300004a20 con 0x7fc31009a080 2023-12-02T01:30:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.575+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3100b52d0 con 0x7fc31009a080 2023-12-02T01:30:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.576+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310067420 con 0x7fc31009a080 2023-12-02T01:30:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.576+0000 7fc2f7fff640 1 -- 172.21.15.1:0/2897431267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc300004b80 con 0x7fc31009a080 2023-12-02T01:30:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.577+0000 7fc2f7fff640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2fc06ae40 0x7fc2fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.577+0000 7fc2f7fff640 1 -- 172.21.15.1:0/2897431267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc300089440 con 0x7fc31009a080 2023-12-02T01:30:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.577+0000 7fc30effd640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2fc06ae40 0x7fc2fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.577+0000 7fc30effd640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2fc06ae40 0x7fc2fc06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc31006d8e0 tx=0x7fc304008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.581+0000 7fc2f7fff640 1 -- 172.21.15.1:0/2897431267 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3000544f0 con 0x7fc31009a080 2023-12-02T01:30:22.759 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.758+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc310099e40 con 0x7fc31009a080 2023-12-02T01:30:22.761 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.759+0000 7fc2f7fff640 1 -- 172.21.15.1:0/2897431267 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fc300057b10 con 0x7fc31009a080 2023-12-02T01:30:22.761 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:22.761 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2fc06ae40 msgr2=0x7fc2fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2fc06ae40 0x7fc2fc06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc31006d8e0 tx=0x7fc304008040 comp rx=0 tx=0).stop 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31009a080 msgr2=0x7fc310157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31009a080 0x7fc310157710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c430 tx=0x7fc30000c8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 shutdown_connections 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc31015d900 0x7fc3100c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fc2fc06ae40 0x7fc2fc06d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3100b2610 0x7fc3100c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 --2- 172.21.15.1:0/2897431267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31009a080 0x7fc310157710 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 >> 172.21.15.1:0/2897431267 conn(0x7fc3100b2a70 msgr2=0x7fc31015c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 shutdown_connections 2023-12-02T01:30:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.761+0000 7fc315d5a640 1 -- 172.21.15.1:0/2897431267 wait complete. 2023-12-02T01:30:22.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:22.774 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:22.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.882+0000 7f3a2cc6e640 1 Processor -- start 2023-12-02T01:30:22.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.882+0000 7f3a2cc6e640 1 -- start start 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2cc6e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3a28144310 0x7f3a28144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2cc6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 0x7f3a280b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2cc6e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3a2806c890 0x7f3a2806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2cc6e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280b3980 con 0x7f3a28144310 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2cc6e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280cec60 con 0x7f3a2806c890 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2cc6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2806d240 con 0x7f3a280ce7e0 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3a28144310 0x7f3a28144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3a28144310 0x7f3a28144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34722/0 (socket says 172.21.15.1:34722) 2023-12-02T01:30:22.885 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 -- 172.21.15.1:0/3559114310 learned_addr learned my addr 172.21.15.1:0/3559114310 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:22.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a26d9d640 1 --2- 172.21.15.1:0/3559114310 >> v2:172.21.15.167:3300/0 conn(0x7f3a2806c890 0x7f3a2806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 -- 172.21.15.1:0/3559114310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 msgr2=0x7f3a280b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:22.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 --2- 172.21.15.1:0/3559114310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 0x7f3a280b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 -- 172.21.15.1:0/3559114310 >> v2:172.21.15.167:3300/0 conn(0x7f3a2806c890 msgr2=0x7f3a2806cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:22.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 --2- 172.21.15.1:0/3559114310 >> v2:172.21.15.167:3300/0 conn(0x7f3a2806c890 0x7f3a2806cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.883+0000 7f3a2659c640 1 -- 172.21.15.1:0/3559114310 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a281446f0 con 0x7f3a28144310 2023-12-02T01:30:22.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.884+0000 7f3a2659c640 1 --2- 172.21.15.1:0/3559114310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a28144310 0x7f3a28144950 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a280700a0 tx=0x7f3a1802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8081af1e021b4808 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.884+0000 7f3a25d9b640 1 -- 172.21.15.1:0/3559114310 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18031640 con 0x7f3a28144310 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.884+0000 7f3a25d9b640 1 -- 172.21.15.1:0/3559114310 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a180317a0 con 0x7f3a28144310 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.884+0000 7f3a25d9b640 1 -- 172.21.15.1:0/3559114310 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18031b30 con 0x7f3a28144310 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/3559114310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a28144310 msgr2=0x7f3a28144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/3559114310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a28144310 0x7f3a28144950 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a280700a0 tx=0x7f3a1802b8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/3559114310 shutdown_connections 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/3559114310 >> v2:172.21.15.167:3300/0 conn(0x7f3a2806c890 0x7f3a2806cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/3559114310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 0x7f3a280b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/3559114310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a28144310 0x7f3a28144950 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/3559114310 >> 172.21.15.1:0/3559114310 conn(0x7f3a2806a8f0 msgr2=0x7f3a2806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/3559114310 shutdown_connections 2023-12-02T01:30:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.885+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/3559114310 wait complete. 2023-12-02T01:30:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.886+0000 7f3a2cc6e640 1 Processor -- start 2023-12-02T01:30:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.886+0000 7f3a2cc6e640 1 -- start start 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2cc6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a2806c890 0x7f3a2813a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2cc6e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 0x7f3a2815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2cc6e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a28144310 0x7f3a2815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2cc6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281548d0 con 0x7f3a2806c890 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2cc6e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28153c50 con 0x7f3a28144310 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2cc6e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28153f30 con 0x7f3a280ce7e0 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a2806c890 0x7f3a2813a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a2806c890 0x7f3a2813a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34726/0 (socket says 172.21.15.1:34726) 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 -- 172.21.15.1:0/1389993411 learned_addr learned my addr 172.21.15.1:0/1389993411 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a26d9d640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a28144310 0x7f3a2815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a1dd9b640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 0x7f3a2815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 -- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 msgr2=0x7f3a2815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 0x7f3a2815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 -- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a28144310 msgr2=0x7f3a2815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a28144310 0x7f3a2815dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.887+0000 7f3a2659c640 1 -- 172.21.15.1:0/1389993411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180094d0 con 0x7f3a2806c890 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.888+0000 7f3a2659c640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a2806c890 0x7f3a2813a5c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3a180097f0 tx=0x7f3a180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.888+0000 7f3a1f7fe640 1 -- 172.21.15.1:0/1389993411 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1803ac60 con 0x7f3a2806c890 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.888+0000 7f3a1f7fe640 1 -- 172.21.15.1:0/1389993411 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1803ade0 con 0x7f3a2806c890 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.888+0000 7f3a1f7fe640 1 -- 172.21.15.1:0/1389993411 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18044630 con 0x7f3a2806c890 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.888+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a28154210 con 0x7f3a2806c890 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.888+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2813ab00 con 0x7f3a2806c890 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.889+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a280aaef0 con 0x7f3a2806c890 2023-12-02T01:30:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.889+0000 7f3a1f7fe640 1 -- 172.21.15.1:0/1389993411 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a1802f050 con 0x7f3a2806c890 2023-12-02T01:30:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.890+0000 7f3a1f7fe640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3a0806ae40 0x7f3a0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.890+0000 7f3a1f7fe640 1 -- 172.21.15.1:0/1389993411 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a180ab730 con 0x7f3a2806c890 2023-12-02T01:30:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.890+0000 7f3a1dd9b640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3a0806ae40 0x7f3a0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:22.893 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.890+0000 7f3a1dd9b640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3a0806ae40 0x7f3a0806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3a28154db0 tx=0x7f3a10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:22.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:22.894+0000 7f3a1f7fe640 1 -- 172.21.15.1:0/1389993411 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a180767e0 con 0x7f3a2806c890 2023-12-02T01:30:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.067+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a28072ae0 con 0x7f3a2806c890 2023-12-02T01:30:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.068+0000 7f3a1f7fe640 1 -- 172.21.15.1:0/1389993411 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a18079e00 con 0x7f3a2806c890 2023-12-02T01:30:23.069 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3a0806ae40 msgr2=0x7f3a0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3a0806ae40 0x7f3a0806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3a28154db0 tx=0x7f3a10008040 comp rx=0 tx=0).stop 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a2806c890 msgr2=0x7f3a2813a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a2806c890 0x7f3a2813a5c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3a180097f0 tx=0x7f3a180046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 shutdown_connections 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f3a0806ae40 0x7f3a0806d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a28144310 0x7f3a2815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a280ce7e0 0x7f3a2815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 --2- 172.21.15.1:0/1389993411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a2806c890 0x7f3a2813a5c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 >> 172.21.15.1:0/1389993411 conn(0x7f3a2806a8f0 msgr2=0x7f3a2815c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 shutdown_connections 2023-12-02T01:30:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.070+0000 7f3a2cc6e640 1 -- 172.21.15.1:0/1389993411 wait complete. 2023-12-02T01:30:23.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:23.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.190+0000 7fa2e3c7c640 1 Processor -- start 2023-12-02T01:30:23.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.190+0000 7fa2e3c7c640 1 -- start start 2023-12-02T01:30:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e3c7c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa2dc06f0d0 0x7fa2dc0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.193 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e3c7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e3c7c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0b38d0 con 0x7fa2dc0b3440 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e3c7c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc161760 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e3c7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0adda0 con 0x7fa2dc160d70 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e1a18640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa2dc06f0d0 0x7fa2dc0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e1217640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa2dc0b3440 0x7fa2dc0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51200/0 (socket says 172.21.15.1:51200) 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.191+0000 7fa2e1217640 1 -- 172.21.15.1:0/3136643102 learned_addr learned my addr 172.21.15.1:0/3136643102 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e2219640 1 --2- 172.21.15.1:0/3136643102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e1a18640 1 -- 172.21.15.1:0/3136643102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 msgr2=0x7fa2dc161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e1a18640 1 --2- 172.21.15.1:0/3136643102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e1a18640 1 -- 172.21.15.1:0/3136643102 >> v1:172.21.15.1:6789/0 conn(0x7fa2dc0b3440 legacy=0x7fa2dc0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e0a16640 1 -- 172.21.15.1:0/3136643102 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493190662 0 0) 0x7fa2dc0b38d0 con 0x7fa2dc0b3440 2023-12-02T01:30:23.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e1a18640 1 -- 172.21.15.1:0/3136643102 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0b3bb0 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e2219640 1 --2- 172.21.15.1:0/3136643102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.192+0000 7fa2e1a18640 1 --2- 172.21.15.1:0/3136643102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc0b4970 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40097d0 tx=0x7fa2d402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc043ef125a5299 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e0a16640 1 -- 172.21.15.1:0/3136643102 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4031800 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e0a16640 1 -- 172.21.15.1:0/3136643102 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4031960 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e0a16640 1 -- 172.21.15.1:0/3136643102 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4031cf0 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/3136643102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 msgr2=0x7fa2dc0b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/3136643102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc0b4970 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40097d0 tx=0x7fa2d402b8a0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/3136643102 shutdown_connections 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/3136643102 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/3136643102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc0b4970 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/3136643102 >> 172.21.15.1:0/3136643102 conn(0x7fa2dc0b1670 msgr2=0x7fa2dc0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/3136643102 shutdown_connections 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.193+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/3136643102 wait complete. 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.194+0000 7fa2e3c7c640 1 Processor -- start 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.194+0000 7fa2e3c7c640 1 -- start start 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e3c7c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e3c7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e3c7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2dc157af0 0x7fa2dc15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e3c7c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06d020 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e3c7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0cc910 con 0x7fa2dc157af0 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e3c7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0cc120 con 0x7fa2dc160d70 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e1a18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e1a18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34758/0 (socket says 172.21.15.1:34758) 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.195+0000 7fa2e1a18640 1 -- 172.21.15.1:0/924969536 learned_addr learned my addr 172.21.15.1:0/924969536 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e1217640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e2219640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2dc157af0 0x7fa2dc15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e1a18640 1 -- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 msgr2=0x7fa2dc0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e1a18640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc0cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e1a18640 1 -- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2dc157af0 msgr2=0x7fa2dc15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e1a18640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2dc157af0 0x7fa2dc15d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e1a18640 1 -- 172.21.15.1:0/924969536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d4009400 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e1a18640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc155970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40098f0 tx=0x7fa2d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2da7fc640 1 -- 172.21.15.1:0/924969536 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d403ad20 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2da7fc640 1 -- 172.21.15.1:0/924969536 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d40443f0 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc06c9f0 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2da7fc640 1 -- 172.21.15.1:0/924969536 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d403aea0 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.196+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc0cc630 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.197+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc072720 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.197+0000 7fa2da7fc640 1 -- 172.21.15.1:0/924969536 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2d404d450 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.198+0000 7fa2da7fc640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa2c806ae40 0x7fa2c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.198+0000 7fa2da7fc640 1 -- 172.21.15.1:0/924969536 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2d402e070 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.198+0000 7fa2e1217640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa2c806ae40 0x7fa2c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.198+0000 7fa2e1217640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa2c806ae40 0x7fa2c806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0cebe0 tx=0x7fa2d0007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.202+0000 7fa2da7fc640 1 -- 172.21.15.1:0/924969536 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2d4076b30 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.377+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2dc04e920 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.377+0000 7fa2da7fc640 1 -- 172.21.15.1:0/924969536 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2d407a150 con 0x7fa2dc06f0d0 2023-12-02T01:30:23.379 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa2c806ae40 msgr2=0x7fa2c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa2c806ae40 0x7fa2c806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0cebe0 tx=0x7fa2d0007b70 comp rx=0 tx=0).stop 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 msgr2=0x7fa2dc155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc155970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40098f0 tx=0x7fa2d40046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 shutdown_connections 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa2c806ae40 0x7fa2c806d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2dc157af0 0x7fa2dc15d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2dc160d70 0x7fa2dc0cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 --2- 172.21.15.1:0/924969536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2dc06f0d0 0x7fa2dc155970 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 >> 172.21.15.1:0/924969536 conn(0x7fa2dc0b1670 msgr2=0x7fa2dc0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 shutdown_connections 2023-12-02T01:30:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.379+0000 7fa2e3c7c640 1 -- 172.21.15.1:0/924969536 wait complete. 2023-12-02T01:30:23.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:23.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.500+0000 7f044102b640 1 Processor -- start 2023-12-02T01:30:23.502 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f044102b640 1 -- start start 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f044102b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f043c15d7b0 0x7f043c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f044102b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f043c0d0050 0x7f043c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f044102b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f044102b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c0d04d0 con 0x7f043c0d0050 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f044102b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c0b04d0 con 0x7f043c15d7b0 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f044102b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0d1e40 con 0x7f043c0b0ea0 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.501+0000 7f043a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f043c0d0050 0x7f043c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f043c0d0050 0x7f043c0b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34764/0 (socket says 172.21.15.1:34764) 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043a59c640 1 -- 172.21.15.1:0/3874457673 learned_addr learned my addr 172.21.15.1:0/3874457673 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043ad9d640 1 --2- 172.21.15.1:0/3874457673 >> v2:172.21.15.167:3300/0 conn(0x7f043c15d7b0 0x7f043c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043b59e640 1 --2- 172.21.15.1:0/3874457673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043a59c640 1 -- 172.21.15.1:0/3874457673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 msgr2=0x7f043c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:23.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043a59c640 1 --2- 172.21.15.1:0/3874457673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043a59c640 1 -- 172.21.15.1:0/3874457673 >> v2:172.21.15.167:3300/0 conn(0x7f043c15d7b0 msgr2=0x7f043c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:23.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043a59c640 1 --2- 172.21.15.1:0/3874457673 >> v2:172.21.15.167:3300/0 conn(0x7f043c15d7b0 0x7f043c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043a59c640 1 -- 172.21.15.1:0/3874457673 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0afe80 con 0x7f043c0d0050 2023-12-02T01:30:23.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.502+0000 7f043b59e640 1 --2- 172.21.15.1:0/3874457673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:23.505 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f043a59c640 1 --2- 172.21.15.1:0/3874457673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c0d0050 0x7f043c0b0960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f043c08bcb0 tx=0x7f043002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f578b397bb626 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f0439d9b640 1 -- 172.21.15.1:0/3874457673 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430031860 con 0x7f043c0d0050 2023-12-02T01:30:23.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f0439d9b640 1 -- 172.21.15.1:0/3874457673 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04300319c0 con 0x7f043c0d0050 2023-12-02T01:30:23.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f0439d9b640 1 -- 172.21.15.1:0/3874457673 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430031d50 con 0x7f043c0d0050 2023-12-02T01:30:23.506 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 -- 172.21.15.1:0/3874457673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c0d0050 msgr2=0x7f043c0b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 --2- 172.21.15.1:0/3874457673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c0d0050 0x7f043c0b0960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f043c08bcb0 tx=0x7f043002b900 comp rx=0 tx=0).stop 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 -- 172.21.15.1:0/3874457673 shutdown_connections 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 --2- 172.21.15.1:0/3874457673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 --2- 172.21.15.1:0/3874457673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c0d0050 0x7f043c0b0960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 --2- 172.21.15.1:0/3874457673 >> v2:172.21.15.167:3300/0 conn(0x7f043c15d7b0 0x7f043c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 -- 172.21.15.1:0/3874457673 >> 172.21.15.1:0/3874457673 conn(0x7f043c09c480 msgr2=0x7f043c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 -- 172.21.15.1:0/3874457673 shutdown_connections 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.503+0000 7f044102b640 1 -- 172.21.15.1:0/3874457673 wait complete. 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.505+0000 7f044102b640 1 Processor -- start 2023-12-02T01:30:23.507 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.505+0000 7f044102b640 1 -- start start 2023-12-02T01:30:23.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f044102b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c1f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.509 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f044102b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043c0d0050 0x7f043c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f044102b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c15d7b0 0x7f043c1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f044102b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1f2f70 con 0x7f043c15d7b0 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f044102b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1f6fe0 con 0x7f043c0d0050 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f044102b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1f72c0 con 0x7f043c0b0ea0 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c15d7b0 0x7f043c1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c15d7b0 0x7f043c1f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34766/0 (socket says 172.21.15.1:34766) 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 -- 172.21.15.1:0/2777428899 learned_addr learned my addr 172.21.15.1:0/2777428899 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043a59c640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043c0d0050 0x7f043c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043ad9d640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c1f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 -- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 msgr2=0x7f043c1f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c1f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.510 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 -- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043c0d0050 msgr2=0x7f043c0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043c0d0050 0x7f043c0b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 -- 172.21.15.1:0/2777428899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04300094d0 con 0x7f043c15d7b0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f043b59e640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c15d7b0 0x7f043c1f6590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0434007e10 tx=0x7f043400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f04237fe640 1 -- 172.21.15.1:0/2777428899 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434003b90 con 0x7f043c15d7b0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f04237fe640 1 -- 172.21.15.1:0/2777428899 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043400f040 con 0x7f043c15d7b0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f04237fe640 1 -- 172.21.15.1:0/2777428899 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400de80 con 0x7f043c15d7b0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.506+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c1f3190 con 0x7f043c15d7b0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.507+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c1f3ed0 con 0x7f043c15d7b0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.508+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c0a1160 con 0x7f043c15d7b0 2023-12-02T01:30:23.511 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.508+0000 7f04237fe640 1 -- 172.21.15.1:0/2777428899 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0434004030 con 0x7f043c15d7b0 2023-12-02T01:30:23.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.508+0000 7f04237fe640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f042806ae40 0x7f042806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.509+0000 7f04237fe640 1 -- 172.21.15.1:0/2777428899 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0434089880 con 0x7f043c15d7b0 2023-12-02T01:30:23.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.509+0000 7f043ad9d640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f042806ae40 0x7f042806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.512 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.509+0000 7f043ad9d640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f042806ae40 0x7f042806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f042c009aa0 tx=0x7f042c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.513+0000 7f04237fe640 1 -- 172.21.15.1:0/2777428899 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04340549d0 con 0x7f043c15d7b0 2023-12-02T01:30:23.693 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.692+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f043c04e920 con 0x7f043c15d7b0 2023-12-02T01:30:23.694 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.692+0000 7f04237fe640 1 -- 172.21.15.1:0/2777428899 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f043401a020 con 0x7f043c15d7b0 2023-12-02T01:30:23.694 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:23.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f042806ae40 msgr2=0x7f042806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f042806ae40 0x7f042806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f042c009aa0 tx=0x7f042c009190 comp rx=0 tx=0).stop 2023-12-02T01:30:23.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c15d7b0 msgr2=0x7f043c1f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c15d7b0 0x7f043c1f6590 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0434007e10 tx=0x7f043400d4a0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.696 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 shutdown_connections 2023-12-02T01:30:23.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f043c15d7b0 0x7f043c1f6590 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f042806ae40 0x7f042806d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043c0d0050 0x7f043c0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 --2- 172.21.15.1:0/2777428899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f043c0b0ea0 0x7f043c1f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.694+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 >> 172.21.15.1:0/2777428899 conn(0x7f043c09c480 msgr2=0x7f043c0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:23.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.695+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 shutdown_connections 2023-12-02T01:30:23.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.695+0000 7f044102b640 1 -- 172.21.15.1:0/2777428899 wait complete. 2023-12-02T01:30:23.707 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:23.814 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.813+0000 7f28578c2640 1 Processor -- start 2023-12-02T01:30:23.815 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.813+0000 7f28578c2640 1 -- start start 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f28578c2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f285009a080 0x7f28500cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f28578c2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f285006bc50 0x7f285006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f28578c2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28500b3590 con 0x7f28500b6b50 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f28578c2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285006b310 con 0x7f285006bc50 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f28578c2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28500cd3a0 con 0x7f285009a080 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2855e5f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f285006bc50 0x7f285006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2855e5f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f285006bc50 0x7f285006c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34770/0 (socket says 172.21.15.1:34770) 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2855e5f640 1 -- 172.21.15.1:0/1424312661 learned_addr learned my addr 172.21.15.1:0/1424312661 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2854e5d640 1 --2- 172.21.15.1:0/1424312661 >> v2:172.21.15.167:3300/0 conn(0x7f285009a080 0x7f28500cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.816 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2855e5f640 1 -- 172.21.15.1:0/1424312661 >> v2:172.21.15.167:3300/0 conn(0x7f285009a080 msgr2=0x7f28500cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:23.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2855e5f640 1 --2- 172.21.15.1:0/1424312661 >> v2:172.21.15.167:3300/0 conn(0x7f285009a080 0x7f28500cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2855e5f640 1 -- 172.21.15.1:0/1424312661 >> v1:172.21.15.167:6789/0 conn(0x7f28500b6b50 legacy=0x7f2850099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:23.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2855e5f640 1 -- 172.21.15.1:0/1424312661 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500b37c0 con 0x7f285006bc50 2023-12-02T01:30:23.817 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.814+0000 7f2854e5d640 1 --2- 172.21.15.1:0/1424312661 >> v2:172.21.15.167:3300/0 conn(0x7f285009a080 0x7f28500cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:23.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.815+0000 7f2855e5f640 1 --2- 172.21.15.1:0/1424312661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f285006c100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28500719a0 tx=0x7f284802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8beaa86d866f31 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.815+0000 7f2847fff640 1 -- 172.21.15.1:0/1424312661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284802cb20 con 0x7f285006bc50 2023-12-02T01:30:23.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.815+0000 7f2847fff640 1 -- 172.21.15.1:0/1424312661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284802cc80 con 0x7f285006bc50 2023-12-02T01:30:23.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.815+0000 7f2847fff640 1 -- 172.21.15.1:0/1424312661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480343f0 con 0x7f285006bc50 2023-12-02T01:30:23.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 -- 172.21.15.1:0/1424312661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 msgr2=0x7f285006c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 --2- 172.21.15.1:0/1424312661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f285006c100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28500719a0 tx=0x7f284802bf80 comp rx=0 tx=0).stop 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 -- 172.21.15.1:0/1424312661 shutdown_connections 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 --2- 172.21.15.1:0/1424312661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f285006c100 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 --2- 172.21.15.1:0/1424312661 >> v2:172.21.15.167:3300/0 conn(0x7f285009a080 0x7f28500cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 -- 172.21.15.1:0/1424312661 >> 172.21.15.1:0/1424312661 conn(0x7f28500b2a70 msgr2=0x7f28500b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 -- 172.21.15.1:0/1424312661 shutdown_connections 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.816+0000 7f28578c2640 1 -- 172.21.15.1:0/1424312661 wait complete. 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.817+0000 7f28578c2640 1 Processor -- start 2023-12-02T01:30:23.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.817+0000 7f28578c2640 1 -- start start 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f28578c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f28501f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f28578c2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f285009a080 0x7f28501602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f28578c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500b6b50 0x7f2850160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f28578c2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501f4470 con 0x7f285006bc50 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f28578c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285015f290 con 0x7f28500b6b50 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f28578c2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285015f500 con 0x7f285009a080 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f28501f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f28501f3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34778/0 (socket says 172.21.15.1:34778) 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 -- 172.21.15.1:0/737324622 learned_addr learned my addr 172.21.15.1:0/737324622 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 -- 172.21.15.1:0/737324622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f285009a080 msgr2=0x7f28501602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f285009a080 0x7f28501602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 -- 172.21.15.1:0/737324622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500b6b50 msgr2=0x7f2850160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:23.821 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500b6b50 0x7f2850160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 -- 172.21.15.1:0/737324622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009b30 con 0x7f285006bc50 2023-12-02T01:30:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f285565e640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f28501f3f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b420 tx=0x7f284c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f2845ffb640 1 -- 172.21.15.1:0/737324622 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c011830 con 0x7f285006bc50 2023-12-02T01:30:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f2845ffb640 1 -- 172.21.15.1:0/737324622 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c011990 con 0x7f285006bc50 2023-12-02T01:30:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285015f7e0 con 0x7f285006bc50 2023-12-02T01:30:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.818+0000 7f2845ffb640 1 -- 172.21.15.1:0/737324622 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c011d40 con 0x7f285006bc50 2023-12-02T01:30:23.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.819+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285015fda0 con 0x7f285006bc50 2023-12-02T01:30:23.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.820+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285009ef40 con 0x7f285006bc50 2023-12-02T01:30:23.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.820+0000 7f2845ffb640 1 -- 172.21.15.1:0/737324622 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f284c01b460 con 0x7f285006bc50 2023-12-02T01:30:23.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.820+0000 7f2845ffb640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f283406ae40 0x7f283406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:23.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.821+0000 7f2845ffb640 1 -- 172.21.15.1:0/737324622 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f284c0891a0 con 0x7f285006bc50 2023-12-02T01:30:23.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.821+0000 7f2854e5d640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f283406ae40 0x7f283406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:23.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.821+0000 7f2854e5d640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f283406ae40 0x7f283406d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2840006fd0 tx=0x7f2840008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:23.826 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:23.825+0000 7f2845ffb640 1 -- 172.21.15.1:0/737324622 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f284c054250 con 0x7f285006bc50 2023-12-02T01:30:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.015+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28500cb080 con 0x7f285006bc50 2023-12-02T01:30:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.015+0000 7f2845ffb640 1 -- 172.21.15.1:0/737324622 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f284c057870 con 0x7f285006bc50 2023-12-02T01:30:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f283406ae40 msgr2=0x7f283406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f283406ae40 0x7f283406d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2840006fd0 tx=0x7f2840008040 comp rx=0 tx=0).stop 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 msgr2=0x7f28501f3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f28501f3f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b420 tx=0x7f284c00b8e0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 shutdown_connections 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f283406ae40 0x7f283406d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28500b6b50 0x7f2850160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f285009a080 0x7f28501602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 --2- 172.21.15.1:0/737324622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f285006bc50 0x7f28501f3f30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 >> 172.21.15.1:0/737324622 conn(0x7f28500b2a70 msgr2=0x7f2850099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 shutdown_connections 2023-12-02T01:30:24.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.017+0000 7f28578c2640 1 -- 172.21.15.1:0/737324622 wait complete. 2023-12-02T01:30:24.029 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi001.front.sepia.ceph.com... 2023-12-02T01:30:24.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:24.029 DEBUG:teuthology.orchestra.run.smithi001:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-02T01:30:24.059 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:24.060 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T01:30:24.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:24.060 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-02T01:30:24.116 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:30:24.116 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:24.135 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:30:24.135 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:24.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:24.299 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.298+0000 7f9176aec640 1 Processor -- start 2023-12-02T01:30:24.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.298+0000 7f9176aec640 1 -- start start 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f9176aec640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f917015d710 0x7f917015b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f9176aec640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9170071ca0 con 0x7f917015d280 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f9176aec640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9170071090 con 0x7f91700ce860 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f9176aec640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9170071370 con 0x7f917015d710 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f9167fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f917015d280 0x7f917015b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51210/0 (socket says 172.21.15.1:51210) 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f9167fff640 1 -- 172.21.15.1:0/2532102631 learned_addr learned my addr 172.21.15.1:0/2532102631 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093720044 0 0) 0x7f9170071ca0 con 0x7f917015d280 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f9175089640 1 --2- 172.21.15.1:0/2532102631 >> v2:172.21.15.167:3300/0 conn(0x7f917015d710 0x7f917015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9158003520 con 0x7f917015d280 2023-12-02T01:30:24.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 102797096 0 0) 0x7f9158003520 con 0x7f917015d280 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 >> v2:172.21.15.167:3300/0 conn(0x7f917015d710 msgr2=0x7f917015b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 --2- 172.21.15.1:0/2532102631 >> v2:172.21.15.167:3300/0 conn(0x7f917015d710 0x7f917015b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 >> v1:172.21.15.167:6789/0 conn(0x7f91700ce860 legacy=0x7f917006e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170071650 con 0x7f917015d280 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f9160001670 con 0x7f917015d280 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 >> v1:172.21.15.1:6789/0 conn(0x7f917015d280 legacy=0x7f917015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.299+0000 7f91677fe640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9158003970 0x7f9158003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f91677fe640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91580047c0 0x7f9158004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f91677fe640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9158005180 0x7f915800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170071370 con 0x7f9158003970 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915800c020 con 0x7f91580047c0 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915800c1e0 con 0x7f9158005180 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9174888640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9158003970 0x7f9158003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.303 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9167fff640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91580047c0 0x7f9158004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9175089640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9158005180 0x7f915800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9174888640 1 -- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9158005180 msgr2=0x7f915800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9174888640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9158005180 0x7f915800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9174888640 1 -- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91580047c0 msgr2=0x7f9158004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9174888640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91580047c0 0x7f9158004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9174888640 1 -- 172.21.15.1:0/2532102631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158003520 con 0x7f9158003970 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.300+0000 7f9175089640 1 -- 172.21.15.1:0/2532102631 reap_dead start 2023-12-02T01:30:24.304 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9174888640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9158003970 0x7f9158003d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f916c001750 tx=0x7f91580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ca96f9edd458e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c0052d0 con 0x7f9158003970 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c02e050 con 0x7f9158003970 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f91677fe640 1 -- 172.21.15.1:0/2532102631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c003830 con 0x7f9158003970 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9176aec640 1 -- 172.21.15.1:0/2532102631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9158003970 msgr2=0x7f9158003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9176aec640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9158003970 0x7f9158003d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f916c001750 tx=0x7f91580057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9176aec640 1 -- 172.21.15.1:0/2532102631 shutdown_connections 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9176aec640 1 --2- 172.21.15.1:0/2532102631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9158003970 0x7f9158003d90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9176aec640 1 -- 172.21.15.1:0/2532102631 >> 172.21.15.1:0/2532102631 conn(0x7f91700b0af0 msgr2=0x7f91700b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:24.307 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9176aec640 1 -- 172.21.15.1:0/2532102631 shutdown_connections 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.301+0000 7f9176aec640 1 -- 172.21.15.1:0/2532102631 wait complete. 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.303+0000 7f9176aec640 1 Processor -- start 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.303+0000 7f9176aec640 1 -- start start 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.303+0000 7f9176aec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9158003970 0x7f91700ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.303+0000 7f9176aec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9170148f10 0x7f91700cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.303+0000 7f9176aec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9170145890 0x7f9170158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.303+0000 7f9176aec640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170149620 con 0x7f9170145890 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.303+0000 7f9176aec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170149900 con 0x7f9158003970 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9176aec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9170149be0 con 0x7f9170148f10 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9170145890 0x7f9170158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9170145890 0x7f9170158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34804/0 (socket says 172.21.15.1:34804) 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 -- 172.21.15.1:0/1753282285 learned_addr learned my addr 172.21.15.1:0/1753282285 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:24.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9174888640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9158003970 0x7f91700ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9167fff640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9170148f10 0x7f91700cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 -- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9170148f10 msgr2=0x7f91700cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9170148f10 0x7f91700cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 -- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9158003970 msgr2=0x7f91700ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9158003970 0x7f91700ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 -- 172.21.15.1:0/1753282285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170149ec0 con 0x7f9170145890 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9174888640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9158003970 0x7f91700ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9175089640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9170145890 0x7f9170158760 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f91700aea30 tx=0x7f916800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f91657fa640 1 -- 172.21.15.1:0/1753282285 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916800e040 con 0x7f9170145890 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f91657fa640 1 -- 172.21.15.1:0/1753282285 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916800f040 con 0x7f9170145890 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91700cc9d0 con 0x7f9170145890 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f91657fa640 1 -- 172.21.15.1:0/1753282285 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168015430 con 0x7f9170145890 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.304+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9170145ef0 con 0x7f9170145890 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.305+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9170067420 con 0x7f9170145890 2023-12-02T01:30:24.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.306+0000 7f91657fa640 1 -- 172.21.15.1:0/1753282285 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9168015590 con 0x7f9170145890 2023-12-02T01:30:24.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.306+0000 7f91657fa640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f915c06ae40 0x7f915c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.306+0000 7f91657fa640 1 -- 172.21.15.1:0/1753282285 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9168089c90 con 0x7f9170145890 2023-12-02T01:30:24.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.306+0000 7f9174888640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f915c06ae40 0x7f915c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.310 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.307+0000 7f9174888640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f915c06ae40 0x7f915c06d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f916c033000 tx=0x7f916c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.311 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.310+0000 7f91657fa640 1 -- 172.21.15.1:0/1753282285 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9168054d40 con 0x7f9170145890 2023-12-02T01:30:24.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.489+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91700ccbc0 con 0x7f9170145890 2023-12-02T01:30:24.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.490+0000 7f91657fa640 1 -- 172.21.15.1:0/1753282285 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f9168058360 con 0x7f9170145890 2023-12-02T01:30:24.492 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:24.492 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:29:46.274493+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f915c06ae40 msgr2=0x7f915c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f915c06ae40 0x7f915c06d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f916c033000 tx=0x7f916c009030 comp rx=0 tx=0).stop 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9170145890 msgr2=0x7f9170158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9170145890 0x7f9170158760 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f91700aea30 tx=0x7f916800f1b0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 shutdown_connections 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9170145890 0x7f9170158760 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9170148f10 0x7f91700cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f915c06ae40 0x7f915c06d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 --2- 172.21.15.1:0/1753282285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9158003970 0x7f91700ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 >> 172.21.15.1:0/1753282285 conn(0x7f91700b0af0 msgr2=0x7f91700afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 shutdown_connections 2023-12-02T01:30:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.492+0000 7f9176aec640 1 -- 172.21.15.1:0/1753282285 wait complete. 2023-12-02T01:30:24.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:24.505 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.613+0000 7f38fc4e5640 1 Processor -- start 2023-12-02T01:30:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.613+0000 7f38fc4e5640 1 -- start start 2023-12-02T01:30:24.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.614+0000 7f38fc4e5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38f40d1980 0x7f38f40cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.614+0000 7f38fc4e5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f40d11d0 con 0x7f38f40d1d60 2023-12-02T01:30:24.618 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.614+0000 7f38fc4e5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f40ce2b0 con 0x7f38f415d6c0 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.614+0000 7f38fc4e5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f40ce590 con 0x7f38f40d1980 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.614+0000 7f38f9a80640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f38f40d1d60 0x7f38f415cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51224/0 (socket says 172.21.15.1:51224) 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.614+0000 7f38f9a80640 1 -- 172.21.15.1:0/2833728948 learned_addr learned my addr 172.21.15.1:0/2833728948 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.614+0000 7f38fa281640 1 --2- 172.21.15.1:0/2833728948 >> v2:172.21.15.167:3300/0 conn(0x7f38f40d1980 0x7f38f40cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867685682 0 0) 0x7f38f40d11d0 con 0x7f38f40d1d60 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38e0003520 con 0x7f38f40d1d60 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748986272 0 0) 0x7f38f40ce2b0 con 0x7f38f415d6c0 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f40d11d0 con 0x7f38f415d6c0 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377439425 0 0) 0x7f38e0003520 con 0x7f38f40d1d60 2023-12-02T01:30:24.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 >> v2:172.21.15.167:3300/0 conn(0x7f38f40d1980 msgr2=0x7f38f40cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 --2- 172.21.15.1:0/2833728948 >> v2:172.21.15.167:3300/0 conn(0x7f38f40d1980 0x7f38f40cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 >> v1:172.21.15.167:6789/0 conn(0x7f38f415d6c0 legacy=0x7f38f40b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40ce870 con 0x7f38f40d1d60 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f38e4001670 con 0x7f38f40d1d60 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38fa281640 1 --2- 172.21.15.1:0/2833728948 >> v2:172.21.15.167:3300/0 conn(0x7f38f40d1980 0x7f38f40cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 >> v1:172.21.15.1:6789/0 conn(0x7f38f40d1d60 legacy=0x7f38f415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38e0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e00047c0 0x7f38e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e0005180 0x7f38e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40ce590 con 0x7f38e0003b00 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e000c0b0 con 0x7f38e0005180 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e000c270 con 0x7f38e00047c0 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38fa281640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38e0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38f9a80640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e00047c0 0x7f38e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38faa82640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e0005180 0x7f38e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38fa281640 1 -- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e00047c0 msgr2=0x7f38e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.621 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38fa281640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e00047c0 0x7f38e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38fa281640 1 -- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e0005180 msgr2=0x7f38e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38fa281640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e0005180 0x7f38e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38fa281640 1 -- 172.21.15.1:0/2833728948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0003520 con 0x7f38e0003b00 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.615+0000 7f38faa82640 1 -- 172.21.15.1:0/2833728948 reap_dead start 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.616+0000 7f38fa281640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38e0003f00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009c90 tx=0x7f38e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd19d88b835143a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.616+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec02c8f0 con 0x7f38e0003b00 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.616+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec02ca50 con 0x7f38e0003b00 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.616+0000 7f38f927f640 1 -- 172.21.15.1:0/2833728948 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec02ce40 con 0x7f38e0003b00 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.617+0000 7f38fc4e5640 1 -- 172.21.15.1:0/2833728948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 msgr2=0x7f38e0003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.617+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38e0003f00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009c90 tx=0x7f38e00057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.617+0000 7f38fc4e5640 1 -- 172.21.15.1:0/2833728948 shutdown_connections 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.617+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/2833728948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38e0003f00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.617+0000 7f38fc4e5640 1 -- 172.21.15.1:0/2833728948 >> 172.21.15.1:0/2833728948 conn(0x7f38f409c470 msgr2=0x7f38f40d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:24.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.617+0000 7f38fc4e5640 1 -- 172.21.15.1:0/2833728948 shutdown_connections 2023-12-02T01:30:24.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.617+0000 7f38fc4e5640 1 -- 172.21.15.1:0/2833728948 wait complete. 2023-12-02T01:30:24.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.618+0000 7f38fc4e5640 1 Processor -- start 2023-12-02T01:30:24.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.618+0000 7f38fc4e5640 1 -- start start 2023-12-02T01:30:24.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fc4e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38f41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fc4e5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f41f7620 0x7f38f40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fc4e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40cb7f0 0x7f38f40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fc4e5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40c96d0 con 0x7f38e0003b00 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fc4e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40cc1b0 con 0x7f38f40cb7f0 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fc4e5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f41566f0 con 0x7f38f41f7620 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38f41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38f41561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34818/0 (socket says 172.21.15.1:34818) 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 -- 172.21.15.1:0/929544162 learned_addr learned my addr 172.21.15.1:0/929544162 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38f9a80640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f41f7620 0x7f38f40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38faa82640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40cb7f0 0x7f38f40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 -- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f41f7620 msgr2=0x7f38f40b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f41f7620 0x7f38f40b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 -- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40cb7f0 msgr2=0x7f38f40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40cb7f0 0x7f38f40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 -- 172.21.15.1:0/929544162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40b4620 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38f9a80640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f41f7620 0x7f38f40b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38faa82640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40cb7f0 0x7f38f40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.619+0000 7f38fa281640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38f41561b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02c3d0 tx=0x7f38ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.620+0000 7f38eaffd640 1 -- 172.21.15.1:0/929544162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec034b40 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.620+0000 7f38eaffd640 1 -- 172.21.15.1:0/929544162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec034ca0 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.620+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f40b42f0 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.620+0000 7f38eaffd640 1 -- 172.21.15.1:0/929544162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec004260 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.620+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f40c98e0 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.621+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f40a10e0 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.621+0000 7f38eaffd640 1 -- 172.21.15.1:0/929544162 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38ec003610 con 0x7f38e0003b00 2023-12-02T01:30:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.621+0000 7f38eaffd640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f38d806ae70 0x7f38d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.621+0000 7f38eaffd640 1 -- 172.21.15.1:0/929544162 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38ec0aba00 con 0x7f38e0003b00 2023-12-02T01:30:24.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.621+0000 7f38f9a80640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f38d806ae70 0x7f38d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.622+0000 7f38f9a80640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f38d806ae70 0x7f38d806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38e40017a0 tx=0x7f38e4001cf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.626+0000 7f38eaffd640 1 -- 172.21.15.1:0/929544162 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38ec076b40 con 0x7f38e0003b00 2023-12-02T01:30:24.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.802+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38f40d39b0 con 0x7f38e0003b00 2023-12-02T01:30:24.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.802+0000 7f38eaffd640 1 -- 172.21.15.1:0/929544162 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38ec07a160 con 0x7f38e0003b00 2023-12-02T01:30:24.804 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:24.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f38d806ae70 msgr2=0x7f38d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f38d806ae70 0x7f38d806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38e40017a0 tx=0x7f38e4001cf0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 msgr2=0x7f38f41561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38f41561b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02c3d0 tx=0x7f38ec004730 comp rx=0 tx=0).stop 2023-12-02T01:30:24.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 shutdown_connections 2023-12-02T01:30:24.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f38d806ae70 0x7f38d806d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40cb7f0 0x7f38f40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f41f7620 0x7f38f40b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 --2- 172.21.15.1:0/929544162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38e0003b00 0x7f38f41561b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 >> 172.21.15.1:0/929544162 conn(0x7f38f409c470 msgr2=0x7f38f40b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:24.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 shutdown_connections 2023-12-02T01:30:24.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.804+0000 7f38fc4e5640 1 -- 172.21.15.1:0/929544162 wait complete. 2023-12-02T01:30:24.817 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:24.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.924+0000 7f24c7809640 1 Processor -- start 2023-12-02T01:30:24.926 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.924+0000 7f24c7809640 1 -- start start 2023-12-02T01:30:24.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.925+0000 7f24c7809640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24c013f750 0x7f24c015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.925+0000 7f24c7809640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00ce060 con 0x7f24c0070630 2023-12-02T01:30:24.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.925+0000 7f24c7809640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00ce340 con 0x7f24c013fb30 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.925+0000 7f24c7809640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c00cec70 con 0x7f24c013f750 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.925+0000 7f24c5da6640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f24c0070630 0x7f24c0070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51226/0 (socket says 172.21.15.1:51226) 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.925+0000 7f24c5da6640 1 -- 172.21.15.1:0/1104070291 learned_addr learned my addr 172.21.15.1:0/1104070291 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183572320 0 0) 0x7f24c00ce060 con 0x7f24c0070630 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a8003520 con 0x7f24c0070630 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c55a5640 1 --2- 172.21.15.1:0/1104070291 >> v2:172.21.15.167:3300/0 conn(0x7f24c013f750 0x7f24c015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358225513 0 0) 0x7f24a8003520 con 0x7f24c0070630 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 >> v2:172.21.15.167:3300/0 conn(0x7f24c013f750 msgr2=0x7f24c015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 --2- 172.21.15.1:0/1104070291 >> v2:172.21.15.167:3300/0 conn(0x7f24c013f750 0x7f24c015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 >> v1:172.21.15.167:6789/0 conn(0x7f24c013fb30 legacy=0x7f24c00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00ce620 con 0x7f24c0070630 2023-12-02T01:30:24.930 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f24b00019f0 con 0x7f24c0070630 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 >> v1:172.21.15.1:6789/0 conn(0x7f24c0070630 legacy=0x7f24c0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a80047c0 0x7f24a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24a8005180 0x7f24a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00cec70 con 0x7f24a8003970 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a800c020 con 0x7f24a80047c0 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a800c1e0 con 0x7f24a8005180 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c55a5640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c4da4640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a80047c0 0x7f24a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c5da6640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24a8005180 0x7f24a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c55a5640 1 -- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24a8005180 msgr2=0x7f24a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c55a5640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24a8005180 0x7f24a800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c55a5640 1 -- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a80047c0 msgr2=0x7f24a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c55a5640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a80047c0 0x7f24a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c55a5640 1 -- 172.21.15.1:0/1104070291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8003520 con 0x7f24a8003970 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.926+0000 7f24c5da6640 1 -- 172.21.15.1:0/1104070291 reap_dead start 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.927+0000 7f24c55a5640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24a8003d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009ac0 tx=0x7f24a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b92a77864320b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.927+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b802c6b0 con 0x7f24a8003970 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.927+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b802c810 con 0x7f24a8003970 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.927+0000 7f24bffff640 1 -- 172.21.15.1:0/1104070291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b802cba0 con 0x7f24a8003970 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.928+0000 7f24c7809640 1 -- 172.21.15.1:0/1104070291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 msgr2=0x7f24a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.928+0000 7f24c7809640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24a8003d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009ac0 tx=0x7f24a80057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.928+0000 7f24c7809640 1 -- 172.21.15.1:0/1104070291 shutdown_connections 2023-12-02T01:30:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.928+0000 7f24c7809640 1 --2- 172.21.15.1:0/1104070291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24a8003d90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.928+0000 7f24c7809640 1 -- 172.21.15.1:0/1104070291 >> 172.21.15.1:0/1104070291 conn(0x7f24c006a8f0 msgr2=0x7f24c006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.928+0000 7f24c7809640 1 -- 172.21.15.1:0/1104070291 shutdown_connections 2023-12-02T01:30:24.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.928+0000 7f24c7809640 1 -- 172.21.15.1:0/1104070291 wait complete. 2023-12-02T01:30:24.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.929+0000 7f24c7809640 1 Processor -- start 2023-12-02T01:30:24.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.929+0000 7f24c7809640 1 -- start start 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c7809640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24c0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c7809640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c015d450 0x7f24c0138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c7809640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c01386d0 0x7f24c015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c7809640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c015d030 con 0x7f24a8003970 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c7809640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c0138b40 con 0x7f24c01386d0 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c7809640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c015c3b0 con 0x7f24c015d450 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24c0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24c0158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34840/0 (socket says 172.21.15.1:34840) 2023-12-02T01:30:24.936 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 -- 172.21.15.1:0/3104850006 learned_addr learned my addr 172.21.15.1:0/3104850006 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c5da6640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c01386d0 0x7f24c015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c4da4640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c015d450 0x7f24c0138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 -- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c015d450 msgr2=0x7f24c0138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c015d450 0x7f24c0138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 -- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c01386d0 msgr2=0x7f24c015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c01386d0 0x7f24c015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.930+0000 7f24c55a5640 1 -- 172.21.15.1:0/3104850006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c015c690 con 0x7f24a8003970 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.931+0000 7f24c55a5640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24c0158e40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f24b8037040 tx=0x7f24b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.931+0000 7f24bdffb640 1 -- 172.21.15.1:0/3104850006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8003810 con 0x7f24a8003970 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.931+0000 7f24bdffb640 1 -- 172.21.15.1:0/3104850006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8003970 con 0x7f24a8003970 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.931+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c015c970 con 0x7f24a8003970 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.931+0000 7f24bdffb640 1 -- 172.21.15.1:0/3104850006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8003ce0 con 0x7f24a8003970 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.931+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c0159380 con 0x7f24a8003970 2023-12-02T01:30:24.937 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.932+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c0159570 con 0x7f24a8003970 2023-12-02T01:30:24.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.933+0000 7f24bdffb640 1 -- 172.21.15.1:0/3104850006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24b803b050 con 0x7f24a8003970 2023-12-02T01:30:24.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.933+0000 7f24bdffb640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f24ac06ae70 0x7f24ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:24.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.933+0000 7f24bdffb640 1 -- 172.21.15.1:0/3104850006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24b80ab590 con 0x7f24a8003970 2023-12-02T01:30:24.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.933+0000 7f24c4da4640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f24ac06ae70 0x7f24ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:24.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.934+0000 7f24c4da4640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f24ac06ae70 0x7f24ac06d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24c015d850 tx=0x7f24b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:24.938 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:24.937+0000 7f24bdffb640 1 -- 172.21.15.1:0/3104850006 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24b8076780 con 0x7f24a8003970 2023-12-02T01:30:25.116 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.115+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24c0072ae0 con 0x7f24a8003970 2023-12-02T01:30:25.117 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.115+0000 7f24bdffb640 1 -- 172.21.15.1:0/3104850006 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24b80044e0 con 0x7f24a8003970 2023-12-02T01:30:25.117 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f24ac06ae70 msgr2=0x7f24ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f24ac06ae70 0x7f24ac06d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24c015d850 tx=0x7f24b4009040 comp rx=0 tx=0).stop 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 msgr2=0x7f24c0158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24c0158e40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f24b8037040 tx=0x7f24b8004730 comp rx=0 tx=0).stop 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 shutdown_connections 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f24ac06ae70 0x7f24ac06d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c01386d0 0x7f24c015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24c015d450 0x7f24c0138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 --2- 172.21.15.1:0/3104850006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24a8003970 0x7f24c0158e40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.119 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 >> 172.21.15.1:0/3104850006 conn(0x7f24c006a8f0 msgr2=0x7f24c00aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:25.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 shutdown_connections 2023-12-02T01:30:25.120 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.117+0000 7f24c7809640 1 -- 172.21.15.1:0/3104850006 wait complete. 2023-12-02T01:30:25.129 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:25.238 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.237+0000 7f1bb6e48640 1 Processor -- start 2023-12-02T01:30:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.237+0000 7f1bb6e48640 1 -- start start 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb6e48640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1bb0144310 0x7f1bb0144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb6e48640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb01446f0 con 0x7f1bb00ce7e0 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb6e48640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb015ba80 con 0x7f1bb006cfa0 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb6e48640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb015bd60 con 0x7f1bb0144310 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb4be4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1bb0144310 0x7f1bb0144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1baffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1bb00ce7e0 0x7f1bb006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51234/0 (socket says 172.21.15.1:51234) 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1baffff640 1 -- 172.21.15.1:0/3859885444 learned_addr learned my addr 172.21.15.1:0/3859885444 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb4be4640 1 -- 172.21.15.1:0/3859885444 >> v1:172.21.15.167:6789/0 conn(0x7f1bb006cfa0 legacy=0x7f1bb015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb4be4640 1 -- 172.21.15.1:0/3859885444 >> v1:172.21.15.1:6789/0 conn(0x7f1bb00ce7e0 legacy=0x7f1bb006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1bb4be4640 1 -- 172.21.15.1:0/3859885444 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb015c040 con 0x7f1bb0144310 2023-12-02T01:30:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.238+0000 7f1baf7fe640 1 -- 172.21.15.1:0/3859885444 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53851742 0 0) 0x7f1bb01446f0 con 0x7f1bb00ce7e0 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.239+0000 7f1bb4be4640 1 --2- 172.21.15.1:0/3859885444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb0144310 0x7f1bb0144950 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009d90 tx=0x7f1ba802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea52b6b80f6cbbae server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.239+0000 7f1baf7fe640 1 -- 172.21.15.1:0/3859885444 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba802cd00 con 0x7f1bb0144310 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.239+0000 7f1baf7fe640 1 -- 172.21.15.1:0/3859885444 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba802ce60 con 0x7f1bb0144310 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.239+0000 7f1baf7fe640 1 -- 172.21.15.1:0/3859885444 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8034660 con 0x7f1bb0144310 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.240+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3859885444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb0144310 msgr2=0x7f1bb0144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.240+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3859885444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb0144310 0x7f1bb0144950 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009d90 tx=0x7f1ba802bf50 comp rx=0 tx=0).stop 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.240+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3859885444 shutdown_connections 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.240+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3859885444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb0144310 0x7f1bb0144950 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.240+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3859885444 >> 172.21.15.1:0/3859885444 conn(0x7f1bb006a8f0 msgr2=0x7f1bb006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.240+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3859885444 shutdown_connections 2023-12-02T01:30:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.240+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3859885444 wait complete. 2023-12-02T01:30:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.241+0000 7f1bb6e48640 1 Processor -- start 2023-12-02T01:30:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.241+0000 7f1bb6e48640 1 -- start start 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb6e48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb006cfa0 0x7f1bb0157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb6e48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bb00ce7e0 0x7f1bb00ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb6e48640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb0144310 0x7f1bb00acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb6e48640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb0071070 con 0x7f1bb006cfa0 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb6e48640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb0071350 con 0x7f1bb0144310 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb6e48640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00c3e70 con 0x7f1bb00ce7e0 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb006cfa0 0x7f1bb0157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb006cfa0 0x7f1bb0157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34858/0 (socket says 172.21.15.1:34858) 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 -- 172.21.15.1:0/3183161360 learned_addr learned my addr 172.21.15.1:0/3183161360 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 -- 172.21.15.1:0/3183161360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bb00ce7e0 msgr2=0x7f1bb00ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bb00ce7e0 0x7f1bb00ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 -- 172.21.15.1:0/3183161360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb0144310 msgr2=0x7f1bb00acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb0144310 0x7f1bb00acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.242+0000 7f1bb4be4640 1 -- 172.21.15.1:0/3183161360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba8009a70 con 0x7f1bb006cfa0 2023-12-02T01:30:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.243+0000 7f1bb4be4640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb006cfa0 0x7f1bb0157ba0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8037040 tx=0x7f1ba8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.243+0000 7f1bad7fa640 1 -- 172.21.15.1:0/3183161360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba803d600 con 0x7f1bb006cfa0 2023-12-02T01:30:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.243+0000 7f1bad7fa640 1 -- 172.21.15.1:0/3183161360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba803d780 con 0x7f1bb006cfa0 2023-12-02T01:30:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.243+0000 7f1bad7fa640 1 -- 172.21.15.1:0/3183161360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba803db30 con 0x7f1bb006cfa0 2023-12-02T01:30:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.243+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb00c4150 con 0x7f1bb006cfa0 2023-12-02T01:30:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.243+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb01580e0 con 0x7f1bb006cfa0 2023-12-02T01:30:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.244+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb00c4670 con 0x7f1bb006cfa0 2023-12-02T01:30:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.244+0000 7f1bad7fa640 1 -- 172.21.15.1:0/3183161360 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ba803b040 con 0x7f1bb006cfa0 2023-12-02T01:30:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.245+0000 7f1bad7fa640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b9006ae40 0x7f1b9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.245+0000 7f1bad7fa640 1 -- 172.21.15.1:0/3183161360 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ba80abd30 con 0x7f1bb006cfa0 2023-12-02T01:30:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.245+0000 7f1baffff640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b9006ae40 0x7f1b9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.245+0000 7f1baffff640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b9006ae40 0x7f1b9006d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007fd0 tx=0x7f1b98007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.249+0000 7f1bad7fa640 1 -- 172.21.15.1:0/3183161360 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1bb00c4670 con 0x7f1bb006cfa0 2023-12-02T01:30:25.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.428+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1bb00c4670 con 0x7f1bb006cfa0 2023-12-02T01:30:25.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.428+0000 7f1bad7fa640 1 -- 172.21.15.1:0/3183161360 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1bb00c4670 con 0x7f1bb006cfa0 2023-12-02T01:30:25.430 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b9006ae40 msgr2=0x7f1b9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b9006ae40 0x7f1b9006d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007fd0 tx=0x7f1b98007900 comp rx=0 tx=0).stop 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb006cfa0 msgr2=0x7f1bb0157ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb006cfa0 0x7f1bb0157ba0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8037040 tx=0x7f1ba8004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 shutdown_connections 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f1b9006ae40 0x7f1b9006d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb0144310 0x7f1bb00acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bb00ce7e0 0x7f1bb00ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 --2- 172.21.15.1:0/3183161360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bb006cfa0 0x7f1bb0157ba0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 >> 172.21.15.1:0/3183161360 conn(0x7f1bb006a8f0 msgr2=0x7f1bb00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 shutdown_connections 2023-12-02T01:30:25.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.430+0000 7f1bb6e48640 1 -- 172.21.15.1:0/3183161360 wait complete. 2023-12-02T01:30:25.443 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:25.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.552+0000 7f1927e87640 1 Processor -- start 2023-12-02T01:30:25.553 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.552+0000 7f1927e87640 1 -- start start 2023-12-02T01:30:25.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1927e87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f192015b0d0 0x7f19200cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1927e87640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1920070630 0x7f1920070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.554 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1927e87640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192015b530 con 0x7f192013f750 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1927e87640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19200cec70 con 0x7f1920070630 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1927e87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19200ce060 con 0x7f192015b0d0 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1926424640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1920070630 0x7f1920070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1925422640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f192015b0d0 0x7f19200cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1926424640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1920070630 0x7f1920070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:57916/0 (socket says 172.21.15.1:57916) 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1925422640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f192015b0d0 0x7f19200cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:56792/0 (socket says 172.21.15.1:56792) 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1926424640 1 -- 172.21.15.1:0/2431382706 learned_addr learned my addr 172.21.15.1:0/2431382706 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:25.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1925c23640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f192013f750 0x7f192013fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:54374/0 (socket says 172.21.15.1:54374) 2023-12-02T01:30:25.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1925422640 1 -- 172.21.15.1:0/2431382706 >> v2:172.21.15.167:3300/0 conn(0x7f1920070630 msgr2=0x7f1920070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1925422640 1 --2- 172.21.15.1:0/2431382706 >> v2:172.21.15.167:3300/0 conn(0x7f1920070630 0x7f1920070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1925422640 1 -- 172.21.15.1:0/2431382706 >> v1:172.21.15.167:6789/0 conn(0x7f192013f750 legacy=0x7f192013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1925422640 1 -- 172.21.15.1:0/2431382706 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200ce340 con 0x7f192015b0d0 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.553+0000 7f1926424640 1 --2- 172.21.15.1:0/2431382706 >> v2:172.21.15.167:3300/0 conn(0x7f1920070630 0x7f1920070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.554+0000 7f1925422640 1 --2- 172.21.15.1:0/2431382706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f192015b0d0 0x7f19200cd7c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5dae968f6eeb7b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.554+0000 7f1924c21640 1 -- 172.21.15.1:0/2431382706 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914031830 con 0x7f192015b0d0 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.554+0000 7f1924c21640 1 -- 172.21.15.1:0/2431382706 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1914031990 con 0x7f192015b0d0 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.554+0000 7f1924c21640 1 -- 172.21.15.1:0/2431382706 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914031d20 con 0x7f192015b0d0 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 -- 172.21.15.1:0/2431382706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f192015b0d0 msgr2=0x7f19200cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 --2- 172.21.15.1:0/2431382706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f192015b0d0 0x7f19200cd7c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 -- 172.21.15.1:0/2431382706 shutdown_connections 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 --2- 172.21.15.1:0/2431382706 >> v2:172.21.15.167:3300/0 conn(0x7f1920070630 0x7f1920070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 --2- 172.21.15.1:0/2431382706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f192015b0d0 0x7f19200cd7c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 -- 172.21.15.1:0/2431382706 >> 172.21.15.1:0/2431382706 conn(0x7f192006a8f0 msgr2=0x7f192006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 -- 172.21.15.1:0/2431382706 shutdown_connections 2023-12-02T01:30:25.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.555+0000 7f1927e87640 1 -- 172.21.15.1:0/2431382706 wait complete. 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.556+0000 7f1927e87640 1 Processor -- start 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.556+0000 7f1927e87640 1 -- start start 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1927e87640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1920070630 0x7f192014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1927e87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192013f750 0x7f19201f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1927e87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f192015b0d0 0x7f192014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1927e87640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192014a580 con 0x7f192013f750 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1927e87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192014a860 con 0x7f192015b0d0 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1927e87640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192014db10 con 0x7f1920070630 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192013f750 0x7f19201f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192013f750 0x7f19201f6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34866/0 (socket says 172.21.15.1:34866) 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 -- 172.21.15.1:0/886760029 learned_addr learned my addr 172.21.15.1:0/886760029 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1926424640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f192015b0d0 0x7f192014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925c23640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1920070630 0x7f192014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 -- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1920070630 msgr2=0x7f192014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1920070630 0x7f192014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 -- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f192015b0d0 msgr2=0x7f192014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f192015b0d0 0x7f192014c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 -- 172.21.15.1:0/886760029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180094d0 con 0x7f192013f750 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.557+0000 7f1925422640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192013f750 0x7f19201f6810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f19140098c0 tx=0x7f19140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.558+0000 7f191e7fc640 1 -- 172.21.15.1:0/886760029 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191403a630 con 0x7f192013f750 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.558+0000 7f191e7fc640 1 -- 172.21.15.1:0/886760029 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191403a7d0 con 0x7f192013f750 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.558+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914009400 con 0x7f192013f750 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.558+0000 7f191e7fc640 1 -- 172.21.15.1:0/886760029 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191403ab80 con 0x7f192013f750 2023-12-02T01:30:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.558+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19201f6d50 con 0x7f192013f750 2023-12-02T01:30:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.559+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192014e030 con 0x7f192013f750 2023-12-02T01:30:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.559+0000 7f191e7fc640 1 -- 172.21.15.1:0/886760029 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f191403ace0 con 0x7f192013f750 2023-12-02T01:30:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.559+0000 7f191e7fc640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f190c06ae40 0x7f190c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.560+0000 7f191e7fc640 1 -- 172.21.15.1:0/886760029 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f19140ab380 con 0x7f192013f750 2023-12-02T01:30:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.560+0000 7f1925c23640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f190c06ae40 0x7f190c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.560+0000 7f1925c23640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f190c06ae40 0x7f190c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19100012e0 tx=0x7f1910005b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.564+0000 7f191e7fc640 1 -- 172.21.15.1:0/886760029 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f192014e030 con 0x7f192013f750 2023-12-02T01:30:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.751+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f192014e030 con 0x7f192013f750 2023-12-02T01:30:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.751+0000 7f191e7fc640 1 -- 172.21.15.1:0/886760029 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f192014e030 con 0x7f192013f750 2023-12-02T01:30:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f190c06ae40 msgr2=0x7f190c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f190c06ae40 0x7f190c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19100012e0 tx=0x7f1910005b70 comp rx=0 tx=0).stop 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192013f750 msgr2=0x7f19201f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192013f750 0x7f19201f6810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f19140098c0 tx=0x7f19140046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 shutdown_connections 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f190c06ae40 0x7f190c06d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f192015b0d0 0x7f192014c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192013f750 0x7f19201f6810 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 --2- 172.21.15.1:0/886760029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1920070630 0x7f192014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.755 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 >> 172.21.15.1:0/886760029 conn(0x7f192006a8f0 msgr2=0x7f192013dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:25.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 shutdown_connections 2023-12-02T01:30:25.756 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.753+0000 7f1927e87640 1 -- 172.21.15.1:0/886760029 wait complete. 2023-12-02T01:30:25.765 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T01:30:25.765 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T01:30:25.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:25.890 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.889+0000 7ff35131d640 1 Processor -- start 2023-12-02T01:30:25.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.889+0000 7ff35131d640 1 -- start start 2023-12-02T01:30:25.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff35131d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff34c0d0ab0 0x7ff34c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.891 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff35131d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c06f9d0 con 0x7ff34c0cce70 2023-12-02T01:30:25.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff35131d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c06c190 con 0x7ff34c0d1c50 2023-12-02T01:30:25.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff35131d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34c06bfa0 con 0x7ff34c0d0ab0 2023-12-02T01:30:25.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff34affd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff34c0cce70 0x7ff34c099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51242/0 (socket says 172.21.15.1:51242) 2023-12-02T01:30:25.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff34affd640 1 -- 172.21.15.1:0/667335053 learned_addr learned my addr 172.21.15.1:0/667335053 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:25.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff343fff640 1 --2- 172.21.15.1:0/667335053 >> v2:172.21.15.167:3300/0 conn(0x7ff34c0d0ab0 0x7ff34c0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196860420 0 0) 0x7ff34c06f9d0 con 0x7ff34c0cce70 2023-12-02T01:30:25.892 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff338003520 con 0x7ff34c0cce70 2023-12-02T01:30:25.894 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.890+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279701601 0 0) 0x7ff338003520 con 0x7ff34c0cce70 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 >> v2:172.21.15.167:3300/0 conn(0x7ff34c0d0ab0 msgr2=0x7ff34c0cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 --2- 172.21.15.1:0/667335053 >> v2:172.21.15.167:3300/0 conn(0x7ff34c0d0ab0 0x7ff34c0cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 >> v1:172.21.15.167:6789/0 conn(0x7ff34c0d1c50 legacy=0x7ff34c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c06c470 con 0x7ff34c0cce70 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7ff33c001670 con 0x7ff34c0cce70 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 >> v1:172.21.15.1:6789/0 conn(0x7ff34c0cce70 legacy=0x7ff34c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff338003970 0x7ff338003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3380047c0 0x7ff338004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff338005180 0x7ff33800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33800bff0 con 0x7ff338003970 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33800c160 con 0x7ff3380047c0 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33800c320 con 0x7ff338005180 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34affd640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff338003970 0x7ff338003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.895 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff343fff640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3380047c0 0x7ff338004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34b7fe640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff338005180 0x7ff33800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34affd640 1 -- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff338005180 msgr2=0x7ff33800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34affd640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff338005180 0x7ff33800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34affd640 1 -- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3380047c0 msgr2=0x7ff338004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34affd640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3380047c0 0x7ff338004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34affd640 1 -- 172.21.15.1:0/667335053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338003520 con 0x7ff338003970 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.891+0000 7ff34b7fe640 1 -- 172.21.15.1:0/667335053 reap_dead start 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.892+0000 7ff34affd640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff338003970 0x7ff338003d90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff33c001050 tx=0x7ff3380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dae848b024729ee server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.892+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c005ad0 con 0x7ff338003970 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.892+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c005c30 con 0x7ff338003970 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.892+0000 7ff34a7fc640 1 -- 172.21.15.1:0/667335053 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c02cad0 con 0x7ff338003970 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.892+0000 7ff35131d640 1 -- 172.21.15.1:0/667335053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff338003970 msgr2=0x7ff338003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.892+0000 7ff35131d640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff338003970 0x7ff338003d90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff33c001050 tx=0x7ff3380057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.896 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.893+0000 7ff35131d640 1 -- 172.21.15.1:0/667335053 shutdown_connections 2023-12-02T01:30:25.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.893+0000 7ff35131d640 1 --2- 172.21.15.1:0/667335053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff338003970 0x7ff338003d90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.893+0000 7ff35131d640 1 -- 172.21.15.1:0/667335053 >> 172.21.15.1:0/667335053 conn(0x7ff34c0d0f20 msgr2=0x7ff34c0d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:25.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.893+0000 7ff35131d640 1 -- 172.21.15.1:0/667335053 shutdown_connections 2023-12-02T01:30:25.897 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.893+0000 7ff35131d640 1 -- 172.21.15.1:0/667335053 wait complete. 2023-12-02T01:30:25.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.894+0000 7ff35131d640 1 Processor -- start 2023-12-02T01:30:25.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.894+0000 7ff35131d640 1 -- start start 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.894+0000 7ff35131d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff338003970 0x7ff34c0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.894+0000 7ff35131d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c15dc10 0x7ff34c0b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff35131d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff34c0cab40 0x7ff34c0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff35131d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0c8120 con 0x7ff34c0cab40 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff35131d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0c8400 con 0x7ff338003970 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff35131d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0c86e0 con 0x7ff34c15dc10 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff34c0cab40 0x7ff34c0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff34c0cab40 0x7ff34c0b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34878/0 (socket says 172.21.15.1:34878) 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 -- 172.21.15.1:0/430511731 learned_addr learned my addr 172.21.15.1:0/430511731 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34affd640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff338003970 0x7ff34c0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff343fff640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c15dc10 0x7ff34c0b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 -- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c15dc10 msgr2=0x7ff34c0b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c15dc10 0x7ff34c0b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 -- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff338003970 msgr2=0x7ff34c0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff338003970 0x7ff34c0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 -- 172.21.15.1:0/430511731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0c89c0 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34affd640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff338003970 0x7ff34c0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff34b7fe640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff34c0cab40 0x7ff34c0b1480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff344007fd0 tx=0x7ff34400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff3437fe640 1 -- 172.21.15.1:0/430511731 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34400eed0 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff3437fe640 1 -- 172.21.15.1:0/430511731 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344003970 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c0c8ca0 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff3437fe640 1 -- 172.21.15.1:0/430511731 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344003d40 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.895+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c156860 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.896+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c067420 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.897+0000 7ff3437fe640 1 -- 172.21.15.1:0/430511731 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3440050d0 con 0x7ff34c0cab40 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.897+0000 7ff3437fe640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff32c06ae40 0x7ff32c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:25.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.897+0000 7ff3437fe640 1 -- 172.21.15.1:0/430511731 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff3440892e0 con 0x7ff34c0cab40 2023-12-02T01:30:25.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.897+0000 7ff34affd640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff32c06ae40 0x7ff32c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:25.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.898+0000 7ff34affd640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff32c06ae40 0x7ff32c06d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff33c034000 tx=0x7ff33c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:25.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:25.902+0000 7ff3437fe640 1 -- 172.21.15.1:0/430511731 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3440543a0 con 0x7ff34c0cab40 2023-12-02T01:30:26.079 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.077+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff34c0ca920 con 0x7ff34c0cab40 2023-12-02T01:30:26.080 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.079+0000 7ff3437fe640 1 -- 172.21.15.1:0/430511731 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16707 (secure 0 0 0) 0x7ff3440579c0 con 0x7ff34c0cab40 2023-12-02T01:30:26.080 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:26.081 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:25.482257+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:26.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.080+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff32c06ae40 msgr2=0x7ff32c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.082 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.080+0000 7ff35131d640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff32c06ae40 0x7ff32c06d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff33c034000 tx=0x7ff33c007000 comp rx=0 tx=0).stop 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff34c0cab40 msgr2=0x7ff34c0b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff34c0cab40 0x7ff34c0b1480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff344007fd0 tx=0x7ff34400eb90 comp rx=0 tx=0).stop 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 shutdown_connections 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff34c0cab40 0x7ff34c0b1480 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff34c15dc10 0x7ff34c0b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff32c06ae40 0x7ff32c06d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 --2- 172.21.15.1:0/430511731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff338003970 0x7ff34c0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 >> 172.21.15.1:0/430511731 conn(0x7ff34c0d0f20 msgr2=0x7ff34c0cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 shutdown_connections 2023-12-02T01:30:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.081+0000 7ff35131d640 1 -- 172.21.15.1:0/430511731 wait complete. 2023-12-02T01:30:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:26.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:26.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.202+0000 7f9ff5d00640 1 Processor -- start 2023-12-02T01:30:26.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.202+0000 7f9ff5d00640 1 -- start start 2023-12-02T01:30:26.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.202+0000 7f9ff5d00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff00d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.202+0000 7f9ff5d00640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ff00cef00 0x7f9ff0161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.202+0000 7f9ff5d00640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff00ce360 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.202+0000 7f9ff5d00640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff00b2f20 con 0x7f9ff00cef00 2023-12-02T01:30:26.205 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.202+0000 7f9ff5d00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00cdd50 con 0x7f9ff0160b70 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ff00cef00 0x7f9ff0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feeffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9ff00b2aa0 0x7f9ff00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51252/0 (socket says 172.21.15.1:51252) 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9ff00cef00 0x7f9ff0161230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34890/0 (socket says 172.21.15.1:34890) 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feeffd640 1 -- 172.21.15.1:0/3463095903 learned_addr learned my addr 172.21.15.1:0/3463095903 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feffff640 1 -- 172.21.15.1:0/3463095903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 msgr2=0x7f9ff00d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9fef7fe640 1 --2- 172.21.15.1:0/3463095903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff00d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9fee7fc640 1 -- 172.21.15.1:0/3463095903 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232327716 0 0) 0x7f9ff00ce360 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feffff640 1 --2- 172.21.15.1:0/3463095903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff00d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feffff640 1 -- 172.21.15.1:0/3463095903 >> v1:172.21.15.1:6789/0 conn(0x7f9ff00b2aa0 legacy=0x7f9ff00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9feffff640 1 -- 172.21.15.1:0/3463095903 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff00d1c70 con 0x7f9ff00cef00 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.203+0000 7f9fef7fe640 1 --2- 172.21.15.1:0/3463095903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff00d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9feffff640 1 --2- 172.21.15.1:0/3463095903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00cef00 0x7f9ff0161230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80097a0 tx=0x7f9fe802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756e7dd9fc58afb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.206 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9fee7fc640 1 -- 172.21.15.1:0/3463095903 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8031830 con 0x7f9ff00cef00 2023-12-02T01:30:26.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9fee7fc640 1 -- 172.21.15.1:0/3463095903 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8031990 con 0x7f9ff00cef00 2023-12-02T01:30:26.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9fee7fc640 1 -- 172.21.15.1:0/3463095903 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8031d20 con 0x7f9ff00cef00 2023-12-02T01:30:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 -- 172.21.15.1:0/3463095903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00cef00 msgr2=0x7f9ff0161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/3463095903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00cef00 0x7f9ff0161230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80097a0 tx=0x7f9fe802b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 -- 172.21.15.1:0/3463095903 shutdown_connections 2023-12-02T01:30:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/3463095903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00cef00 0x7f9ff0161230 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/3463095903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff00d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 -- 172.21.15.1:0/3463095903 >> 172.21.15.1:0/3463095903 conn(0x7f9ff009c470 msgr2=0x7f9ff00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:26.209 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 -- 172.21.15.1:0/3463095903 shutdown_connections 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.204+0000 7f9ff5d00640 1 -- 172.21.15.1:0/3463095903 wait complete. 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 Processor -- start 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 -- start start 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00b2aa0 0x7f9ff014f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ff00cef00 0x7f9ff00b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff01e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff015d690 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00b7e00 con 0x7f9ff00cef00 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.206+0000 7f9ff5d00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff014f9b0 con 0x7f9ff0160b70 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00b2aa0 0x7f9ff014f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00b2aa0 0x7f9ff014f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34898/0 (socket says 172.21.15.1:34898) 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 -- 172.21.15.1:0/300708 learned_addr learned my addr 172.21.15.1:0/300708 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:26.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9feffff640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff01e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9feeffd640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ff00cef00 0x7f9ff00b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 -- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 msgr2=0x7f9ff01e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff01e7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 -- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ff00cef00 msgr2=0x7f9ff00b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ff00cef00 0x7f9ff00b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 -- 172.21.15.1:0/300708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8009400 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fef7fe640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00b2aa0 0x7f9ff014f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000ce00 tx=0x7f9fe000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fd7fff640 1 -- 172.21.15.1:0/300708 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000f890 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fd7fff640 1 -- 172.21.15.1:0/300708 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000f9f0 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff00b7840 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9fd7fff640 1 -- 172.21.15.1:0/300708 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000fdc0 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.207+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff015d320 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.208+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff00a1150 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.209+0000 7f9fd7fff640 1 -- 172.21.15.1:0/300708 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fe000b040 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.209+0000 7f9fd7fff640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9fdc06ae70 0x7f9fdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.209+0000 7f9fd7fff640 1 -- 172.21.15.1:0/300708 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9fe0089f90 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.209+0000 7f9feeffd640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9fdc06ae70 0x7f9fdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.210+0000 7f9feeffd640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9fdc06ae70 0x7f9fdc06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ff015d180 tx=0x7f9fe4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.215 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.213+0000 7f9fd7fff640 1 -- 172.21.15.1:0/300708 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9fe00bce90 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.387+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ff00b22d0 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.389 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.388+0000 7f9fd7fff640 1 -- 172.21.15.1:0/300708 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fe001d020 con 0x7f9ff00b2aa0 2023-12-02T01:30:26.390 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9fdc06ae70 msgr2=0x7f9fdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9fdc06ae70 0x7f9fdc06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ff015d180 tx=0x7f9fe4009040 comp rx=0 tx=0).stop 2023-12-02T01:30:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00b2aa0 msgr2=0x7f9ff014f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00b2aa0 0x7f9ff014f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000ce00 tx=0x7f9fe000a650 comp rx=0 tx=0).stop 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 shutdown_connections 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ff0160b70 0x7f9ff01e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f9fdc06ae70 0x7f9fdc06d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ff00cef00 0x7f9ff00b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 --2- 172.21.15.1:0/300708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ff00b2aa0 0x7f9ff014f470 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.389+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 >> 172.21.15.1:0/300708 conn(0x7f9ff009c470 msgr2=0x7f9ff00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.390+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 shutdown_connections 2023-12-02T01:30:26.392 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.390+0000 7f9ff5d00640 1 -- 172.21.15.1:0/300708 wait complete. 2023-12-02T01:30:26.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:26.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.513+0000 7f514d739640 1 Processor -- start 2023-12-02T01:30:26.514 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.513+0000 7f514d739640 1 -- start start 2023-12-02T01:30:26.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.513+0000 7f514d739640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f514809a080 0x7f51480cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.513+0000 7f514d739640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514806bc50 0x7f514806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.513+0000 7f514d739640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51480b3590 con 0x7f51480b6b50 2023-12-02T01:30:26.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.513+0000 7f514d739640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514806b310 con 0x7f514809a080 2023-12-02T01:30:26.515 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.513+0000 7f514d739640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51480cd3a0 con 0x7f514806bc50 2023-12-02T01:30:26.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f51477fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514806bc50 0x7f514806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f513ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f514809a080 0x7f51480cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f51477fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514806bc50 0x7f514806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:56848/0 (socket says 172.21.15.1:56848) 2023-12-02T01:30:26.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f5146ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f51480b6b50 0x7f5148099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:54394/0 (socket says 172.21.15.1:54394) 2023-12-02T01:30:26.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f513ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f514809a080 0x7f51480cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:57964/0 (socket says 172.21.15.1:57964) 2023-12-02T01:30:26.516 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f51477fe640 1 -- 172.21.15.1:0/2235261358 learned_addr learned my addr 172.21.15.1:0/2235261358 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f513ffff640 1 -- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514806bc50 msgr2=0x7f514806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:26.517 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f513ffff640 1 --2- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514806bc50 0x7f514806c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f513ffff640 1 -- 172.21.15.1:0/2235261358 >> v1:172.21.15.167:6789/0 conn(0x7f51480b6b50 legacy=0x7f5148099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f513ffff640 1 -- 172.21.15.1:0/2235261358 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51480b37c0 con 0x7f514809a080 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.514+0000 7f51477fe640 1 --2- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514806bc50 0x7f514806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.515+0000 7f513ffff640 1 --2- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f514809a080 0x7f51480cfd40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51300097a0 tx=0x7f513002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6c67283c230c28 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.515+0000 7f51467fc640 1 -- 172.21.15.1:0/2235261358 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130030610 con 0x7f514809a080 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.515+0000 7f51467fc640 1 -- 172.21.15.1:0/2235261358 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5130030770 con 0x7f514809a080 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.515+0000 7f51467fc640 1 -- 172.21.15.1:0/2235261358 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130030b00 con 0x7f514809a080 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 -- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f514809a080 msgr2=0x7f51480cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 --2- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f514809a080 0x7f51480cfd40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51300097a0 tx=0x7f513002b960 comp rx=0 tx=0).stop 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 -- 172.21.15.1:0/2235261358 shutdown_connections 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 --2- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514806bc50 0x7f514806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.518 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 --2- 172.21.15.1:0/2235261358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f514809a080 0x7f51480cfd40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 -- 172.21.15.1:0/2235261358 >> 172.21.15.1:0/2235261358 conn(0x7f51480b2a70 msgr2=0x7f51480b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 -- 172.21.15.1:0/2235261358 shutdown_connections 2023-12-02T01:30:26.519 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.516+0000 7f514d739640 1 -- 172.21.15.1:0/2235261358 wait complete. 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.517+0000 7f514d739640 1 Processor -- start 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.517+0000 7f514d739640 1 -- start start 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f514d739640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514806bc50 0x7f51480ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f514d739640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514809a080 0x7f51480c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f514d739640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51480b6b50 0x7f51481f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f514d739640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51480c8a60 con 0x7f514806bc50 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f514d739640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51480c8d00 con 0x7f51480b6b50 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f514d739640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51480c8fe0 con 0x7f514809a080 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514806bc50 0x7f51480ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514806bc50 0x7f51480ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34914/0 (socket says 172.21.15.1:34914) 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 -- 172.21.15.1:0/98020380 learned_addr learned my addr 172.21.15.1:0/98020380 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:26.521 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f51477fe640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51480b6b50 0x7f51481f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f513ffff640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514809a080 0x7f51480c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 -- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514809a080 msgr2=0x7f51480c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514809a080 0x7f51480c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 -- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51480b6b50 msgr2=0x7f51481f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51480b6b50 0x7f51481f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 -- 172.21.15.1:0/98020380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009b30 con 0x7f514806bc50 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.518+0000 7f5146ffd640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514806bc50 0x7f51480ca8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f513800c3e0 tx=0x7f513800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.519+0000 7f513f7fe640 1 -- 172.21.15.1:0/98020380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380074e0 con 0x7f514806bc50 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.519+0000 7f513f7fe640 1 -- 172.21.15.1:0/98020380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138007640 con 0x7f514806bc50 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.519+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5130009400 con 0x7f514806bc50 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.519+0000 7f513f7fe640 1 -- 172.21.15.1:0/98020380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380049e0 con 0x7f514806bc50 2023-12-02T01:30:26.522 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.519+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51480c95a0 con 0x7f514806bc50 2023-12-02T01:30:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.520+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514809ef40 con 0x7f514806bc50 2023-12-02T01:30:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.520+0000 7f513f7fe640 1 -- 172.21.15.1:0/98020380 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5138004b40 con 0x7f514806bc50 2023-12-02T01:30:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.520+0000 7f513f7fe640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f512806ae40 0x7f512806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.521+0000 7f513f7fe640 1 -- 172.21.15.1:0/98020380 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5138089080 con 0x7f514806bc50 2023-12-02T01:30:26.523 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.521+0000 7f513ffff640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f512806ae40 0x7f512806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.521+0000 7f513ffff640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f512806ae40 0x7f512806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5130036000 tx=0x7f5130008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.526 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.525+0000 7f513f7fe640 1 -- 172.21.15.1:0/98020380 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51380540b0 con 0x7f514806bc50 2023-12-02T01:30:26.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.705+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51480c6a90 con 0x7f514806bc50 2023-12-02T01:30:26.707 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.706+0000 7f513f7fe640 1 -- 172.21.15.1:0/98020380 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51380576d0 con 0x7f514806bc50 2023-12-02T01:30:26.707 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:26.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f512806ae40 msgr2=0x7f512806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f512806ae40 0x7f512806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5130036000 tx=0x7f5130008030 comp rx=0 tx=0).stop 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514806bc50 msgr2=0x7f51480ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514806bc50 0x7f51480ca8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f513800c3e0 tx=0x7f513800c8a0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 shutdown_connections 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f512806ae40 0x7f512806d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51480b6b50 0x7f51481f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f514809a080 0x7f51480c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 --2- 172.21.15.1:0/98020380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f514806bc50 0x7f51480ca8f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 >> 172.21.15.1:0/98020380 conn(0x7f51480b2a70 msgr2=0x7f51480d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 shutdown_connections 2023-12-02T01:30:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.708+0000 7f514d739640 1 -- 172.21.15.1:0/98020380 wait complete. 2023-12-02T01:30:26.720 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:26.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.828+0000 7f9114f9e640 1 Processor -- start 2023-12-02T01:30:26.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.828+0000 7f9114f9e640 1 -- start start 2023-12-02T01:30:26.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f9114f9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f9110144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f9114f9e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f91100ce7e0 0x7f91100b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f9114f9e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91101446f0 con 0x7f9110144310 2023-12-02T01:30:26.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f9114f9e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91100b3980 con 0x7f91100ce7e0 2023-12-02T01:30:26.831 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f9114f9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100cec50 con 0x7f911006cfa0 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f910ed9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f91100ce7e0 0x7f91100b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f910e59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9110144310 0x7f911006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51256/0 (socket says 172.21.15.1:51256) 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f910e59c640 1 -- 172.21.15.1:0/1870518910 learned_addr learned my addr 172.21.15.1:0/1870518910 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.829+0000 7f910dd9b640 1 --2- 172.21.15.1:0/1870518910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f9110144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910ed9d640 1 -- 172.21.15.1:0/1870518910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 msgr2=0x7f9110144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910ed9d640 1 --2- 172.21.15.1:0/1870518910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f9110144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910ed9d640 1 -- 172.21.15.1:0/1870518910 >> v1:172.21.15.1:6789/0 conn(0x7f9110144310 legacy=0x7f911006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910ed9d640 1 -- 172.21.15.1:0/1870518910 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911015ba80 con 0x7f91100ce7e0 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910d59a640 1 -- 172.21.15.1:0/1870518910 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667383317 0 0) 0x7f91101446f0 con 0x7f9110144310 2023-12-02T01:30:26.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910dd9b640 1 --2- 172.21.15.1:0/1870518910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f9110144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910ed9d640 1 --2- 172.21.15.1:0/1870518910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91100ce7e0 0x7f91100b3440 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8579feff02c2872b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910d59a640 1 -- 172.21.15.1:0/1870518910 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910002cc50 con 0x7f91100ce7e0 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.830+0000 7f910d59a640 1 -- 172.21.15.1:0/1870518910 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910002cdb0 con 0x7f91100ce7e0 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f910d59a640 1 -- 172.21.15.1:0/1870518910 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100034660 con 0x7f91100ce7e0 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 -- 172.21.15.1:0/1870518910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91100ce7e0 msgr2=0x7f91100b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 --2- 172.21.15.1:0/1870518910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91100ce7e0 0x7f91100b3440 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910002bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 -- 172.21.15.1:0/1870518910 shutdown_connections 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 --2- 172.21.15.1:0/1870518910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f9110144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 --2- 172.21.15.1:0/1870518910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91100ce7e0 0x7f91100b3440 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 -- 172.21.15.1:0/1870518910 >> 172.21.15.1:0/1870518910 conn(0x7f911006a8f0 msgr2=0x7f911006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:26.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 -- 172.21.15.1:0/1870518910 shutdown_connections 2023-12-02T01:30:26.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.831+0000 7f9114f9e640 1 -- 172.21.15.1:0/1870518910 wait complete. 2023-12-02T01:30:26.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.832+0000 7f9114f9e640 1 Processor -- start 2023-12-02T01:30:26.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.832+0000 7f9114f9e640 1 -- start start 2023-12-02T01:30:26.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f9114f9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f91100add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f9114f9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91100ce7e0 0x7f9110138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f9114f9e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9110144310 0x7f91100aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f9114f9e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100ae2d0 con 0x7f9110144310 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f9114f9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100a9ee0 con 0x7f91100ce7e0 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f9114f9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100a8bc0 con 0x7f911006cfa0 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f910ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9110144310 0x7f91100aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f910ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9110144310 0x7f91100aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34930/0 (socket says 172.21.15.1:34930) 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f910ed9d640 1 -- 172.21.15.1:0/2424123409 learned_addr learned my addr 172.21.15.1:0/2424123409 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f910dd9b640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91100ce7e0 0x7f9110138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.833+0000 7f910e59c640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f91100add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f910ed9d640 1 -- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 msgr2=0x7f91100add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f910ed9d640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f91100add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f910ed9d640 1 -- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91100ce7e0 msgr2=0x7f9110138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f910ed9d640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91100ce7e0 0x7f9110138050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f910ed9d640 1 -- 172.21.15.1:0/2424123409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100009a70 con 0x7f9110144310 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f910ed9d640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9110144310 0x7f91100aed90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f9100004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f9106ffd640 1 -- 172.21.15.1:0/2424123409 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100040650 con 0x7f9110144310 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f9106ffd640 1 -- 172.21.15.1:0/2424123409 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91000407d0 con 0x7f9110144310 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91100a92d0 con 0x7f9110144310 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f9106ffd640 1 -- 172.21.15.1:0/2424123409 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100040b80 con 0x7f9110144310 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.834+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91100a9890 con 0x7f9110144310 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.835+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91100aa070 con 0x7f9110144310 2023-12-02T01:30:26.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.835+0000 7f9106ffd640 1 -- 172.21.15.1:0/2424123409 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9100040ce0 con 0x7f9110144310 2023-12-02T01:30:26.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.836+0000 7f9106ffd640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f90f006ae40 0x7f90f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:26.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.836+0000 7f9106ffd640 1 -- 172.21.15.1:0/2424123409 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f91000ac520 con 0x7f9110144310 2023-12-02T01:30:26.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.836+0000 7f910e59c640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f90f006ae40 0x7f90f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:26.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.836+0000 7f910e59c640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f90f006ae40 0x7f90f006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9108000f60 tx=0x7f9108007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:26.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:26.840+0000 7f9106ffd640 1 -- 172.21.15.1:0/2424123409 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91000774c0 con 0x7f9110144310 2023-12-02T01:30:27.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.018+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9110072ae0 con 0x7f9110144310 2023-12-02T01:30:27.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.019+0000 7f9106ffd640 1 -- 172.21.15.1:0/2424123409 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f910007aae0 con 0x7f9110144310 2023-12-02T01:30:27.021 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f90f006ae40 msgr2=0x7f90f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f90f006ae40 0x7f90f006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9108000f60 tx=0x7f9108007c00 comp rx=0 tx=0).stop 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9110144310 msgr2=0x7f91100aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9110144310 0x7f91100aed90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f9100004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 shutdown_connections 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9110144310 0x7f91100aed90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f90f006ae40 0x7f90f006d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91100ce7e0 0x7f9110138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 --2- 172.21.15.1:0/2424123409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f911006cfa0 0x7f91100add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 >> 172.21.15.1:0/2424123409 conn(0x7f911006a8f0 msgr2=0x7f911006c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:27.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 shutdown_connections 2023-12-02T01:30:27.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.021+0000 7f9114f9e640 1 -- 172.21.15.1:0/2424123409 wait complete. 2023-12-02T01:30:27.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-02T01:30:27.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.140+0000 7f2b1eeee640 1 Processor -- start 2023-12-02T01:30:27.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.140+0000 7f2b1eeee640 1 -- start start 2023-12-02T01:30:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1eeee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1eeee640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2b1815ebf0 0x7f2b18099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1eeee640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b180cd540 0x7f2b18099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1eeee640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b180b2260 con 0x7f2b180cd540 2023-12-02T01:30:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1eeee640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b180cd170 con 0x7f2b1815ebf0 2023-12-02T01:30:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1eeee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180b37b0 con 0x7f2b1815e810 2023-12-02T01:30:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b180cd540 0x7f2b18099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2b180cd540 0x7f2b18099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34938/0 (socket says 172.21.15.1:34938) 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 -- 172.21.15.1:0/223602632 learned_addr learned my addr 172.21.15.1:0/223602632 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1cc8a640 1 --2- 172.21.15.1:0/223602632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b0ffff640 1 --2- 172.21.15.1:0/223602632 >> v2:172.21.15.167:3300/0 conn(0x7f2b1815ebf0 0x7f2b18099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 -- 172.21.15.1:0/223602632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 msgr2=0x7f2b180ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 --2- 172.21.15.1:0/223602632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 -- 172.21.15.1:0/223602632 >> v2:172.21.15.167:3300/0 conn(0x7f2b1815ebf0 msgr2=0x7f2b18099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 --2- 172.21.15.1:0/223602632 >> v2:172.21.15.167:3300/0 conn(0x7f2b1815ebf0 0x7f2b18099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1d48b640 1 -- 172.21.15.1:0/223602632 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180cc720 con 0x7f2b180cd540 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b1cc8a640 1 --2- 172.21.15.1:0/223602632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.141+0000 7f2b0ffff640 1 --2- 172.21.15.1:0/223602632 >> v2:172.21.15.167:3300/0 conn(0x7f2b1815ebf0 0x7f2b18099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.142+0000 7f2b1d48b640 1 --2- 172.21.15.1:0/223602632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b180cd540 0x7f2b18099eb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2b18070ef0 tx=0x7f2b1002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2cbe587659bf5d server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.142+0000 7f2b0f7fe640 1 -- 172.21.15.1:0/223602632 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1002cb00 con 0x7f2b180cd540 2023-12-02T01:30:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.142+0000 7f2b0f7fe640 1 -- 172.21.15.1:0/223602632 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1002cc60 con 0x7f2b180cd540 2023-12-02T01:30:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.142+0000 7f2b0f7fe640 1 -- 172.21.15.1:0/223602632 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100343f0 con 0x7f2b180cd540 2023-12-02T01:30:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 -- 172.21.15.1:0/223602632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b180cd540 msgr2=0x7f2b18099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/223602632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b180cd540 0x7f2b18099eb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2b18070ef0 tx=0x7f2b1002bf60 comp rx=0 tx=0).stop 2023-12-02T01:30:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 -- 172.21.15.1:0/223602632 shutdown_connections 2023-12-02T01:30:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/223602632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b180cd540 0x7f2b18099eb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/223602632 >> v2:172.21.15.167:3300/0 conn(0x7f2b1815ebf0 0x7f2b18099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/223602632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 -- 172.21.15.1:0/223602632 >> 172.21.15.1:0/223602632 conn(0x7f2b180b2a70 msgr2=0x7f2b180b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 -- 172.21.15.1:0/223602632 shutdown_connections 2023-12-02T01:30:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.143+0000 7f2b1eeee640 1 -- 172.21.15.1:0/223602632 wait complete. 2023-12-02T01:30:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.144+0000 7f2b1eeee640 1 Processor -- start 2023-12-02T01:30:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.144+0000 7f2b1eeee640 1 -- start start 2023-12-02T01:30:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1eeee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b180cd540 0x7f2b1815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1eeee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1eeee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b1815ebf0 0x7f2b180c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1eeee640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180cb750 con 0x7f2b1815ebf0 2023-12-02T01:30:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1eeee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180caeb0 con 0x7f2b180cd540 2023-12-02T01:30:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1eeee640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180cb190 con 0x7f2b1815e810 2023-12-02T01:30:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b1815ebf0 0x7f2b180c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b1815ebf0 0x7f2b180c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34952/0 (socket says 172.21.15.1:34952) 2023-12-02T01:30:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 -- 172.21.15.1:0/2089819978 learned_addr learned my addr 172.21.15.1:0/2089819978 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1cc8a640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b180cd540 0x7f2b1815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b0ffff640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 -- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 msgr2=0x7f2b180b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 -- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b180cd540 msgr2=0x7f2b1815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b180cd540 0x7f2b1815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.145+0000 7f2b1d48b640 1 -- 172.21.15.1:0/2089819978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10009b30 con 0x7f2b1815ebf0 2023-12-02T01:30:27.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.146+0000 7f2b1d48b640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b1815ebf0 0x7f2b180c6080 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b10036040 tx=0x7f2b10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.146+0000 7f2b0d7fa640 1 -- 172.21.15.1:0/2089819978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1003e450 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.146+0000 7f2b0d7fa640 1 -- 172.21.15.1:0/2089819978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1003e5d0 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.146+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b180cb470 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.146+0000 7f2b0d7fa640 1 -- 172.21.15.1:0/2089819978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1003e980 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.146+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1815a9d0 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.147+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b180b3dd0 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.147+0000 7f2b0d7fa640 1 -- 172.21.15.1:0/2089819978 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b1003eae0 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.148+0000 7f2b0d7fa640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b0406ae40 0x7f2b0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.148+0000 7f2b0d7fa640 1 -- 172.21.15.1:0/2089819978 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2b100ac4f0 con 0x7f2b1815ebf0 2023-12-02T01:30:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.148+0000 7f2b1cc8a640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b0406ae40 0x7f2b0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.148+0000 7f2b1cc8a640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b0406ae40 0x7f2b0406d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400a990 tx=0x7f2b14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.152+0000 7f2b0d7fa640 1 -- 172.21.15.1:0/2089819978 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b100775b0 con 0x7f2b1815ebf0 2023-12-02T01:30:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.339+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b1809ef40 con 0x7f2b1815ebf0 2023-12-02T01:30:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.339+0000 7f2b0d7fa640 1 -- 172.21.15.1:0/2089819978 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2b1007abd0 con 0x7f2b1815ebf0 2023-12-02T01:30:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2023-12-02T01:30:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.341+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b0406ae40 msgr2=0x7f2b0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.341+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b0406ae40 0x7f2b0406d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400a990 tx=0x7f2b14008040 comp rx=0 tx=0).stop 2023-12-02T01:30:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.341+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b1815ebf0 msgr2=0x7f2b180c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.341+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b1815ebf0 0x7f2b180c6080 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b10036040 tx=0x7f2b10004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 shutdown_connections 2023-12-02T01:30:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b1815ebf0 0x7f2b180c6080 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b1815e810 0x7f2b180b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b0406ae40 0x7f2b0406d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 --2- 172.21.15.1:0/2089819978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b180cd540 0x7f2b1815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 >> 172.21.15.1:0/2089819978 conn(0x7f2b180b2a70 msgr2=0x7f2b1815d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 shutdown_connections 2023-12-02T01:30:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.342+0000 7f2b1eeee640 1 -- 172.21.15.1:0/2089819978 wait complete. 2023-12-02T01:30:27.354 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2023-12-02T01:30:27.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:27.354 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-02T01:30:27.386 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:27.387 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T01:30:27.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:27.387 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-02T01:30:27.445 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-02T01:30:27.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:30:27.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.553+0000 7f5d2fa4f640 1 Processor -- start 2023-12-02T01:30:27.555 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.553+0000 7f5d2fa4f640 1 -- start start 2023-12-02T01:30:27.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.554+0000 7f5d2fa4f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d280b2610 0x7f5d280b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.554+0000 7f5d2fa4f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d280b0660 con 0x7f5d2815d900 2023-12-02T01:30:27.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.554+0000 7f5d2fa4f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2806c900 con 0x7f5d2809a080 2023-12-02T01:30:27.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.554+0000 7f5d2fa4f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2806cbe0 con 0x7f5d280b2610 2023-12-02T01:30:27.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.554+0000 7f5d2d7eb640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5d2815d900 0x7f5d28099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51266/0 (socket says 172.21.15.1:51266) 2023-12-02T01:30:27.556 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.554+0000 7f5d2d7eb640 1 -- 172.21.15.1:0/1859382580 learned_addr learned my addr 172.21.15.1:0/1859382580 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.554+0000 7f5d2dfec640 1 --2- 172.21.15.1:0/1859382580 >> v2:172.21.15.167:3300/0 conn(0x7f5d280b2610 0x7f5d280b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.555+0000 7f5d27fff640 1 -- 172.21.15.1:0/1859382580 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506368832 0 0) 0x7f5d280b0660 con 0x7f5d2815d900 2023-12-02T01:30:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.555+0000 7f5d27fff640 1 -- 172.21.15.1:0/1859382580 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d10003520 con 0x7f5d2815d900 2023-12-02T01:30:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.555+0000 7f5d2dfec640 1 -- 172.21.15.1:0/1859382580 >> v1:172.21.15.167:6789/0 conn(0x7f5d2809a080 legacy=0x7f5d280b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.555+0000 7f5d2dfec640 1 -- 172.21.15.1:0/1859382580 >> v1:172.21.15.1:6789/0 conn(0x7f5d2815d900 legacy=0x7f5d28099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.557 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.555+0000 7f5d2dfec640 1 -- 172.21.15.1:0/1859382580 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2806cec0 con 0x7f5d280b2610 2023-12-02T01:30:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d2dfec640 1 --2- 172.21.15.1:0/1859382580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d280b2610 0x7f5d280b14e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d200097a0 tx=0x7f5d2002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6a8466b08b07831 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d27fff640 1 -- 172.21.15.1:0/1859382580 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20030610 con 0x7f5d280b2610 2023-12-02T01:30:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d27fff640 1 -- 172.21.15.1:0/1859382580 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20030770 con 0x7f5d280b2610 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d27fff640 1 -- 172.21.15.1:0/1859382580 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20030b00 con 0x7f5d280b2610 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/1859382580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d280b2610 msgr2=0x7f5d280b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/1859382580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d280b2610 0x7f5d280b14e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d200097a0 tx=0x7f5d2002b960 comp rx=0 tx=0).stop 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/1859382580 shutdown_connections 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/1859382580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d280b2610 0x7f5d280b14e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.556+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/1859382580 >> 172.21.15.1:0/1859382580 conn(0x7f5d280b2a70 msgr2=0x7f5d280b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.557+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/1859382580 shutdown_connections 2023-12-02T01:30:27.559 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.557+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/1859382580 wait complete. 2023-12-02T01:30:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 Processor -- start 2023-12-02T01:30:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 -- start start 2023-12-02T01:30:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d2809a080 0x7f5d281601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.561 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d280b2610 0x7f5d281f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d2815d900 0x7f5d281f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d281610d0 con 0x7f5d2809a080 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280c6080 con 0x7f5d2815d900 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.558+0000 7f5d2fa4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28160b10 con 0x7f5d280b2610 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d2809a080 0x7f5d281601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d2809a080 0x7f5d281601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34968/0 (socket says 172.21.15.1:34968) 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 -- 172.21.15.1:0/2529555745 learned_addr learned my addr 172.21.15.1:0/2529555745 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2dfec640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d2815d900 0x7f5d281f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2cfea640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d280b2610 0x7f5d281f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 -- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d280b2610 msgr2=0x7f5d281f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d280b2610 0x7f5d281f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 -- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d2815d900 msgr2=0x7f5d281f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.562 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d2815d900 0x7f5d281f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 -- 172.21.15.1:0/2529555745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009400 con 0x7f5d2809a080 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2dfec640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d2815d900 0x7f5d281f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2d7eb640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d2809a080 0x7f5d281601a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800cbc0 tx=0x7f5d1800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d25ffb640 1 -- 172.21.15.1:0/2529555745 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800ad40 con 0x7f5d2809a080 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d25ffb640 1 -- 172.21.15.1:0/2529555745 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18012400 con 0x7f5d2809a080 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d28160df0 con 0x7f5d2809a080 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d25ffb640 1 -- 172.21.15.1:0/2529555745 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800aea0 con 0x7f5d2809a080 2023-12-02T01:30:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.559+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d281606e0 con 0x7f5d2809a080 2023-12-02T01:30:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.560+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d280c5b00 con 0x7f5d2809a080 2023-12-02T01:30:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.561+0000 7f5d25ffb640 1 -- 172.21.15.1:0/2529555745 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d18007070 con 0x7f5d2809a080 2023-12-02T01:30:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.561+0000 7f5d25ffb640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5d1406ae40 0x7f5d1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.561+0000 7f5d25ffb640 1 -- 172.21.15.1:0/2529555745 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5d18089530 con 0x7f5d2809a080 2023-12-02T01:30:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.561+0000 7f5d2cfea640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5d1406ae40 0x7f5d1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.562+0000 7f5d2cfea640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5d1406ae40 0x7f5d1406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d280737c0 tx=0x7f5d1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.565+0000 7f5d25ffb640 1 -- 172.21.15.1:0/2529555745 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d280c5b00 con 0x7f5d2809a080 2023-12-02T01:30:27.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.778+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d280c5b00 con 0x7f5d2809a080 2023-12-02T01:30:27.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.778+0000 7f5d25ffb640 1 -- 172.21.15.1:0/2529555745 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f5d280c5b00 con 0x7f5d2809a080 2023-12-02T01:30:27.780 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:27.780 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:30:27.780 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5d1406ae40 msgr2=0x7f5d1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5d1406ae40 0x7f5d1406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d280737c0 tx=0x7f5d1c009040 comp rx=0 tx=0).stop 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d2809a080 msgr2=0x7f5d281601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d2809a080 0x7f5d281601a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800cbc0 tx=0x7f5d1800a430 comp rx=0 tx=0).stop 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 shutdown_connections 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f5d1406ae40 0x7f5d1406d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d2815d900 0x7f5d281f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d280b2610 0x7f5d281f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 --2- 172.21.15.1:0/2529555745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d2809a080 0x7f5d281601a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 >> 172.21.15.1:0/2529555745 conn(0x7f5d280b2a70 msgr2=0x7f5d2806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:27.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 shutdown_connections 2023-12-02T01:30:27.783 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.780+0000 7f5d2fa4f640 1 -- 172.21.15.1:0/2529555745 wait complete. 2023-12-02T01:30:27.793 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:27.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.897+0000 7ffac8b2c640 1 Processor -- start 2023-12-02T01:30:27.899 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.897+0000 7ffac8b2c640 1 -- start start 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.898+0000 7ffac8b2c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffac40b2610 0x7ffac40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.898+0000 7ffac8b2c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac40b0660 con 0x7ffac415d900 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.898+0000 7ffac8b2c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac406c900 con 0x7ffac409a080 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.898+0000 7ffac8b2c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac406cbe0 con 0x7ffac40b2610 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.898+0000 7ffac2d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ffac40b2610 0x7ffac40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.898+0000 7ffac259c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ffac415d900 0x7ffac4099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51268/0 (socket says 172.21.15.1:51268) 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.898+0000 7ffac259c640 1 -- 172.21.15.1:0/1621800037 learned_addr learned my addr 172.21.15.1:0/1621800037 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.899+0000 7ffac2d9d640 1 -- 172.21.15.1:0/1621800037 >> v1:172.21.15.167:6789/0 conn(0x7ffac409a080 legacy=0x7ffac40b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:27.900 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.899+0000 7ffac2d9d640 1 -- 172.21.15.1:0/1621800037 >> v1:172.21.15.1:6789/0 conn(0x7ffac415d900 legacy=0x7ffac4099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.899+0000 7ffac2d9d640 1 -- 172.21.15.1:0/1621800037 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac406cec0 con 0x7ffac40b2610 2023-12-02T01:30:27.901 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.899+0000 7ffac159a640 1 -- 172.21.15.1:0/1621800037 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652261986 0 0) 0x7ffac40b0660 con 0x7ffac415d900 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.899+0000 7ffac2d9d640 1 --2- 172.21.15.1:0/1621800037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40b14e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0097a0 tx=0x7ffabc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab282fe50a5ec5b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac159a640 1 -- 172.21.15.1:0/1621800037 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc031830 con 0x7ffac40b2610 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac159a640 1 -- 172.21.15.1:0/1621800037 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc031990 con 0x7ffac40b2610 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac159a640 1 -- 172.21.15.1:0/1621800037 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc031d20 con 0x7ffac40b2610 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac8b2c640 1 -- 172.21.15.1:0/1621800037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 msgr2=0x7ffac40b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/1621800037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40b14e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0097a0 tx=0x7ffabc02b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac8b2c640 1 -- 172.21.15.1:0/1621800037 shutdown_connections 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/1621800037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40b14e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac8b2c640 1 -- 172.21.15.1:0/1621800037 >> 172.21.15.1:0/1621800037 conn(0x7ffac40b2a70 msgr2=0x7ffac40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:27.902 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac8b2c640 1 -- 172.21.15.1:0/1621800037 shutdown_connections 2023-12-02T01:30:27.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.900+0000 7ffac8b2c640 1 -- 172.21.15.1:0/1621800037 wait complete. 2023-12-02T01:30:27.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 Processor -- start 2023-12-02T01:30:27.903 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 -- start start 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffac409a080 0x7ffac4150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffac415d900 0x7ffac40aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac41f2d70 con 0x7ffac40b2610 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac415f1f0 con 0x7ffac409a080 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac8b2c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac415f4d0 con 0x7ffac415d900 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34994/0 (socket says 172.21.15.1:34994) 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.902+0000 7ffac1d9b640 1 -- 172.21.15.1:0/4112060314 learned_addr learned my addr 172.21.15.1:0/4112060314 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:27.905 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac259c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffac409a080 0x7ffac4150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac2d9d640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffac415d900 0x7ffac40aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac1d9b640 1 -- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffac415d900 msgr2=0x7ffac40aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac1d9b640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffac415d900 0x7ffac40aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac1d9b640 1 -- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffac409a080 msgr2=0x7ffac4150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac1d9b640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffac409a080 0x7ffac4150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac1d9b640 1 -- 172.21.15.1:0/4112060314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009400 con 0x7ffac40b2610 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac259c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffac409a080 0x7ffac4150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac1d9b640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40c7400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00b3c0 tx=0x7ffaac00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffabaffd640 1 -- 172.21.15.1:0/4112060314 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011830 con 0x7ffac40b2610 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffabaffd640 1 -- 172.21.15.1:0/4112060314 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac011990 con 0x7ffac40b2610 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffabaffd640 1 -- 172.21.15.1:0/4112060314 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011d80 con 0x7ffac40b2610 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac415f7b0 con 0x7ffac40b2610 2023-12-02T01:30:27.906 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.903+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac415fd70 con 0x7ffac40b2610 2023-12-02T01:30:27.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.904+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac415ff90 con 0x7ffac40b2610 2023-12-02T01:30:27.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.905+0000 7ffabaffd640 1 -- 172.21.15.1:0/4112060314 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffaac01b460 con 0x7ffac40b2610 2023-12-02T01:30:27.907 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.905+0000 7ffabaffd640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffaa406ae40 0x7ffaa406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:27.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.905+0000 7ffabaffd640 1 -- 172.21.15.1:0/4112060314 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ffaac089240 con 0x7ffac40b2610 2023-12-02T01:30:27.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.905+0000 7ffac259c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffaa406ae40 0x7ffaa406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:27.908 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.906+0000 7ffac259c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffaa406ae40 0x7ffaa406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffab40012e0 tx=0x7ffab4005b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:27.911 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:27.910+0000 7ffabaffd640 1 -- 172.21.15.1:0/4112060314 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffaac0541d0 con 0x7ffac40b2610 2023-12-02T01:30:28.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.086+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffac4067420 con 0x7ffac40b2610 2023-12-02T01:30:28.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.087+0000 7ffabaffd640 1 -- 172.21.15.1:0/4112060314 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16707 (secure 0 0 0) 0x7ffaac0577f0 con 0x7ffac40b2610 2023-12-02T01:30:28.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:28.089 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:26.486281+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:28.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffaa406ae40 msgr2=0x7ffaa406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffaa406ae40 0x7ffaa406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffab40012e0 tx=0x7ffab4005b90 comp rx=0 tx=0).stop 2023-12-02T01:30:28.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 msgr2=0x7ffac40c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40c7400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00b3c0 tx=0x7ffaac00b880 comp rx=0 tx=0).stop 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 shutdown_connections 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffac415d900 0x7ffac40aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffac40b2610 0x7ffac40c7400 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ffaa406ae40 0x7ffaa406d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 --2- 172.21.15.1:0/4112060314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffac409a080 0x7ffac4150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 >> 172.21.15.1:0/4112060314 conn(0x7ffac40b2a70 msgr2=0x7ffac4099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 shutdown_connections 2023-12-02T01:30:28.092 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.089+0000 7ffac8b2c640 1 -- 172.21.15.1:0/4112060314 wait complete. 2023-12-02T01:30:28.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-02T01:29:42.820093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-02T01:29:43.685635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:28.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:28.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.211+0000 7fcb82b5a640 1 Processor -- start 2023-12-02T01:30:28.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.211+0000 7fcb82b5a640 1 -- start start 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb82b5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c0cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb82b5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcb7c15ef60 0x7fcb7c0ae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb82b5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c06ae00 con 0x7fcb7c15eb80 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb82b5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c0ccc70 con 0x7fcb7c15ef60 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb82b5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0cf120 con 0x7fcb7c0cc7f0 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c0cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb810f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcb7c15ef60 0x7fcb7c0ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c0cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:56906/0 (socket says 172.21.15.1:56906) 2023-12-02T01:30:28.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb810f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcb7c15ef60 0x7fcb7c0ae430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:58010/0 (socket says 172.21.15.1:58010) 2023-12-02T01:30:28.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7bfff640 1 -- 172.21.15.1:0/3877607134 learned_addr learned my addr 172.21.15.1:0/3877607134 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:28.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb808f6640 1 --1- 172.21.15.1:0/3877607134 >> v1:172.21.15.167:6789/0 conn(0x7fcb7c15eb80 0x7fcb7c15c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:54430/0 (socket says 172.21.15.1:54430) 2023-12-02T01:30:28.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7bfff640 1 -- 172.21.15.1:0/3877607134 >> v2:172.21.15.167:3300/0 conn(0x7fcb7c15ef60 msgr2=0x7fcb7c0ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:28.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7bfff640 1 --2- 172.21.15.1:0/3877607134 >> v2:172.21.15.167:3300/0 conn(0x7fcb7c15ef60 0x7fcb7c0ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7bfff640 1 -- 172.21.15.1:0/3877607134 >> v1:172.21.15.167:6789/0 conn(0x7fcb7c15eb80 legacy=0x7fcb7c15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7bfff640 1 -- 172.21.15.1:0/3877607134 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0cf3a0 con 0x7fcb7c0cc7f0 2023-12-02T01:30:28.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb7b7fe640 1 -- 172.21.15.1:0/3877607134 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830567950 0 0) 0x7fcb7c06ae00 con 0x7fcb7c15eb80 2023-12-02T01:30:28.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.212+0000 7fcb810f7640 1 --2- 172.21.15.1:0/3877607134 >> v2:172.21.15.167:3300/0 conn(0x7fcb7c15ef60 0x7fcb7c0ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:28.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.213+0000 7fcb7bfff640 1 --2- 172.21.15.1:0/3877607134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c0cebe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009870 tx=0x7fcb6802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c4752252bdef3c server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.213+0000 7fcb7b7fe640 1 -- 172.21.15.1:0/3877607134 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68030840 con 0x7fcb7c0cc7f0 2023-12-02T01:30:28.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.213+0000 7fcb7b7fe640 1 -- 172.21.15.1:0/3877607134 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb680309a0 con 0x7fcb7c0cc7f0 2023-12-02T01:30:28.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.213+0000 7fcb7b7fe640 1 -- 172.21.15.1:0/3877607134 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68030d30 con 0x7fcb7c0cc7f0 2023-12-02T01:30:28.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 -- 172.21.15.1:0/3877607134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 msgr2=0x7fcb7c0cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/3877607134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c0cebe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009870 tx=0x7fcb6802b980 comp rx=0 tx=0).stop 2023-12-02T01:30:28.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 -- 172.21.15.1:0/3877607134 shutdown_connections 2023-12-02T01:30:28.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/3877607134 >> v2:172.21.15.167:3300/0 conn(0x7fcb7c15ef60 0x7fcb7c0ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/3877607134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c0cebe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 -- 172.21.15.1:0/3877607134 >> 172.21.15.1:0/3877607134 conn(0x7fcb7c0b1670 msgr2=0x7fcb7c0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:28.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 -- 172.21.15.1:0/3877607134 shutdown_connections 2023-12-02T01:30:28.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.214+0000 7fcb82b5a640 1 -- 172.21.15.1:0/3877607134 wait complete. 2023-12-02T01:30:28.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.215+0000 7fcb82b5a640 1 Processor -- start 2023-12-02T01:30:28.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.215+0000 7fcb82b5a640 1 -- start start 2023-12-02T01:30:28.226 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb82b5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c1418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb82b5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb7c15eb80 0x7fcb7c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb82b5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c15ef60 0x7fcb7c1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb82b5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c142b00 con 0x7fcb7c15eb80 2023-12-02T01:30:28.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb82b5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c142820 con 0x7fcb7c15ef60 2023-12-02T01:30:28.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb82b5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c144200 con 0x7fcb7c0cc7f0 2023-12-02T01:30:28.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb7c15eb80 0x7fcb7c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.227 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb7bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb7c15eb80 0x7fcb7c156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35008/0 (socket says 172.21.15.1:35008) 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb7bfff640 1 -- 172.21.15.1:0/1117058373 learned_addr learned my addr 172.21.15.1:0/1117058373 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb808f6640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c1418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.216+0000 7fcb810f7640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c15ef60 0x7fcb7c1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb7bfff640 1 -- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 msgr2=0x7fcb7c1418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb7bfff640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c1418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb7bfff640 1 -- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c15ef60 msgr2=0x7fcb7c1f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb7bfff640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c15ef60 0x7fcb7c1f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb7bfff640 1 -- 172.21.15.1:0/1117058373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009a70 con 0x7fcb7c15eb80 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb7bfff640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb7c15eb80 0x7fcb7c156f10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009870 tx=0x7fcb68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb797fa640 1 -- 172.21.15.1:0/1117058373 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6803e040 con 0x7fcb7c15eb80 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb797fa640 1 -- 172.21.15.1:0/1117058373 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68039cb0 con 0x7fcb7c15eb80 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb680094d0 con 0x7fcb7c15eb80 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb797fa640 1 -- 172.21.15.1:0/1117058373 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68004270 con 0x7fcb7c15eb80 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.217+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c1447c0 con 0x7fcb7c15eb80 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.218+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7c153030 con 0x7fcb7c15eb80 2023-12-02T01:30:28.229 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.218+0000 7fcb797fa640 1 -- 172.21.15.1:0/1117058373 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb680043d0 con 0x7fcb7c15eb80 2023-12-02T01:30:28.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.219+0000 7fcb797fa640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcb6006ae70 0x7fcb6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.219+0000 7fcb797fa640 1 -- 172.21.15.1:0/1117058373 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcb680aba00 con 0x7fcb7c15eb80 2023-12-02T01:30:28.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.219+0000 7fcb808f6640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcb6006ae70 0x7fcb6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.219+0000 7fcb808f6640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcb6006ae70 0x7fcb6006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb70000f60 tx=0x7fcb70007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.230 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.223+0000 7fcb797fa640 1 -- 172.21.15.1:0/1117058373 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb7c153030 con 0x7fcb7c15eb80 2023-12-02T01:30:28.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.399+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb7c153030 con 0x7fcb7c15eb80 2023-12-02T01:30:28.401 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.399+0000 7fcb797fa640 1 -- 172.21.15.1:0/1117058373 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb7c153030 con 0x7fcb7c15eb80 2023-12-02T01:30:28.401 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcb6006ae70 msgr2=0x7fcb6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcb6006ae70 0x7fcb6006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb70000f60 tx=0x7fcb70007d50 comp rx=0 tx=0).stop 2023-12-02T01:30:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb7c15eb80 msgr2=0x7fcb7c156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb7c15eb80 0x7fcb7c156f10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009870 tx=0x7fcb68004730 comp rx=0 tx=0).stop 2023-12-02T01:30:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 shutdown_connections 2023-12-02T01:30:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fcb6006ae70 0x7fcb6006d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c15ef60 0x7fcb7c1f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb7c15eb80 0x7fcb7c156f10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 --2- 172.21.15.1:0/1117058373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb7c0cc7f0 0x7fcb7c1418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 >> 172.21.15.1:0/1117058373 conn(0x7fcb7c0b1670 msgr2=0x7fcb7c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:28.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.401+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 shutdown_connections 2023-12-02T01:30:28.404 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.402+0000 7fcb82b5a640 1 -- 172.21.15.1:0/1117058373 wait complete. 2023-12-02T01:30:28.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-02T01:30:28.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.522+0000 7f8d37ea6640 1 Processor -- start 2023-12-02T01:30:28.524 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.522+0000 7f8d37ea6640 1 -- start start 2023-12-02T01:30:28.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d37ea6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d3006ec60 0x7f8d3015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d37ea6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3009a720 con 0x7f8d3006e460 2023-12-02T01:30:28.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d37ea6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d30099b10 con 0x7f8d3015d690 2023-12-02T01:30:28.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d37ea6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3015e9d0 con 0x7f8d3006ec60 2023-12-02T01:30:28.527 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d35c42640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d3006ec60 0x7f8d3015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d35c42640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8d3006ec60 0x7f8d3015e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35024/0 (socket says 172.21.15.1:35024) 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d35c42640 1 -- 172.21.15.1:0/2909177204 learned_addr learned my addr 172.21.15.1:0/2909177204 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.523+0000 7f8d36443640 1 --1- 172.21.15.1:0/2909177204 >> v1:172.21.15.1:6789/0 conn(0x7f8d3006e460 0x7f8d300cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51284/0 (socket says 172.21.15.1:51284) 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.524+0000 7f8d35c42640 1 -- 172.21.15.1:0/2909177204 >> v1:172.21.15.167:6789/0 conn(0x7f8d3015d690 legacy=0x7f8d3006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.524+0000 7f8d35c42640 1 -- 172.21.15.1:0/2909177204 >> v1:172.21.15.1:6789/0 conn(0x7f8d3006e460 legacy=0x7f8d300cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.524+0000 7f8d35c42640 1 -- 172.21.15.1:0/2909177204 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30099df0 con 0x7f8d3006ec60 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.524+0000 7f8d34c40640 1 -- 172.21.15.1:0/2909177204 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126838539 0 0) 0x7f8d3009a720 con 0x7f8d3006e460 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.524+0000 7f8d35c42640 1 --2- 172.21.15.1:0/2909177204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006ec60 0x7f8d3015e490 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009e50 tx=0x7f8d2c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865cdfd15d62fac7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.524+0000 7f8d34c40640 1 -- 172.21.15.1:0/2909177204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c02ca80 con 0x7f8d3006ec60 2023-12-02T01:30:28.528 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d34c40640 1 -- 172.21.15.1:0/2909177204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c02cbe0 con 0x7f8d3006ec60 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d34c40640 1 -- 172.21.15.1:0/2909177204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0343f0 con 0x7f8d3006ec60 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d37ea6640 1 -- 172.21.15.1:0/2909177204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006ec60 msgr2=0x7f8d3015e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/2909177204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006ec60 0x7f8d3015e490 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009e50 tx=0x7f8d2c02bee0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d37ea6640 1 -- 172.21.15.1:0/2909177204 shutdown_connections 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/2909177204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006ec60 0x7f8d3015e490 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d37ea6640 1 -- 172.21.15.1:0/2909177204 >> 172.21.15.1:0/2909177204 conn(0x7f8d300b2a20 msgr2=0x7f8d300b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d37ea6640 1 -- 172.21.15.1:0/2909177204 shutdown_connections 2023-12-02T01:30:28.529 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.525+0000 7f8d37ea6640 1 -- 172.21.15.1:0/2909177204 wait complete. 2023-12-02T01:30:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.526+0000 7f8d37ea6640 1 Processor -- start 2023-12-02T01:30:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.526+0000 7f8d37ea6640 1 -- start start 2023-12-02T01:30:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d37ea6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006e460 0x7f8d300b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d37ea6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3006ec60 0x7f8d300b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d37ea6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d301f66b0 0x7f8d300b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d37ea6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30157c50 con 0x7f8d3006e460 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d37ea6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300b69e0 con 0x7f8d3006ec60 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d37ea6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300b3b50 con 0x7f8d301f66b0 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006e460 0x7f8d300b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006e460 0x7f8d300b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35030/0 (socket says 172.21.15.1:35030) 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 -- 172.21.15.1:0/3186011130 learned_addr learned my addr 172.21.15.1:0/3186011130 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d36443640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d301f66b0 0x7f8d300b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35441640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3006ec60 0x7f8d300b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.534 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 -- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d301f66b0 msgr2=0x7f8d300b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d301f66b0 0x7f8d300b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 -- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3006ec60 msgr2=0x7f8d300b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3006ec60 0x7f8d300b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.527+0000 7f8d35c42640 1 -- 172.21.15.1:0/3186011130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c009b30 con 0x7f8d3006e460 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.528+0000 7f8d35c42640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006e460 0x7f8d300b6400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c036040 tx=0x7f8d2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.528+0000 7f8d267fc640 1 -- 172.21.15.1:0/3186011130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c009510 con 0x7f8d3006e460 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.528+0000 7f8d267fc640 1 -- 172.21.15.1:0/3186011130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c03e450 con 0x7f8d3006e460 2023-12-02T01:30:28.535 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.528+0000 7f8d267fc640 1 -- 172.21.15.1:0/3186011130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c03e7e0 con 0x7f8d3006e460 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.528+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d300b3e30 con 0x7f8d3006e460 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.528+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d300b43f0 con 0x7f8d3006e460 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.529+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3009f040 con 0x7f8d3006e460 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.529+0000 7f8d267fc640 1 -- 172.21.15.1:0/3186011130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d2c02cd50 con 0x7f8d3006e460 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.530+0000 7f8d267fc640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d1406ae40 0x7f8d1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.530+0000 7f8d267fc640 1 -- 172.21.15.1:0/3186011130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8d2c0ac3c0 con 0x7f8d3006e460 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.530+0000 7f8d35441640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d1406ae40 0x7f8d1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.536 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.530+0000 7f8d35441640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d1406ae40 0x7f8d1406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8d20006fd0 tx=0x7f8d20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.537 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.534+0000 7f8d267fc640 1 -- 172.21.15.1:0/3186011130 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d2c077360 con 0x7f8d3006e460 2023-12-02T01:30:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.708+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d300b61e0 con 0x7f8d3006e460 2023-12-02T01:30:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.709+0000 7f8d267fc640 1 -- 172.21.15.1:0/3186011130 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d2c07a980 con 0x7f8d3006e460 2023-12-02T01:30:28.711 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2023-12-02T01:30:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d1406ae40 msgr2=0x7f8d1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d1406ae40 0x7f8d1406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8d20006fd0 tx=0x7f8d20008040 comp rx=0 tx=0).stop 2023-12-02T01:30:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006e460 msgr2=0x7f8d300b6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006e460 0x7f8d300b6400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c036040 tx=0x7f8d2c004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 shutdown_connections 2023-12-02T01:30:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d301f66b0 0x7f8d300b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8d1406ae40 0x7f8d1406d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d3006ec60 0x7f8d300b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 --2- 172.21.15.1:0/3186011130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d3006e460 0x7f8d300b6400 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 >> 172.21.15.1:0/3186011130 conn(0x7f8d300b2a20 msgr2=0x7f8d300b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 shutdown_connections 2023-12-02T01:30:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.711+0000 7f8d37ea6640 1 -- 172.21.15.1:0/3186011130 wait complete. 2023-12-02T01:30:28.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-02T01:30:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.831+0000 7fbe82d5a640 1 Processor -- start 2023-12-02T01:30:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.831+0000 7fbe82d5a640 1 -- start start 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe82d5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe82d5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbe7c0b2aa0 0x7fbe7c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe82d5a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe7c0ced30 0x7fbe7c0cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe82d5a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0ce360 con 0x7fbe7c0ced30 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe82d5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b2f20 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe82d5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0cdd50 con 0x7fbe7c160b70 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe812f7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe7c0ced30 0x7fbe7c0cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe812f7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe7c0ced30 0x7fbe7c0cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35046/0 (socket says 172.21.15.1:35046) 2023-12-02T01:30:28.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.832+0000 7fbe812f7640 1 -- 172.21.15.1:0/1469382615 learned_addr learned my addr 172.21.15.1:0/1469382615 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe812f7640 1 -- 172.21.15.1:0/1469382615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 msgr2=0x7fbe7c0d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe80af6640 1 --2- 172.21.15.1:0/1469382615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe7bfff640 1 --2- 172.21.15.1:0/1469382615 >> v2:172.21.15.167:3300/0 conn(0x7fbe7c0b2aa0 0x7fbe7c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe812f7640 1 --2- 172.21.15.1:0/1469382615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe812f7640 1 -- 172.21.15.1:0/1469382615 >> v2:172.21.15.167:3300/0 conn(0x7fbe7c0b2aa0 msgr2=0x7fbe7c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe812f7640 1 --2- 172.21.15.1:0/1469382615 >> v2:172.21.15.167:3300/0 conn(0x7fbe7c0b2aa0 0x7fbe7c0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe812f7640 1 -- 172.21.15.1:0/1469382615 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0d1c70 con 0x7fbe7c0ced30 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.833+0000 7fbe812f7640 1 --2- 172.21.15.1:0/1469382615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0ced30 0x7fbe7c0cfb50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c08b550 tx=0x7fbe6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd4115e0431759a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe7b7fe640 1 -- 172.21.15.1:0/1469382615 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64031870 con 0x7fbe7c0ced30 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe7b7fe640 1 -- 172.21.15.1:0/1469382615 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640319d0 con 0x7fbe7c0ced30 2023-12-02T01:30:28.836 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe7b7fe640 1 -- 172.21.15.1:0/1469382615 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64031d60 con 0x7fbe7c0ced30 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 -- 172.21.15.1:0/1469382615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0ced30 msgr2=0x7fbe7c0cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/1469382615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0ced30 0x7fbe7c0cfb50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c08b550 tx=0x7fbe6402b910 comp rx=0 tx=0).stop 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 -- 172.21.15.1:0/1469382615 shutdown_connections 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/1469382615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0ced30 0x7fbe7c0cfb50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/1469382615 >> v2:172.21.15.167:3300/0 conn(0x7fbe7c0b2aa0 0x7fbe7c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/1469382615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 -- 172.21.15.1:0/1469382615 >> 172.21.15.1:0/1469382615 conn(0x7fbe7c09c470 msgr2=0x7fbe7c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 -- 172.21.15.1:0/1469382615 shutdown_connections 2023-12-02T01:30:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.834+0000 7fbe82d5a640 1 -- 172.21.15.1:0/1469382615 wait complete. 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.835+0000 7fbe82d5a640 1 Processor -- start 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.835+0000 7fbe82d5a640 1 -- start start 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe82d5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0b2aa0 0x7fbe7c15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe82d5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe7c0ced30 0x7fbe7c09cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe82d5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe82d5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c15d030 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe82d5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c15d310 con 0x7fbe7c0ced30 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe82d5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c15d5f0 con 0x7fbe7c160b70 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe80af6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0b2aa0 0x7fbe7c15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe80af6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0b2aa0 0x7fbe7c15a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35060/0 (socket says 172.21.15.1:35060) 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.836+0000 7fbe80af6640 1 -- 172.21.15.1:0/3701499077 learned_addr learned my addr 172.21.15.1:0/3701499077 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe7bfff640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe7c0ced30 0x7fbe7c09cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe812f7640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe80af6640 1 -- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 msgr2=0x7fbe7c0b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe80af6640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe80af6640 1 -- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe7c0ced30 msgr2=0x7fbe7c09cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe80af6640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe7c0ced30 0x7fbe7c09cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe80af6640 1 -- 172.21.15.1:0/3701499077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640094d0 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe80af6640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0b2aa0 0x7fbe7c15a950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c7f0 tx=0x7fbe7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe797fa640 1 -- 172.21.15.1:0/3701499077 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74004220 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe797fa640 1 -- 172.21.15.1:0/3701499077 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74004380 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe797fa640 1 -- 172.21.15.1:0/3701499077 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74007840 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c15d8d0 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.841 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.837+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c15cc50 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.838+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0ce7f0 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.839+0000 7fbe797fa640 1 -- 172.21.15.1:0/3701499077 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe74007bb0 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.839+0000 7fbe797fa640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbe5c06ae40 0x7fbe5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.839+0000 7fbe797fa640 1 -- 172.21.15.1:0/3701499077 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbe740894f0 con 0x7fbe7c0b2aa0 2023-12-02T01:30:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.839+0000 7fbe7bfff640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbe5c06ae40 0x7fbe5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.840+0000 7fbe7bfff640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbe5c06ae40 0x7fbe5c06d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c06d1d0 tx=0x7fbe6c007740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:28.845 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:28.844+0000 7fbe797fa640 1 -- 172.21.15.1:0/3701499077 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe740545c0 con 0x7fbe7c0b2aa0 2023-12-02T01:30:29.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.020+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe7c0afdd0 con 0x7fbe7c0b2aa0 2023-12-02T01:30:29.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.021+0000 7fbe797fa640 1 -- 172.21.15.1:0/3701499077 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe7401e020 con 0x7fbe7c0b2aa0 2023-12-02T01:30:29.023 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2023-12-02T01:30:29.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbe5c06ae40 msgr2=0x7fbe5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbe5c06ae40 0x7fbe5c06d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c06d1d0 tx=0x7fbe6c007740 comp rx=0 tx=0).stop 2023-12-02T01:30:29.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0b2aa0 msgr2=0x7fbe7c15a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0b2aa0 0x7fbe7c15a950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c7f0 tx=0x7fbe7400ccb0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 shutdown_connections 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe7c160b70 0x7fbe7c0b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fbe5c06ae40 0x7fbe5c06d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe7c0ced30 0x7fbe7c09cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 --2- 172.21.15.1:0/3701499077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7c0b2aa0 0x7fbe7c15a950 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 >> 172.21.15.1:0/3701499077 conn(0x7fbe7c09c470 msgr2=0x7fbe7c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 shutdown_connections 2023-12-02T01:30:29.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.023+0000 7fbe82d5a640 1 -- 172.21.15.1:0/3701499077 wait complete. 2023-12-02T01:30:29.035 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:30:29.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.140+0000 7fb081e4f640 1 Processor -- start 2023-12-02T01:30:29.254 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.140+0000 7fb081e4f640 1 -- start start 2023-12-02T01:30:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb081e4f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb07c13e2d0 0x7fb07c0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb081e4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c0b4640 0x7fb07c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb081e4f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb07c15bd90 0x7fb07c140860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb081e4f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15fc60 con 0x7fb07c13e2d0 2023-12-02T01:30:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb081e4f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0b4aa0 con 0x7fb07c15bd90 2023-12-02T01:30:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb081e4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c06de80 con 0x7fb07c0b4640 2023-12-02T01:30:29.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb07c13e2d0 0x7fb07c0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb07c13e2d0 0x7fb07c0b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35072/0 (socket says 172.21.15.1:35072) 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 -- 172.21.15.1:0/3781943237 learned_addr learned my addr 172.21.15.1:0/3781943237 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07affd640 1 --2- 172.21.15.1:0/3781943237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c0b4640 0x7fb07c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07bfff640 1 --2- 172.21.15.1:0/3781943237 >> v2:172.21.15.167:3300/0 conn(0x7fb07c15bd90 0x7fb07c140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 -- 172.21.15.1:0/3781943237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c0b4640 msgr2=0x7fb07c15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 --2- 172.21.15.1:0/3781943237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c0b4640 0x7fb07c15b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 -- 172.21.15.1:0/3781943237 >> v2:172.21.15.167:3300/0 conn(0x7fb07c15bd90 msgr2=0x7fb07c140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 --2- 172.21.15.1:0/3781943237 >> v2:172.21.15.167:3300/0 conn(0x7fb07c15bd90 0x7fb07c140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.141+0000 7fb07b7fe640 1 -- 172.21.15.1:0/3781943237 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c06d5c0 con 0x7fb07c13e2d0 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.142+0000 7fb07b7fe640 1 --2- 172.21.15.1:0/3781943237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c13e2d0 0x7fb07c0b4100 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0ae530 tx=0x7fb06c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a414cc7c12a94557 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.142+0000 7fb07a7fc640 1 -- 172.21.15.1:0/3781943237 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c031640 con 0x7fb07c13e2d0 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.142+0000 7fb07a7fc640 1 -- 172.21.15.1:0/3781943237 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c0317a0 con 0x7fb07c13e2d0 2023-12-02T01:30:29.260 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.142+0000 7fb07a7fc640 1 -- 172.21.15.1:0/3781943237 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c031b30 con 0x7fb07c13e2d0 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.142+0000 7fb081e4f640 1 -- 172.21.15.1:0/3781943237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c13e2d0 msgr2=0x7fb07c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.142+0000 7fb081e4f640 1 --2- 172.21.15.1:0/3781943237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c13e2d0 0x7fb07c0b4100 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0ae530 tx=0x7fb06c02b8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.143+0000 7fb081e4f640 1 -- 172.21.15.1:0/3781943237 shutdown_connections 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.143+0000 7fb081e4f640 1 --2- 172.21.15.1:0/3781943237 >> v2:172.21.15.167:3300/0 conn(0x7fb07c15bd90 0x7fb07c140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.143+0000 7fb081e4f640 1 --2- 172.21.15.1:0/3781943237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c0b4640 0x7fb07c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.143+0000 7fb081e4f640 1 --2- 172.21.15.1:0/3781943237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c13e2d0 0x7fb07c0b4100 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.143+0000 7fb081e4f640 1 -- 172.21.15.1:0/3781943237 >> 172.21.15.1:0/3781943237 conn(0x7fb07c0b0af0 msgr2=0x7fb07c0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.143+0000 7fb081e4f640 1 -- 172.21.15.1:0/3781943237 shutdown_connections 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.143+0000 7fb081e4f640 1 -- 172.21.15.1:0/3781943237 wait complete. 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.144+0000 7fb081e4f640 1 Processor -- start 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.144+0000 7fb081e4f640 1 -- start start 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb081e4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c0b4640 0x7fb07c13bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb081e4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb07c13e2d0 0x7fb07c13c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.261 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb081e4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c15bd90 0x7fb07c138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb081e4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1f0d40 con 0x7fb07c0b4640 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb081e4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c13cee0 con 0x7fb07c13e2d0 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb081e4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c13c920 con 0x7fb07c15bd90 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c0b4640 0x7fb07c13bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c0b4640 0x7fb07c13bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35086/0 (socket says 172.21.15.1:35086) 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 -- 172.21.15.1:0/106188872 learned_addr learned my addr 172.21.15.1:0/106188872 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07affd640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb07c13e2d0 0x7fb07c13c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07bfff640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c15bd90 0x7fb07c138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 -- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c15bd90 msgr2=0x7fb07c138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c15bd90 0x7fb07c138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 -- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb07c13e2d0 msgr2=0x7fb07c13c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb07c13e2d0 0x7fb07c13c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 -- 172.21.15.1:0/106188872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0094d0 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07affd640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb07c13e2d0 0x7fb07c13c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07bfff640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c15bd90 0x7fb07c138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb07b7fe640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c0b4640 0x7fb07c13bdc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb073fff640 1 -- 172.21.15.1:0/106188872 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c03ac60 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb073fff640 1 -- 172.21.15.1:0/106188872 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c03adc0 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c13cc00 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.145+0000 7fb073fff640 1 -- 172.21.15.1:0/106188872 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c044630 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.146+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c1f1210 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.146+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c1f1400 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.147+0000 7fb073fff640 1 -- 172.21.15.1:0/106188872 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb06c02f050 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.147+0000 7fb073fff640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb05c06ae40 0x7fb05c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.147+0000 7fb073fff640 1 -- 172.21.15.1:0/106188872 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb06c0ab560 con 0x7fb07c0b4640 2023-12-02T01:30:29.263 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.147+0000 7fb07affd640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb05c06ae40 0x7fb05c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.148+0000 7fb07affd640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb05c06ae40 0x7fb05c06d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb07c151a40 tx=0x7fb064008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.264 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.152+0000 7fb073fff640 1 -- 172.21.15.1:0/106188872 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb06c076590 con 0x7fb07c0b4640 2023-12-02T01:30:29.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.363+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb07c067420 con 0x7fb07c0b4640 2023-12-02T01:30:29.365 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.363+0000 7fb073fff640 1 -- 172.21.15.1:0/106188872 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fb06c079bb0 con 0x7fb07c0b4640 2023-12-02T01:30:29.365 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:29.365 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:30:29.365 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:30:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb05c06ae40 msgr2=0x7fb05c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb05c06ae40 0x7fb05c06d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb07c151a40 tx=0x7fb064008040 comp rx=0 tx=0).stop 2023-12-02T01:30:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c0b4640 msgr2=0x7fb07c13bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c0b4640 0x7fb07c13bdc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c0046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 shutdown_connections 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb07c15bd90 0x7fb07c138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb05c06ae40 0x7fb05c06d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb07c13e2d0 0x7fb07c13c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 --2- 172.21.15.1:0/106188872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb07c0b4640 0x7fb07c13bdc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 >> 172.21.15.1:0/106188872 conn(0x7fb07c0b0af0 msgr2=0x7fb07c0cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.365+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 shutdown_connections 2023-12-02T01:30:29.368 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.366+0000 7fb081e4f640 1 -- 172.21.15.1:0/106188872 wait complete. 2023-12-02T01:30:29.381 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:29.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.486+0000 7f52d7e4f640 1 Processor -- start 2023-12-02T01:30:29.488 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.487+0000 7f52d7e4f640 1 -- start start 2023-12-02T01:30:29.489 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.487+0000 7f52d7e4f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52d015d3e0 0x7f52d00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.487+0000 7f52d7e4f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00b5f90 con 0x7f52d00d1e30 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.487+0000 7f52d7e4f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00b61e0 con 0x7f52d00ced30 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.487+0000 7f52d7e4f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d00cf170 con 0x7f52d015d3e0 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d63ec640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f52d00d1e30 0x7f52d00b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51292/0 (socket says 172.21.15.1:51292) 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d63ec640 1 -- 172.21.15.1:0/1037275502 learned_addr learned my addr 172.21.15.1:0/1037275502 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d5beb640 1 --2- 172.21.15.1:0/1037275502 >> v2:172.21.15.167:3300/0 conn(0x7f52d015d3e0 0x7f52d00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d4be9640 1 -- 172.21.15.1:0/1037275502 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734369506 0 0) 0x7f52d00b5f90 con 0x7f52d00d1e30 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d4be9640 1 -- 172.21.15.1:0/1037275502 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc003520 con 0x7f52d00d1e30 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d5beb640 1 -- 172.21.15.1:0/1037275502 >> v1:172.21.15.167:6789/0 conn(0x7f52d00ced30 legacy=0x7f52d00d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d5beb640 1 -- 172.21.15.1:0/1037275502 >> v1:172.21.15.1:6789/0 conn(0x7f52d00d1e30 legacy=0x7f52d00b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d4be9640 1 -- 172.21.15.1:0/1037275502 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554463549 0 0) 0x7f52d00b61e0 con 0x7f52d00ced30 2023-12-02T01:30:29.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.488+0000 7f52d5beb640 1 -- 172.21.15.1:0/1037275502 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00b64c0 con 0x7f52d015d3e0 2023-12-02T01:30:29.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.489+0000 7f52d5beb640 1 --2- 172.21.15.1:0/1037275502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015d3e0 0x7f52d00ce7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0097a0 tx=0x7f52cc02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7a6bf2d0a0aa74a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.489+0000 7f52d4be9640 1 -- 172.21.15.1:0/1037275502 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc02f810 con 0x7f52d015d3e0 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.489+0000 7f52d4be9640 1 -- 172.21.15.1:0/1037275502 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc02f970 con 0x7f52d015d3e0 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.489+0000 7f52d4be9640 1 -- 172.21.15.1:0/1037275502 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc02fce0 con 0x7f52d015d3e0 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.490+0000 7f52d7e4f640 1 -- 172.21.15.1:0/1037275502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015d3e0 msgr2=0x7f52d00ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.490+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/1037275502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015d3e0 0x7f52d00ce7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0097a0 tx=0x7f52cc02b9f0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.490+0000 7f52d7e4f640 1 -- 172.21.15.1:0/1037275502 shutdown_connections 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.490+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/1037275502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d015d3e0 0x7f52d00ce7f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.490+0000 7f52d7e4f640 1 -- 172.21.15.1:0/1037275502 >> 172.21.15.1:0/1037275502 conn(0x7f52d009c480 msgr2=0x7f52d00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.490+0000 7f52d7e4f640 1 -- 172.21.15.1:0/1037275502 shutdown_connections 2023-12-02T01:30:29.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.490+0000 7f52d7e4f640 1 -- 172.21.15.1:0/1037275502 wait complete. 2023-12-02T01:30:29.494 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.491+0000 7f52d7e4f640 1 Processor -- start 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.491+0000 7f52d7e4f640 1 -- start start 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d7e4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d00ced30 0x7f52d00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d7e4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d00d1e30 0x7f52d0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d7e4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d015d3e0 0x7f52d0154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d7e4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00ca210 con 0x7f52d015d3e0 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d7e4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00cb070 con 0x7f52d00ced30 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d7e4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00ca460 con 0x7f52d00d1e30 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d015d3e0 0x7f52d0154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d015d3e0 0x7f52d0154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35094/0 (socket says 172.21.15.1:35094) 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 -- 172.21.15.1:0/821442975 learned_addr learned my addr 172.21.15.1:0/821442975 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d5beb640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d00ced30 0x7f52d00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.495 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d53ea640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d00d1e30 0x7f52d0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 -- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d00d1e30 msgr2=0x7f52d0159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d00d1e30 0x7f52d0159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 -- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d00ced30 msgr2=0x7f52d00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d00ced30 0x7f52d00cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 -- 172.21.15.1:0/821442975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc009400 con 0x7f52d015d3e0 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.492+0000 7f52d63ec640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d015d3e0 0x7f52d0154fa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f52c800cb70 tx=0x7f52c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.493+0000 7f52c67fc640 1 -- 172.21.15.1:0/821442975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800ad40 con 0x7f52d015d3e0 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.493+0000 7f52c67fc640 1 -- 172.21.15.1:0/821442975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8012400 con 0x7f52d015d3e0 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.493+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00ca740 con 0x7f52d015d3e0 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.493+0000 7f52c67fc640 1 -- 172.21.15.1:0/821442975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800aea0 con 0x7f52d015d3e0 2023-12-02T01:30:29.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.493+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d00cad00 con 0x7f52d015d3e0 2023-12-02T01:30:29.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.494+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d0067420 con 0x7f52d015d3e0 2023-12-02T01:30:29.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.494+0000 7f52c67fc640 1 -- 172.21.15.1:0/821442975 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52c8007070 con 0x7f52d015d3e0 2023-12-02T01:30:29.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.495+0000 7f52c67fc640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f52b406ae70 0x7f52b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.495+0000 7f52c67fc640 1 -- 172.21.15.1:0/821442975 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f52c8089640 con 0x7f52d015d3e0 2023-12-02T01:30:29.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.495+0000 7f52d5beb640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f52b406ae70 0x7f52b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.495+0000 7f52d5beb640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f52b406ae70 0x7f52b406d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52cc036000 tx=0x7f52cc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.500 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.499+0000 7f52c67fc640 1 -- 172.21.15.1:0/821442975 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52c8054690 con 0x7f52d015d3e0 2023-12-02T01:30:29.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.676+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d00cb1b0 con 0x7f52d015d3e0 2023-12-02T01:30:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.677+0000 7f52c67fc640 1 -- 172.21.15.1:0/821442975 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16707 (secure 0 0 0) 0x7f52c8017090 con 0x7f52d015d3e0 2023-12-02T01:30:29.679 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:29.679 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:26.486281+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f52b406ae70 msgr2=0x7f52b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f52b406ae70 0x7f52b406d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52cc036000 tx=0x7f52cc008030 comp rx=0 tx=0).stop 2023-12-02T01:30:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d015d3e0 msgr2=0x7f52d0154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d015d3e0 0x7f52d0154fa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f52c800cb70 tx=0x7f52c800a430 comp rx=0 tx=0).stop 2023-12-02T01:30:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 shutdown_connections 2023-12-02T01:30:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52d015d3e0 0x7f52d0154fa0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52d00d1e30 0x7f52d0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f52b406ae70 0x7f52b406d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 --2- 172.21.15.1:0/821442975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52d00ced30 0x7f52d00cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 >> 172.21.15.1:0/821442975 conn(0x7f52d009c480 msgr2=0x7f52d00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 shutdown_connections 2023-12-02T01:30:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.679+0000 7f52d7e4f640 1 -- 172.21.15.1:0/821442975 wait complete. 2023-12-02T01:30:29.692 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-02T01:30:29.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:30:29.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.796+0000 7ff970d9e640 1 Processor -- start 2023-12-02T01:30:29.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.796+0000 7ff970d9e640 1 -- start start 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.797+0000 7ff970d9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff96c15d900 0x7ff96c099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.797+0000 7ff970d9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b2610 0x7ff96c099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.797+0000 7ff970d9e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff96c0b00c0 0x7ff96c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.797+0000 7ff970d9e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0b0660 con 0x7ff96c0b00c0 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.797+0000 7ff970d9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c06c900 con 0x7ff96c15d900 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.797+0000 7ff970d9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c06cbe0 con 0x7ff96c0b2610 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff96c0b00c0 0x7ff96c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff96c0b00c0 0x7ff96c0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35108/0 (socket says 172.21.15.1:35108) 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 -- 172.21.15.1:0/2162914059 learned_addr learned my addr 172.21.15.1:0/2162914059 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96a59c640 1 --2- 172.21.15.1:0/2162914059 >> v2:172.21.15.167:3300/0 conn(0x7ff96c15d900 0x7ff96c099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff969d9b640 1 --2- 172.21.15.1:0/2162914059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b2610 0x7ff96c099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 -- 172.21.15.1:0/2162914059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b2610 msgr2=0x7ff96c099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 --2- 172.21.15.1:0/2162914059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b2610 0x7ff96c099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 -- 172.21.15.1:0/2162914059 >> v2:172.21.15.167:3300/0 conn(0x7ff96c15d900 msgr2=0x7ff96c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 --2- 172.21.15.1:0/2162914059 >> v2:172.21.15.167:3300/0 conn(0x7ff96c15d900 0x7ff96c099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.798+0000 7ff96ad9d640 1 -- 172.21.15.1:0/2162914059 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c06cec0 con 0x7ff96c0b00c0 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff96ad9d640 1 --2- 172.21.15.1:0/2162914059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b00c0 0x7ff96c0cee80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0d0ee0 tx=0x7ff95c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5b649c4ae7ee00 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff96959a640 1 -- 172.21.15.1:0/2162914059 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c02ca70 con 0x7ff96c0b00c0 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff96959a640 1 -- 172.21.15.1:0/2162914059 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c02cbd0 con 0x7ff96c0b00c0 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff96959a640 1 -- 172.21.15.1:0/2162914059 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0343f0 con 0x7ff96c0b00c0 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 -- 172.21.15.1:0/2162914059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b00c0 msgr2=0x7ff96c0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 --2- 172.21.15.1:0/2162914059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b00c0 0x7ff96c0cee80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0d0ee0 tx=0x7ff95c02bed0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 -- 172.21.15.1:0/2162914059 shutdown_connections 2023-12-02T01:30:29.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 --2- 172.21.15.1:0/2162914059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b00c0 0x7ff96c0cee80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 --2- 172.21.15.1:0/2162914059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b2610 0x7ff96c099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 --2- 172.21.15.1:0/2162914059 >> v2:172.21.15.167:3300/0 conn(0x7ff96c15d900 0x7ff96c099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 -- 172.21.15.1:0/2162914059 >> 172.21.15.1:0/2162914059 conn(0x7ff96c0b2a70 msgr2=0x7ff96c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:29.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 -- 172.21.15.1:0/2162914059 shutdown_connections 2023-12-02T01:30:29.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.799+0000 7ff970d9e640 1 -- 172.21.15.1:0/2162914059 wait complete. 2023-12-02T01:30:29.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 Processor -- start 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 -- start start 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b00c0 0x7ff96c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b2610 0x7ff96c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff96c15d900 0x7ff96c06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15ee20 con 0x7ff96c0b2610 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0aed40 con 0x7ff96c15d900 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.801+0000 7ff970d9e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15f680 con 0x7ff96c0b00c0 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b2610 0x7ff96c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b2610 0x7ff96c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35116/0 (socket says 172.21.15.1:35116) 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 -- 172.21.15.1:0/4074270788 learned_addr learned my addr 172.21.15.1:0/4074270788 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff96ad9d640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff96c15d900 0x7ff96c06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff96a59c640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b00c0 0x7ff96c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 -- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b00c0 msgr2=0x7ff96c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b00c0 0x7ff96c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 -- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff96c15d900 msgr2=0x7ff96c06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff96c15d900 0x7ff96c06e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 -- 172.21.15.1:0/4074270788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009b30 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff969d9b640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b2610 0x7ff96c0cc2c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff96000d7d0 tx=0x7ff96000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff95affd640 1 -- 172.21.15.1:0/4074270788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600096a0 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff95affd640 1 -- 172.21.15.1:0/4074270788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff960009800 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c0aea60 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff95affd640 1 -- 172.21.15.1:0/4074270788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960009b90 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.802+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c15f310 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.803+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c067420 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.804+0000 7ff95affd640 1 -- 172.21.15.1:0/4074270788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff960009cf0 con 0x7ff96c0b2610 2023-12-02T01:30:29.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.804+0000 7ff95affd640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff94c06ae40 0x7ff94c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:29.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.804+0000 7ff95affd640 1 -- 172.21.15.1:0/4074270788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff960089a70 con 0x7ff96c0b2610 2023-12-02T01:30:29.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.804+0000 7ff96a59c640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff94c06ae40 0x7ff94c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:29.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.805+0000 7ff96a59c640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff94c06ae40 0x7ff94c06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9640079a0 tx=0x7ff964008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:29.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:29.808+0000 7ff95affd640 1 -- 172.21.15.1:0/4074270788 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff960054b50 con 0x7ff96c0b2610 2023-12-02T01:30:30.021 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.020+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff96c099b10 con 0x7ff96c0b2610 2023-12-02T01:30:30.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.020+0000 7ff95affd640 1 -- 172.21.15.1:0/4074270788 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff960058170 con 0x7ff96c0b2610 2023-12-02T01:30:30.022 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:30.022 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:30:30.022 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:30:30.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff94c06ae40 msgr2=0x7ff94c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff94c06ae40 0x7ff94c06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9640079a0 tx=0x7ff964008040 comp rx=0 tx=0).stop 2023-12-02T01:30:30.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b2610 msgr2=0x7ff96c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b2610 0x7ff96c0cc2c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff96000d7d0 tx=0x7ff96000dc90 comp rx=0 tx=0).stop 2023-12-02T01:30:30.024 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 shutdown_connections 2023-12-02T01:30:30.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff94c06ae40 0x7ff94c06d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff96c15d900 0x7ff96c06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff96c0b2610 0x7ff96c0cc2c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 --2- 172.21.15.1:0/4074270788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff96c0b00c0 0x7ff96c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 >> 172.21.15.1:0/4074270788 conn(0x7ff96c0b2a70 msgr2=0x7ff96c0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:30.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 shutdown_connections 2023-12-02T01:30:30.025 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.022+0000 7ff970d9e640 1 -- 172.21.15.1:0/4074270788 wait complete. 2023-12-02T01:30:30.035 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:30:30.141 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.140+0000 7fe150801640 1 Processor -- start 2023-12-02T01:30:30.142 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.140+0000 7fe150801640 1 -- start start 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe150801640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe14c0d00d0 0x7fe14c0d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe150801640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe150801640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0d3f10 con 0x7fe14c160740 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe150801640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0d3cb0 con 0x7fe14c0d00d0 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe150801640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0cf050 con 0x7fe14c0b3c80 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe143fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe14c0d00d0 0x7fe14c0d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe143fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe14c0d00d0 0x7fe14c0d3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35128/0 (socket says 172.21.15.1:35128) 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe143fff640 1 -- 172.21.15.1:0/3298587196 learned_addr learned my addr 172.21.15.1:0/3298587196 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe14ad9d640 1 --1- 172.21.15.1:0/3298587196 >> v1:172.21.15.1:6789/0 conn(0x7fe14c160740 0x7fe14c0cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51294/0 (socket says 172.21.15.1:51294) 2023-12-02T01:30:30.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe14b59e640 1 --2- 172.21.15.1:0/3298587196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe143fff640 1 -- 172.21.15.1:0/3298587196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 msgr2=0x7fe14c0d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:30.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe143fff640 1 --2- 172.21.15.1:0/3298587196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe143fff640 1 -- 172.21.15.1:0/3298587196 >> v1:172.21.15.1:6789/0 conn(0x7fe14c160740 legacy=0x7fe14c0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe14a59c640 1 -- 172.21.15.1:0/3298587196 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116589932 0 0) 0x7fe14c0d3f10 con 0x7fe14c160740 2023-12-02T01:30:30.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.141+0000 7fe143fff640 1 -- 172.21.15.1:0/3298587196 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0ce7b0 con 0x7fe14c0d00d0 2023-12-02T01:30:30.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.142+0000 7fe143fff640 1 --2- 172.21.15.1:0/3298587196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0d3770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe134009870 tx=0x7fe13402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965aba6963a044c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.142+0000 7fe14a59c640 1 -- 172.21.15.1:0/3298587196 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1340317c0 con 0x7fe14c0d00d0 2023-12-02T01:30:30.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.142+0000 7fe14a59c640 1 -- 172.21.15.1:0/3298587196 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134031920 con 0x7fe14c0d00d0 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.142+0000 7fe14a59c640 1 -- 172.21.15.1:0/3298587196 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134031cb0 con 0x7fe14c0d00d0 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 -- 172.21.15.1:0/3298587196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 msgr2=0x7fe14c0d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 --2- 172.21.15.1:0/3298587196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0d3770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe134009870 tx=0x7fe13402b860 comp rx=0 tx=0).stop 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 -- 172.21.15.1:0/3298587196 shutdown_connections 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 --2- 172.21.15.1:0/3298587196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 --2- 172.21.15.1:0/3298587196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0d3770 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 -- 172.21.15.1:0/3298587196 >> 172.21.15.1:0/3298587196 conn(0x7fe14c09c3a0 msgr2=0x7fe14c0d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 -- 172.21.15.1:0/3298587196 shutdown_connections 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.143+0000 7fe150801640 1 -- 172.21.15.1:0/3298587196 wait complete. 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.144+0000 7fe150801640 1 Processor -- start 2023-12-02T01:30:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.144+0000 7fe150801640 1 -- start start 2023-12-02T01:30:30.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe150801640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe150801640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe150801640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c160740 0x7fe14c155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe150801640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b8dc0 con 0x7fe14c0d00d0 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe150801640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b8760 con 0x7fe14c160740 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe150801640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b7be0 con 0x7fe14c0b3c80 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35144/0 (socket says 172.21.15.1:35144) 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 -- 172.21.15.1:0/4149595686 learned_addr learned my addr 172.21.15.1:0/4149595686 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe14b59e640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c160740 0x7fe14c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe14ad9d640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 -- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 msgr2=0x7fe14c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 -- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c160740 msgr2=0x7fe14c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c160740 0x7fe14c155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.149 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 -- 172.21.15.1:0/4149595686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340094d0 con 0x7fe14c0d00d0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe14b59e640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c160740 0x7fe14c155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe14ad9d640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.145+0000 7fe143fff640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0c8e90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c00 tx=0x7fe1340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.146+0000 7fe1437fe640 1 -- 172.21.15.1:0/4149595686 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134032650 con 0x7fe14c0d00d0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.146+0000 7fe1437fe640 1 -- 172.21.15.1:0/4149595686 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134031f00 con 0x7fe14c0d00d0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.146+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0b7ec0 con 0x7fe14c0d00d0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.146+0000 7fe1437fe640 1 -- 172.21.15.1:0/4149595686 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134032a30 con 0x7fe14c0d00d0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.146+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c0b8480 con 0x7fe14c0d00d0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.147+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c0ca110 con 0x7fe14c0d00d0 2023-12-02T01:30:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.147+0000 7fe1437fe640 1 -- 172.21.15.1:0/4149595686 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe134043070 con 0x7fe14c0d00d0 2023-12-02T01:30:30.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.148+0000 7fe1437fe640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe12c06ae70 0x7fe12c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.148+0000 7fe1437fe640 1 -- 172.21.15.1:0/4149595686 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe1340ab610 con 0x7fe14c0d00d0 2023-12-02T01:30:30.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.148+0000 7fe14ad9d640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe12c06ae70 0x7fe12c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.148+0000 7fe14ad9d640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe12c06ae70 0x7fe12c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000f60 tx=0x7fe13c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.152+0000 7fe1437fe640 1 -- 172.21.15.1:0/4149595686 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe134076760 con 0x7fe14c0d00d0 2023-12-02T01:30:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.365+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe14c0a1010 con 0x7fe14c0d00d0 2023-12-02T01:30:30.367 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.365+0000 7fe1437fe640 1 -- 172.21.15.1:0/4149595686 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fe13404a090 con 0x7fe14c0d00d0 2023-12-02T01:30:30.367 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:30.367 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/1970711636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":1970711636},{"type":"v1","addr":"172.21.15.1:6837","nonce":1970711636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/4193648384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4193648384},{"type":"v1","addr":"172.21.15.167:6833","nonce":4193648384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4208884185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4208884185},{"type":"v1","addr":"172.21.15.167:6835","nonce":4208884185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:29:44.704158+0000","modified":"2023-12-02T01:29:46.693986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6836/4222783213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":4222783213},{"type":"v1","addr":"172.21.15.1:6836","nonce":4222783213}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-02T01:30:30.367 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2023-12-02T01:30:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.367+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe12c06ae70 msgr2=0x7fe12c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.367+0000 7fe150801640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe12c06ae70 0x7fe12c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000f60 tx=0x7fe13c009040 comp rx=0 tx=0).stop 2023-12-02T01:30:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.367+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 msgr2=0x7fe14c0c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.367+0000 7fe150801640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0c8e90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c00 tx=0x7fe1340046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 shutdown_connections 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe12c06ae70 0x7fe12c06d330 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000f60 tx=0x7fe13c009040 comp rx=0 tx=0).stop 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c160740 0x7fe14c155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe14c0d00d0 0x7fe14c0c8e90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 --2- 172.21.15.1:0/4149595686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0b3c80 0x7fe14c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 >> 172.21.15.1:0/4149595686 conn(0x7fe14c09c3a0 msgr2=0x7fe14c0d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 shutdown_connections 2023-12-02T01:30:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.368+0000 7fe150801640 1 -- 172.21.15.1:0/4149595686 wait complete. 2023-12-02T01:30:30.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:30.486 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.485+0000 7f53755ec640 1 Processor -- start 2023-12-02T01:30:30.487 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.485+0000 7f53755ec640 1 -- start start 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f53755ec640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5370160ab0 0x7f53700afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f53755ec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 0x7f53700cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f53755ec640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53700cdd30 con 0x7f53700d0030 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f53755ec640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53700ce2d0 con 0x7f5370160ab0 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f53755ec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700d0a90 con 0x7f53700b2450 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f53700d0030 0x7f53700d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51308/0 (socket says 172.21.15.1:51308) 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536f7fe640 1 -- 172.21.15.1:0/3538709279 learned_addr learned my addr 172.21.15.1:0/3538709279 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:30.490 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536effd640 1 --2- 172.21.15.1:0/3538709279 >> v2:172.21.15.167:3300/0 conn(0x7f5370160ab0 0x7f53700afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 0x7f53700cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489835428 0 0) 0x7f53700cdd30 con 0x7f53700d0030 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5358003520 con 0x7f53700d0030 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154857801 0 0) 0x7f5358003520 con 0x7f53700d0030 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 msgr2=0x7f53700cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 0x7f53700cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 >> v2:172.21.15.167:3300/0 conn(0x7f5370160ab0 msgr2=0x7f53700afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 --2- 172.21.15.1:0/3538709279 >> v2:172.21.15.167:3300/0 conn(0x7f5370160ab0 0x7f53700afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.486+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700b02f0 con 0x7f53700d0030 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f53680019f0 con 0x7f53700d0030 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 >> v1:172.21.15.1:6789/0 conn(0x7f53700d0030 legacy=0x7f53700d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 0x7f5358003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5358003ef0 0x7f53580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5358004d00 0x7f5358005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.491 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700ce2d0 con 0x7f5358003ef0 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700d0a90 con 0x7f5358004d00 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535800b9d0 con 0x7f53700b2450 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5358003ef0 0x7f53580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536effd640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 0x7f5358003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536f7fe640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5358004d00 0x7f5358005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536e7fc640 1 -- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 msgr2=0x7f5358003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53700b2450 0x7f5358003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536e7fc640 1 -- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5358004d00 msgr2=0x7f5358005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5358004d00 0x7f5358005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.487+0000 7f536e7fc640 1 -- 172.21.15.1:0/3538709279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5358003520 con 0x7f5358003ef0 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5358003ef0 0x7f53580047c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5364009af0 tx=0x7f53580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d721de2e851263 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536402c6b0 con 0x7f5358003ef0 2023-12-02T01:30:30.492 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536402c810 con 0x7f5358003ef0 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f536dffb640 1 -- 172.21.15.1:0/3538709279 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536402cba0 con 0x7f5358003ef0 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f53755ec640 1 -- 172.21.15.1:0/3538709279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5358003ef0 msgr2=0x7f53580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f53755ec640 1 --2- 172.21.15.1:0/3538709279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5358003ef0 0x7f53580047c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5364009af0 tx=0x7f53580057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f536f7fe640 1 -- 172.21.15.1:0/3538709279 reap_dead start 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f53755ec640 1 -- 172.21.15.1:0/3538709279 shutdown_connections 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f53755ec640 1 -- 172.21.15.1:0/3538709279 >> 172.21.15.1:0/3538709279 conn(0x7f537009c450 msgr2=0x7f53700d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f53755ec640 1 -- 172.21.15.1:0/3538709279 shutdown_connections 2023-12-02T01:30:30.493 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.488+0000 7f53755ec640 1 -- 172.21.15.1:0/3538709279 wait complete. 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.490+0000 7f53755ec640 1 Processor -- start 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.490+0000 7f53755ec640 1 -- start start 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53755ec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5358003ef0 0x7f53700ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53755ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f537015ca20 0x7f53700b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53755ec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53701f6c30 0x7f53701f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53755ec640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700cba60 con 0x7f537015ca20 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53755ec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700caa40 con 0x7f53701f6c30 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53755ec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700cad20 con 0x7f5358003ef0 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f537015ca20 0x7f53700b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.496 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f537015ca20 0x7f53700b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35162/0 (socket says 172.21.15.1:35162) 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 -- 172.21.15.1:0/3687657978 learned_addr learned my addr 172.21.15.1:0/3687657978 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536effd640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5358003ef0 0x7f53700ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536f7fe640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53701f6c30 0x7f53701f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 -- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5358003ef0 msgr2=0x7f53700ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5358003ef0 0x7f53700ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 -- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53701f6c30 msgr2=0x7f53701f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53701f6c30 0x7f53701f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 -- 172.21.15.1:0/3687657978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700cb000 con 0x7f537015ca20 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536f7fe640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53701f6c30 0x7f53701f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f536e7fc640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f537015ca20 0x7f53700b1340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5364037040 tx=0x7f5364004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53577fe640 1 -- 172.21.15.1:0/3687657978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364003810 con 0x7f537015ca20 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53577fe640 1 -- 172.21.15.1:0/3687657978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364003970 con 0x7f537015ca20 2023-12-02T01:30:30.497 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53700cba60 con 0x7f537015ca20 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.491+0000 7f53577fe640 1 -- 172.21.15.1:0/3687657978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364003ce0 con 0x7f537015ca20 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.492+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53700ca730 con 0x7f537015ca20 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.492+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370067420 con 0x7f537015ca20 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.493+0000 7f53577fe640 1 -- 172.21.15.1:0/3687657978 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5364047450 con 0x7f537015ca20 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.493+0000 7f53577fe640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f535c06ae40 0x7f535c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.493+0000 7f536effd640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f535c06ae40 0x7f535c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.494+0000 7f53577fe640 1 -- 172.21.15.1:0/3687657978 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f53640ab810 con 0x7f537015ca20 2023-12-02T01:30:30.498 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.494+0000 7f536effd640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f535c06ae40 0x7f535c06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5360009b80 tx=0x7f5360008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.499 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.498+0000 7f53577fe640 1 -- 172.21.15.1:0/3687657978 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5364076980 con 0x7f537015ca20 2023-12-02T01:30:30.678 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.676+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53700d1020 con 0x7f537015ca20 2023-12-02T01:30:30.679 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.677+0000 7f53577fe640 1 -- 172.21.15.1:0/3687657978 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16707 (secure 0 0 0) 0x7f53640044e0 con 0x7f537015ca20 2023-12-02T01:30:30.679 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:30.679 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:26.486281+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:29:42.820093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-02T01:29:43.685635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:30.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.679+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f535c06ae40 msgr2=0x7f535c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.679+0000 7f53755ec640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f535c06ae40 0x7f535c06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5360009b80 tx=0x7f5360008040 comp rx=0 tx=0).stop 2023-12-02T01:30:30.681 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f537015ca20 msgr2=0x7f53700b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f537015ca20 0x7f53700b1340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5364037040 tx=0x7f5364004730 comp rx=0 tx=0).stop 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 shutdown_connections 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f535c06ae40 0x7f535c06d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53701f6c30 0x7f53701f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f537015ca20 0x7f53700b1340 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 --2- 172.21.15.1:0/3687657978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5358003ef0 0x7f53700ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 >> 172.21.15.1:0/3687657978 conn(0x7f537009c450 msgr2=0x7f5370161730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 shutdown_connections 2023-12-02T01:30:30.682 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.680+0000 7f53755ec640 1 -- 172.21.15.1:0/3687657978 wait complete. 2023-12-02T01:30:30.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-02T01:30:30.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.799+0000 7fa6adde5640 1 Processor -- start 2023-12-02T01:30:30.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.799+0000 7fa6adde5640 1 -- start start 2023-12-02T01:30:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6adde5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa6a80b3610 0x7fa6a8160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6adde5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6adde5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a80adda0 con 0x7fa6a806efd0 2023-12-02T01:30:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6adde5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a8161800 con 0x7fa6a80b3610 2023-12-02T01:30:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6adde5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80b3aa0 con 0x7fa6a8161370 2023-12-02T01:30:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a77fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa6a806efd0 0x7fa6a80ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51322/0 (socket says 172.21.15.1:51322) 2023-12-02T01:30:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a77fe640 1 -- 172.21.15.1:0/512637011 learned_addr learned my addr 172.21.15.1:0/512637011 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a7fff640 1 --2- 172.21.15.1:0/512637011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a6ffd640 1 --2- 172.21.15.1:0/512637011 >> v2:172.21.15.167:3300/0 conn(0x7fa6a80b3610 0x7fa6a8160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a67fc640 1 -- 172.21.15.1:0/512637011 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994754239 0 0) 0x7fa6a80adda0 con 0x7fa6a806efd0 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a67fc640 1 -- 172.21.15.1:0/512637011 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa690003520 con 0x7fa6a806efd0 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a7fff640 1 -- 172.21.15.1:0/512637011 >> v2:172.21.15.167:3300/0 conn(0x7fa6a80b3610 msgr2=0x7fa6a8160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a7fff640 1 --2- 172.21.15.1:0/512637011 >> v2:172.21.15.167:3300/0 conn(0x7fa6a80b3610 0x7fa6a8160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a7fff640 1 -- 172.21.15.1:0/512637011 >> v1:172.21.15.1:6789/0 conn(0x7fa6a806efd0 legacy=0x7fa6a80ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a7fff640 1 -- 172.21.15.1:0/512637011 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80b3d80 con 0x7fa6a8161370 2023-12-02T01:30:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.800+0000 7fa6a6ffd640 1 --2- 172.21.15.1:0/512637011 >> v2:172.21.15.167:3300/0 conn(0x7fa6a80b3610 0x7fa6a8160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:30.804 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.801+0000 7fa6a7fff640 1 --2- 172.21.15.1:0/512637011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a806a4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097a0 tx=0x7fa6a002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a094e9fb9eca071b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.801+0000 7fa6a67fc640 1 -- 172.21.15.1:0/512637011 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0031830 con 0x7fa6a8161370 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.801+0000 7fa6a67fc640 1 -- 172.21.15.1:0/512637011 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0031990 con 0x7fa6a8161370 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.801+0000 7fa6a67fc640 1 -- 172.21.15.1:0/512637011 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0031d20 con 0x7fa6a8161370 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 -- 172.21.15.1:0/512637011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 msgr2=0x7fa6a806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 --2- 172.21.15.1:0/512637011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a806a4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097a0 tx=0x7fa6a002b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 -- 172.21.15.1:0/512637011 shutdown_connections 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 --2- 172.21.15.1:0/512637011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a806a4d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 --2- 172.21.15.1:0/512637011 >> v2:172.21.15.167:3300/0 conn(0x7fa6a80b3610 0x7fa6a8160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 -- 172.21.15.1:0/512637011 >> 172.21.15.1:0/512637011 conn(0x7fa6a80b1670 msgr2=0x7fa6a80b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 -- 172.21.15.1:0/512637011 shutdown_connections 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.802+0000 7fa6adde5640 1 -- 172.21.15.1:0/512637011 wait complete. 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.803+0000 7fa6adde5640 1 Processor -- start 2023-12-02T01:30:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.803+0000 7fa6adde5640 1 -- start start 2023-12-02T01:30:30.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6adde5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a806efd0 0x7fa6a81598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6adde5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a8151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6adde5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a806dde0 0x7fa6a814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6adde5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81523c0 con 0x7fa6a806dde0 2023-12-02T01:30:30.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6adde5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a815b7e0 con 0x7fa6a806efd0 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6adde5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a815bac0 con 0x7fa6a8161370 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a806dde0 0x7fa6a814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a806dde0 0x7fa6a814bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35172/0 (socket says 172.21.15.1:35172) 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6a7fff640 1 -- 172.21.15.1:0/3463750614 learned_addr learned my addr 172.21.15.1:0/3463750614 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6a6ffd640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a8151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.804+0000 7fa6a77fe640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a806efd0 0x7fa6a81598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a7fff640 1 -- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 msgr2=0x7fa6a8151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a7fff640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a8151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a7fff640 1 -- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a806efd0 msgr2=0x7fa6a81598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a7fff640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a806efd0 0x7fa6a81598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a7fff640 1 -- 172.21.15.1:0/3463750614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c009400 con 0x7fa6a806dde0 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a6ffd640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a8151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a77fe640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a806efd0 0x7fa6a81598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:30.808 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6a7fff640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a806dde0 0x7fa6a814bc80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097a0 tx=0x7fa6a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa68ffff640 1 -- 172.21.15.1:0/3463750614 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a003a830 con 0x7fa6a806dde0 2023-12-02T01:30:30.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa68ffff640 1 -- 172.21.15.1:0/3463750614 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a003a9b0 con 0x7fa6a806dde0 2023-12-02T01:30:30.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa68ffff640 1 -- 172.21.15.1:0/3463750614 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a003ad60 con 0x7fa6a806dde0 2023-12-02T01:30:30.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a0009400 con 0x7fa6a806dde0 2023-12-02T01:30:30.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.805+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a815c080 con 0x7fa6a806dde0 2023-12-02T01:30:30.809 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.806+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a8072720 con 0x7fa6a806dde0 2023-12-02T01:30:30.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.806+0000 7fa68ffff640 1 -- 172.21.15.1:0/3463750614 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6a004d450 con 0x7fa6a806dde0 2023-12-02T01:30:30.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.807+0000 7fa68ffff640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa69406ae40 0x7fa69406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:30.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.807+0000 7fa68ffff640 1 -- 172.21.15.1:0/3463750614 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa6a00ab5b0 con 0x7fa6a806dde0 2023-12-02T01:30:30.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.807+0000 7fa6a77fe640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa69406ae40 0x7fa69406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:30.810 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.807+0000 7fa6a77fe640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa69406ae40 0x7fa69406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa698001560 tx=0x7fa698009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:30.812 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:30.811+0000 7fa68ffff640 1 -- 172.21.15.1:0/3463750614 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6a00765e0 con 0x7fa6a806dde0 2023-12-02T01:30:31.028 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.027+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa6a804e920 con 0x7fa6a806dde0 2023-12-02T01:30:31.028 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-12-02T01:30:31.027+0000 7fa98a810640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-02T01:30:31.030 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.028+0000 7fa68ffff640 1 -- 172.21.15.1:0/3463750614 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa6a0035090 con 0x7fa6a806dde0 2023-12-02T01:30:31.030 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-02T01:30:31.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa69406ae40 msgr2=0x7fa69406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:31.032 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa69406ae40 0x7fa69406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa698001560 tx=0x7fa698009040 comp rx=0 tx=0).stop 2023-12-02T01:30:31.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a806dde0 msgr2=0x7fa6a814bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:31.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a806dde0 0x7fa6a814bc80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097a0 tx=0x7fa6a00046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 shutdown_connections 2023-12-02T01:30:31.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6a806dde0 0x7fa6a814bc80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6a8161370 0x7fa6a8151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa69406ae40 0x7fa69406d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 --2- 172.21.15.1:0/3463750614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a806efd0 0x7fa6a81598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.031+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 >> 172.21.15.1:0/3463750614 conn(0x7fa6a80b1670 msgr2=0x7fa6a8160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:31.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.032+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 shutdown_connections 2023-12-02T01:30:31.034 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.032+0000 7fa6adde5640 1 -- 172.21.15.1:0/3463750614 wait complete. 2023-12-02T01:30:31.038 INFO:tasks.ceph.mds.a.smithi001.stderr: -2780> 2023-12-02T01:29:49.322+0000 7f6c1fd03640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-02T01:30:31.045 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-02T01:30:31.062 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-12-02T01:30:31.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.152+0000 7facba3ea640 1 Processor -- start 2023-12-02T01:30:31.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.152+0000 7facba3ea640 1 -- start start 2023-12-02T01:30:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facba3ea640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7facb41465d0 0x7facb40b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facba3ea640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb40721d0 con 0x7facb4071d40 2023-12-02T01:30:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facba3ea640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb40cf790 con 0x7facb406abe0 2023-12-02T01:30:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facba3ea640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb4161d80 con 0x7facb41465d0 2023-12-02T01:30:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7facb41465d0 0x7facb40b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb37fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7facb4071d40 0x7facb406a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51346/0 (socket says 172.21.15.1:51346) 2023-12-02T01:30:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb37fe640 1 -- 172.21.15.1:0/1580290692 learned_addr learned my addr 172.21.15.1:0/1580290692 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7facb41465d0 0x7facb40b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35188/0 (socket says 172.21.15.1:35188) 2023-12-02T01:30:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb3fff640 1 -- 172.21.15.1:0/1580290692 >> v1:172.21.15.167:6789/0 conn(0x7facb406abe0 legacy=0x7facb40cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb3fff640 1 -- 172.21.15.1:0/1580290692 >> v1:172.21.15.1:6789/0 conn(0x7facb4071d40 legacy=0x7facb406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb2ffd640 1 -- 172.21.15.1:0/1580290692 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962728415 0 0) 0x7facb40721d0 con 0x7facb4071d40 2023-12-02T01:30:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.153+0000 7facb3fff640 1 -- 172.21.15.1:0/1580290692 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb41614e0 con 0x7facb41465d0 2023-12-02T01:30:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.154+0000 7facb3fff640 1 --2- 172.21.15.1:0/1580290692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb41465d0 0x7facb40b2ee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faca40097a0 tx=0x7faca402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d30668c34a06e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.154+0000 7facb2ffd640 1 -- 172.21.15.1:0/1580290692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4031830 con 0x7facb41465d0 2023-12-02T01:30:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.154+0000 7facb2ffd640 1 -- 172.21.15.1:0/1580290692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca4031990 con 0x7facb41465d0 2023-12-02T01:30:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.154+0000 7facb2ffd640 1 -- 172.21.15.1:0/1580290692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4031d20 con 0x7facb41465d0 2023-12-02T01:30:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.155+0000 7facba3ea640 1 -- 172.21.15.1:0/1580290692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb41465d0 msgr2=0x7facb40b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.155+0000 7facba3ea640 1 --2- 172.21.15.1:0/1580290692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb41465d0 0x7facb40b2ee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faca40097a0 tx=0x7faca402b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.155+0000 7facba3ea640 1 -- 172.21.15.1:0/1580290692 shutdown_connections 2023-12-02T01:30:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.155+0000 7facba3ea640 1 --2- 172.21.15.1:0/1580290692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb41465d0 0x7facb40b2ee0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.155+0000 7facba3ea640 1 -- 172.21.15.1:0/1580290692 >> 172.21.15.1:0/1580290692 conn(0x7facb40cc930 msgr2=0x7facb40ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.155+0000 7facba3ea640 1 -- 172.21.15.1:0/1580290692 shutdown_connections 2023-12-02T01:30:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.155+0000 7facba3ea640 1 -- 172.21.15.1:0/1580290692 wait complete. 2023-12-02T01:30:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.156+0000 7facba3ea640 1 Processor -- start 2023-12-02T01:30:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.156+0000 7facba3ea640 1 -- start start 2023-12-02T01:30:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facba3ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb406abe0 0x7facb40ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facba3ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4071d40 0x7facb4160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facba3ea640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb41465d0 0x7facb413d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facba3ea640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb413cab0 con 0x7facb406abe0 2023-12-02T01:30:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facba3ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb413db90 con 0x7facb4071d40 2023-12-02T01:30:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facba3ea640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb40acda0 con 0x7facb41465d0 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb406abe0 0x7facb40ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb406abe0 0x7facb40ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35202/0 (socket says 172.21.15.1:35202) 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 -- 172.21.15.1:0/1529964875 learned_addr learned my addr 172.21.15.1:0/1529964875 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb37fe640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4071d40 0x7facb4160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb8987640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb41465d0 0x7facb413d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 -- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb41465d0 msgr2=0x7facb413d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb41465d0 0x7facb413d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 -- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4071d40 msgr2=0x7facb4160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4071d40 0x7facb4160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb3fff640 1 -- 172.21.15.1:0/1529964875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4009400 con 0x7facb406abe0 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb37fe640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4071d40 0x7facb4160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.157+0000 7facb8987640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb41465d0 0x7facb413d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.158+0000 7facb3fff640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb406abe0 0x7facb40ade40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faca40097a0 tx=0x7faca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.158+0000 7facb0ff9640 1 -- 172.21.15.1:0/1529964875 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca403aa60 con 0x7facb406abe0 2023-12-02T01:30:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.158+0000 7facb0ff9640 1 -- 172.21.15.1:0/1529964875 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca403abc0 con 0x7facb406abe0 2023-12-02T01:30:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.158+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb40ad080 con 0x7facb406abe0 2023-12-02T01:30:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.158+0000 7facb0ff9640 1 -- 172.21.15.1:0/1529964875 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40443f0 con 0x7facb406abe0 2023-12-02T01:30:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.158+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb40ad640 con 0x7facb406abe0 2023-12-02T01:30:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.159+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb406e6a0 con 0x7facb406abe0 2023-12-02T01:30:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.159+0000 7facb0ff9640 1 -- 172.21.15.1:0/1529964875 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faca404d450 con 0x7facb406abe0 2023-12-02T01:30:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.160+0000 7facb0ff9640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fac9406ae40 0x7fac9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.160+0000 7facb0ff9640 1 -- 172.21.15.1:0/1529964875 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7faca40ab8a0 con 0x7facb406abe0 2023-12-02T01:30:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.160+0000 7facb37fe640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fac9406ae40 0x7fac9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.160+0000 7facb37fe640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fac9406ae40 0x7fac9406d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7facb413edc0 tx=0x7fac9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:31.165 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.164+0000 7facb0ff9640 1 -- 172.21.15.1:0/1529964875 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faca4076910 con 0x7facb406abe0 2023-12-02T01:30:31.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:31.376+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7facb404e920 con 0x7facb406abe0 2023-12-02T01:30:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.030+0000 7facb0ff9640 1 -- 172.21.15.1:0/1529964875 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7faca4079f30 con 0x7facb406abe0 2023-12-02T01:30:32.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fac9406ae40 msgr2=0x7fac9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:32.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fac9406ae40 0x7fac9406d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7facb413edc0 tx=0x7fac9c009040 comp rx=0 tx=0).stop 2023-12-02T01:30:32.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb406abe0 msgr2=0x7facb40ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:32.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb406abe0 0x7facb40ade40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faca40097a0 tx=0x7faca40046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 shutdown_connections 2023-12-02T01:30:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facb41465d0 0x7facb413d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fac9406ae40 0x7fac9406d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb4071d40 0x7facb4160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 --2- 172.21.15.1:0/1529964875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facb406abe0 0x7facb40ade40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 >> 172.21.15.1:0/1529964875 conn(0x7facb40cc930 msgr2=0x7facb40afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 shutdown_connections 2023-12-02T01:30:32.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.033+0000 7facba3ea640 1 -- 172.21.15.1:0/1529964875 wait complete. 2023-12-02T01:30:32.049 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-02T01:30:32.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.205+0000 7fd33fb7c640 1 Processor -- start 2023-12-02T01:30:32.207 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.206+0000 7fd33fb7c640 1 -- start start 2023-12-02T01:30:32.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.206+0000 7fd33fb7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 0x7fd3380b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.210 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.206+0000 7fd33fb7c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380cfb70 con 0x7fd338160a00 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.206+0000 7fd33fb7c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380cfe10 con 0x7fd3380d1c20 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.206+0000 7fd33fb7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380d00f0 con 0x7fd3380d08f0 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.206+0000 7fd33d918640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd338160a00 0x7fd3380d1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55078/0 (socket says 172.21.15.1:55078) 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.206+0000 7fd33d918640 1 -- 172.21.15.1:0/4216016252 learned_addr learned my addr 172.21.15.1:0/4216016252 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33e119640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 0x7fd3380b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296964169 0 0) 0x7fd3380cfb70 con 0x7fd338160a00 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd320003520 con 0x7fd338160a00 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 169019313 0 0) 0x7fd320003520 con 0x7fd338160a00 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 msgr2=0x7fd3380b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 0x7fd3380b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 >> v1:172.21.15.167:6789/0 conn(0x7fd3380d1c20 legacy=0x7fd3380cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380d03d0 con 0x7fd338160a00 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fd330001670 con 0x7fd338160a00 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 >> v1:172.21.15.1:6789/0 conn(0x7fd338160a00 legacy=0x7fd3380d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3200039a0 0x7fd320003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd320004350 0x7fd320004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 0x7fd320005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380d00f0 con 0x7fd320004350 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32000b980 con 0x7fd3200039a0 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32000bb40 con 0x7fd3380d08f0 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33d117640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd320004350 0x7fd320004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33d918640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3200039a0 0x7fd320003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.207+0000 7fd33e119640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 0x7fd320005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33d117640 1 -- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 msgr2=0x7fd320005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33d117640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380d08f0 0x7fd320005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33d117640 1 -- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3200039a0 msgr2=0x7fd320003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33d117640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3200039a0 0x7fd320003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33d117640 1 -- 172.21.15.1:0/4216016252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320003520 con 0x7fd320004350 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33d117640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd320004350 0x7fd320004820 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd32c001910 tx=0x7fd3200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ac63cf5aeb2216 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c032620 con 0x7fd320004350 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c032780 con 0x7fd320004350 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.208+0000 7fd33c916640 1 -- 172.21.15.1:0/4216016252 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c032b10 con 0x7fd320004350 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.209+0000 7fd33fb7c640 1 -- 172.21.15.1:0/4216016252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd320004350 msgr2=0x7fd320004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.209+0000 7fd33fb7c640 1 --2- 172.21.15.1:0/4216016252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd320004350 0x7fd320004820 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd32c001910 tx=0x7fd3200057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.209+0000 7fd33e119640 1 -- 172.21.15.1:0/4216016252 reap_dead start 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.209+0000 7fd33fb7c640 1 -- 172.21.15.1:0/4216016252 shutdown_connections 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.209+0000 7fd33fb7c640 1 -- 172.21.15.1:0/4216016252 >> 172.21.15.1:0/4216016252 conn(0x7fd33809c4a0 msgr2=0x7fd3380d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.209+0000 7fd33fb7c640 1 -- 172.21.15.1:0/4216016252 shutdown_connections 2023-12-02T01:30:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.209+0000 7fd33fb7c640 1 -- 172.21.15.1:0/4216016252 wait complete. 2023-12-02T01:30:32.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.210+0000 7fd33fb7c640 1 Processor -- start 2023-12-02T01:30:32.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.210+0000 7fd33fb7c640 1 -- start start 2023-12-02T01:30:32.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33fb7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd320004350 0x7fd3381556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33fb7c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3380b77e0 0x7fd3380b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33fb7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380b62a0 0x7fd3380b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33fb7c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380b6740 con 0x7fd3380b77e0 2023-12-02T01:30:32.216 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33fb7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380b6a20 con 0x7fd320004350 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33fb7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380b6d00 con 0x7fd3380b62a0 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3380b77e0 0x7fd3380b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3380b77e0 0x7fd3380b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37846/0 (socket says 172.21.15.1:37846) 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 -- 172.21.15.1:0/2968404901 learned_addr learned my addr 172.21.15.1:0/2968404901 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33e119640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380b62a0 0x7fd3380b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d918640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd320004350 0x7fd3381556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 -- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380b62a0 msgr2=0x7fd3380b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380b62a0 0x7fd3380b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 -- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd320004350 msgr2=0x7fd3381556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd320004350 0x7fd3381556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33d117640 1 -- 172.21.15.1:0/2968404901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380b6fe0 con 0x7fd3380b77e0 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.211+0000 7fd33e119640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380b62a0 0x7fd3380b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:32.217 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.212+0000 7fd33d918640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd320004350 0x7fd3381556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.212+0000 7fd33d117640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3380b77e0 0x7fd3380b5d60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd32c034040 tx=0x7fd32c0012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.212+0000 7fd3367fc640 1 -- 172.21.15.1:0/2968404901 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c005270 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.212+0000 7fd3367fc640 1 -- 172.21.15.1:0/2968404901 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c0053d0 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.212+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3380b72c0 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.212+0000 7fd3367fc640 1 -- 172.21.15.1:0/2968404901 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0069d0 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.212+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3380cc150 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.213+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3380cda10 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.213+0000 7fd3367fc640 1 -- 172.21.15.1:0/2968404901 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd32c042070 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.214+0000 7fd3367fc640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd32406ae70 0x7fd32406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.214+0000 7fd3367fc640 1 -- 172.21.15.1:0/2968404901 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fd32c0ab5b0 con 0x7fd3380b77e0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.214+0000 7fd33d918640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd32406ae70 0x7fd32406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:32.218 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.214+0000 7fd33d918640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd32406ae70 0x7fd32406d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd330001eb0 tx=0x7fd330009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:32.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.218+0000 7fd3367fc640 1 -- 172.21.15.1:0/2968404901 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd32c076620 con 0x7fd3380b77e0 2023-12-02T01:30:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:32.396+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd338067420 con 0x7fd3380b77e0 2023-12-02T01:30:33.033 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.032+0000 7fd3367fc640 1 -- 172.21.15.1:0/2968404901 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd32c04a020 con 0x7fd3380b77e0 2023-12-02T01:30:33.033 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2023-12-02T01:30:33.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd32406ae70 msgr2=0x7fd32406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:33.037 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd32406ae70 0x7fd32406d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd330001eb0 tx=0x7fd330009040 comp rx=0 tx=0).stop 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3380b77e0 msgr2=0x7fd3380b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3380b77e0 0x7fd3380b5d60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd32c034040 tx=0x7fd32c0012b0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 shutdown_connections 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3380b62a0 0x7fd3380b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3380b77e0 0x7fd3380b5d60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd32406ae70 0x7fd32406d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 --2- 172.21.15.1:0/2968404901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd320004350 0x7fd3381556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 >> 172.21.15.1:0/2968404901 conn(0x7fd33809c4a0 msgr2=0x7fd3380ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 shutdown_connections 2023-12-02T01:30:33.038 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.036+0000 7fd33fb7c640 1 -- 172.21.15.1:0/2968404901 wait complete. 2023-12-02T01:30:33.052 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-02T01:30:33.171 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.169+0000 7f8c4d2ad640 1 Processor -- start 2023-12-02T01:30:33.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.169+0000 7f8c4d2ad640 1 -- start start 2023-12-02T01:30:33.172 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.171+0000 7f8c4d2ad640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c4806d4f0 0x7f8c480ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:33.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.171+0000 7f8c4d2ad640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c480b49c0 con 0x7f8c480ccc40 2023-12-02T01:30:33.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.171+0000 7f8c4d2ad640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c480cd100 con 0x7f8c481538e0 2023-12-02T01:30:33.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.171+0000 7f8c4d2ad640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c480ce6e0 con 0x7f8c4806d4f0 2023-12-02T01:30:33.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.172+0000 7f8c477fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c4806d4f0 0x7f8c480ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:33.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.172+0000 7f8c477fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c4806d4f0 0x7f8c480ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37852/0 (socket says 172.21.15.1:37852) 2023-12-02T01:30:33.173 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.172+0000 7f8c477fe640 1 -- 172.21.15.1:0/1323434002 learned_addr learned my addr 172.21.15.1:0/1323434002 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.172+0000 7f8c477fe640 1 -- 172.21.15.1:0/1323434002 >> v1:172.21.15.167:6789/0 conn(0x7f8c481538e0 legacy=0x7f8c4815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.172+0000 7f8c477fe640 1 -- 172.21.15.1:0/1323434002 >> v1:172.21.15.1:6789/0 conn(0x7f8c480ccc40 legacy=0x7f8c4806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.172+0000 7f8c477fe640 1 -- 172.21.15.1:0/1323434002 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480cd3e0 con 0x7f8c4806d4f0 2023-12-02T01:30:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.174+0000 7f8c477fe640 1 --2- 172.21.15.1:0/1323434002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c480ce1a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000a910 tx=0x7f8c400301d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e41d5224f2bcf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.174+0000 7f8c45ffb640 1 -- 172.21.15.1:0/1323434002 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4003a400 con 0x7f8c4806d4f0 2023-12-02T01:30:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.174+0000 7f8c45ffb640 1 -- 172.21.15.1:0/1323434002 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40034070 con 0x7f8c4806d4f0 2023-12-02T01:30:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.175+0000 7f8c45ffb640 1 -- 172.21.15.1:0/1323434002 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4003a760 con 0x7f8c4806d4f0 2023-12-02T01:30:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.175+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/1323434002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 msgr2=0x7f8c480ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.175+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/1323434002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c480ce1a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000a910 tx=0x7f8c400301d0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.175+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/1323434002 shutdown_connections 2023-12-02T01:30:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.175+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/1323434002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c480ce1a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.175+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/1323434002 >> 172.21.15.1:0/1323434002 conn(0x7f8c480b0af0 msgr2=0x7f8c480b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.176+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/1323434002 shutdown_connections 2023-12-02T01:30:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.176+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/1323434002 wait complete. 2023-12-02T01:30:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.177+0000 7f8c4d2ad640 1 Processor -- start 2023-12-02T01:30:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.177+0000 7f8c4d2ad640 1 -- start start 2023-12-02T01:30:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c4d2ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c48145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c4d2ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c480ccc40 0x7f8c48151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c4d2ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c481538e0 0x7f8c48156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c4d2ad640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c48145d60 con 0x7f8c4806d4f0 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c4d2ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481513e0 con 0x7f8c481538e0 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c4d2ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481510b0 con 0x7f8c480ccc40 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c48145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c48145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37868/0 (socket says 172.21.15.1:37868) 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 -- 172.21.15.1:0/2754000954 learned_addr learned my addr 172.21.15.1:0/2754000954 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c477fe640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c481538e0 0x7f8c48156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c467fc640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c480ccc40 0x7f8c48151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 -- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c480ccc40 msgr2=0x7f8c48151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c480ccc40 0x7f8c48151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 -- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c481538e0 msgr2=0x7f8c48156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c481538e0 0x7f8c48156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.178+0000 7f8c46ffd640 1 -- 172.21.15.1:0/2754000954 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4000a570 con 0x7f8c4806d4f0 2023-12-02T01:30:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.179+0000 7f8c46ffd640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c48145820 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800ba50 tx=0x7f8c3800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.179+0000 7f8c2f7fe640 1 -- 172.21.15.1:0/2754000954 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800cc10 con 0x7f8c4806d4f0 2023-12-02T01:30:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.179+0000 7f8c2f7fe640 1 -- 172.21.15.1:0/2754000954 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800cd70 con 0x7f8c4806d4f0 2023-12-02T01:30:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.179+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4815ac90 con 0x7f8c4806d4f0 2023-12-02T01:30:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.179+0000 7f8c2f7fe640 1 -- 172.21.15.1:0/2754000954 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38014680 con 0x7f8c4806d4f0 2023-12-02T01:30:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.179+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c48151db0 con 0x7f8c4806d4f0 2023-12-02T01:30:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.180+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c48152000 con 0x7f8c4806d4f0 2023-12-02T01:30:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.180+0000 7f8c2f7fe640 1 -- 172.21.15.1:0/2754000954 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c3801d3b0 con 0x7f8c4806d4f0 2023-12-02T01:30:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.181+0000 7f8c2f7fe640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8c3406ae40 0x7f8c3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.181+0000 7f8c467fc640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8c3406ae40 0x7f8c3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.181+0000 7f8c2f7fe640 1 -- 172.21.15.1:0/2754000954 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f8c380893d0 con 0x7f8c4806d4f0 2023-12-02T01:30:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.181+0000 7f8c467fc640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8c3406ae40 0x7f8c3406d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c48152830 tx=0x7f8c3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:33.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.185+0000 7f8c2f7fe640 1 -- 172.21.15.1:0/2754000954 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c48152000 con 0x7f8c4806d4f0 2023-12-02T01:30:33.364 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:33.363+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8c48152000 con 0x7f8c4806d4f0 2023-12-02T01:30:34.035 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.033+0000 7f8c2f7fe640 1 -- 172.21.15.1:0/2754000954 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8c48152000 con 0x7f8c4806d4f0 2023-12-02T01:30:34.035 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.037+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8c3406ae40 msgr2=0x7f8c3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.037+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8c3406ae40 0x7f8c3406d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c48152830 tx=0x7f8c3c009040 comp rx=0 tx=0).stop 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.037+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 msgr2=0x7f8c48145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.037+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c48145820 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800ba50 tx=0x7f8c3800bf10 comp rx=0 tx=0).stop 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.038+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 shutdown_connections 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.038+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8c3406ae40 0x7f8c3406d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.038+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c481538e0 0x7f8c48156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.038+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c480ccc40 0x7f8c48151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.040 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.038+0000 7f8c4d2ad640 1 --2- 172.21.15.1:0/2754000954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c4806d4f0 0x7f8c48145820 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.038+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 >> 172.21.15.1:0/2754000954 conn(0x7f8c480b0af0 msgr2=0x7f8c48158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.038+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 shutdown_connections 2023-12-02T01:30:34.041 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.039+0000 7f8c4d2ad640 1 -- 172.21.15.1:0/2754000954 wait complete. 2023-12-02T01:30:34.056 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-02T01:30:34.056 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-02T01:30:34.056 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-02T01:30:34.057 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:34.057 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-02T01:30:34.057 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-02T01:30:34.057 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-02T01:30:34.057 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:34.057 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-02T01:30:34.057 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-02T01:30:34.058 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-02T01:30:34.058 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:34.058 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-02T01:30:34.058 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-02T01:30:34.058 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-02T01:30:34.058 INFO:teuthology.orchestra.run:waiting for 300 2023-12-02T01:30:34.068 INFO:tasks.ceph.mds.a:Stopped 2023-12-02T01:30:34.068 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-02T01:30:34.069 INFO:tasks.ceph.mds.c:Stopped 2023-12-02T01:30:34.069 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-02T01:30:34.072 INFO:tasks.ceph.mds.b:Stopped 2023-12-02T01:30:34.072 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-02T01:30:34.073 INFO:tasks.ceph.mds.d:Stopped 2023-12-02T01:30:34.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-02T01:30:34.111 INFO:tasks.ceph.mds.a:Started 2023-12-02T01:30:34.111 DEBUG:teuthology.parallel:result is None 2023-12-02T01:30:34.112 INFO:tasks.ceph.mds.c:Started 2023-12-02T01:30:34.112 DEBUG:teuthology.parallel:result is None 2023-12-02T01:30:34.114 INFO:tasks.ceph.mds.b:Started 2023-12-02T01:30:34.115 DEBUG:teuthology.parallel:result is None 2023-12-02T01:30:34.115 INFO:tasks.ceph.mds.d:Started 2023-12-02T01:30:34.115 DEBUG:teuthology.parallel:result is None 2023-12-02T01:30:34.116 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-02T01:30:34.198 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2023-12-02T01:30:34.199 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2023-12-02T01:30:34.199 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2023-12-02T01:30:34.200 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2023-12-02T01:30:34.231 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.230+0000 7f1322d73640 1 Processor -- start 2023-12-02T01:30:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.230+0000 7f1322d73640 1 -- start start 2023-12-02T01:30:34.232 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1322d73640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f131c0d1570 0x7f131c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1322d73640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c0cef00 0x7f131c161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1322d73640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c0ce360 con 0x7f131c160b70 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1322d73640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131c0d19f0 con 0x7f131c0d1570 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1322d73640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0cdd50 con 0x7f131c0cef00 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1321310640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c0cef00 0x7f131c161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f131bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f131c0d1570 0x7f131c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1320b0f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f131c160b70 0x7f131c0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:53956/0 (socket says 172.21.15.1:53956) 2023-12-02T01:30:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1320b0f640 1 -- 172.21.15.1:0/925599767 learned_addr learned my addr 172.21.15.1:0/925599767 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1321310640 1 -- 172.21.15.1:0/925599767 >> v2:172.21.15.167:3300/0 conn(0x7f131c0d1570 msgr2=0x7f131c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1321310640 1 --2- 172.21.15.1:0/925599767 >> v2:172.21.15.167:3300/0 conn(0x7f131c0d1570 0x7f131c0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.231+0000 7f1321310640 1 -- 172.21.15.1:0/925599767 >> v1:172.21.15.167:6789/0 conn(0x7f131c160b70 legacy=0x7f131c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.232+0000 7f1321310640 1 -- 172.21.15.1:0/925599767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0d1c70 con 0x7f131c0cef00 2023-12-02T01:30:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.232+0000 7f131b7fe640 1 -- 172.21.15.1:0/925599767 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398136055 0 0) 0x7f131c0ce360 con 0x7f131c160b70 2023-12-02T01:30:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.232+0000 7f131bfff640 1 --2- 172.21.15.1:0/925599767 >> v2:172.21.15.167:3300/0 conn(0x7f131c0d1570 0x7f131c0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.232+0000 7f1321310640 1 --2- 172.21.15.1:0/925599767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c0cef00 0x7f131c161230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1314009d90 tx=0x7f131402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bddbe23de657efdc server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.232+0000 7f131b7fe640 1 -- 172.21.15.1:0/925599767 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131402cc50 con 0x7f131c0cef00 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f131b7fe640 1 -- 172.21.15.1:0/925599767 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131402cdb0 con 0x7f131c0cef00 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f131b7fe640 1 -- 172.21.15.1:0/925599767 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314034660 con 0x7f131c0cef00 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 -- 172.21.15.1:0/925599767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c0cef00 msgr2=0x7f131c161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 --2- 172.21.15.1:0/925599767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c0cef00 0x7f131c161230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1314009d90 tx=0x7f131402bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 -- 172.21.15.1:0/925599767 shutdown_connections 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 --2- 172.21.15.1:0/925599767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c0cef00 0x7f131c161230 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 --2- 172.21.15.1:0/925599767 >> v2:172.21.15.167:3300/0 conn(0x7f131c0d1570 0x7f131c0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 -- 172.21.15.1:0/925599767 >> 172.21.15.1:0/925599767 conn(0x7f131c09c470 msgr2=0x7f131c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 -- 172.21.15.1:0/925599767 shutdown_connections 2023-12-02T01:30:34.236 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.233+0000 7f1322d73640 1 -- 172.21.15.1:0/925599767 wait complete. 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.235+0000 7f1322d73640 1 Processor -- start 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.235+0000 7f1322d73640 1 -- start start 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1322d73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c0cef00 0x7f131c09dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1322d73640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f131c0d1570 0x7f131c0a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1322d73640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c160b70 0x7f131c14c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1322d73640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c15e660 con 0x7f131c0d1570 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f131c0d1570 0x7f131c0a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f131c0d1570 0x7f131c0a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37890/0 (socket says 172.21.15.1:37890) 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 -- 172.21.15.1:0/2910261670 learned_addr learned my addr 172.21.15.1:0/2910261670 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1320b0f640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c0cef00 0x7f131c09dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1321310640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c160b70 0x7f131c14c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c09e100 con 0x7f131c0cef00 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0a0da0 con 0x7f131c160b70 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 -- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c160b70 msgr2=0x7f131c14c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c160b70 0x7f131c14c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 -- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c0cef00 msgr2=0x7f131c09dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c0cef00 0x7f131c09dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.236+0000 7f131bfff640 1 -- 172.21.15.1:0/2910261670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308009400 con 0x7f131c0d1570 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.237+0000 7f131bfff640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f131c0d1570 0x7f131c0a0000 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f130800e990 tx=0x7f130800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.237+0000 7f13197fa640 1 -- 172.21.15.1:0/2910261670 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130800c9e0 con 0x7f131c0d1570 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.237+0000 7f13197fa640 1 -- 172.21.15.1:0/2910261670 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130800cb40 con 0x7f131c0d1570 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.237+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1314009a70 con 0x7f131c0d1570 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.237+0000 7f13197fa640 1 -- 172.21.15.1:0/2910261670 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130800ced0 con 0x7f131c0d1570 2023-12-02T01:30:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.237+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c15e310 con 0x7f131c0d1570 2023-12-02T01:30:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.238+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c15e120 con 0x7f131c0d1570 2023-12-02T01:30:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.238+0000 7f13197fa640 1 -- 172.21.15.1:0/2910261670 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1308013470 con 0x7f131c0d1570 2023-12-02T01:30:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.239+0000 7f13197fa640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f130006ae40 0x7f130006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.239+0000 7f13197fa640 1 -- 172.21.15.1:0/2910261670 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1308089450 con 0x7f131c0d1570 2023-12-02T01:30:34.241 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.239+0000 7f1320b0f640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f130006ae40 0x7f130006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:34.242 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.239+0000 7f1320b0f640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f130006ae40 0x7f130006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1310007fd0 tx=0x7f1310007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:34.245 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.243+0000 7f13197fa640 1 -- 172.21.15.1:0/2910261670 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f131c15e120 con 0x7f131c0d1570 2023-12-02T01:30:34.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:34.436+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f131c15e120 con 0x7f131c0d1570 2023-12-02T01:30:35.051 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.049+0000 7f13197fa640 1 -- 172.21.15.1:0/2910261670 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f131c15e120 con 0x7f131c0d1570 2023-12-02T01:30:35.051 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f130006ae40 msgr2=0x7f130006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f130006ae40 0x7f130006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1310007fd0 tx=0x7f1310007de0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f131c0d1570 msgr2=0x7f131c0a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f131c0d1570 0x7f131c0a0000 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f130800e990 tx=0x7f130800ee50 comp rx=0 tx=0).stop 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 shutdown_connections 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f131c160b70 0x7f131c14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f131c0d1570 0x7f131c0a0000 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f130006ae40 0x7f130006d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 --2- 172.21.15.1:0/2910261670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c0cef00 0x7f131c09dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 >> 172.21.15.1:0/2910261670 conn(0x7f131c09c470 msgr2=0x7f131c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 shutdown_connections 2023-12-02T01:30:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.053+0000 7f1322d73640 1 -- 172.21.15.1:0/2910261670 wait complete. 2023-12-02T01:30:35.069 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-02T01:30:35.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.178+0000 7fa8dffce640 1 Processor -- start 2023-12-02T01:30:35.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.179+0000 7fa8dffce640 1 -- start start 2023-12-02T01:30:35.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.179+0000 7fa8dffce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8161540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.179+0000 7fa8dffce640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8d80b0ee0 0x7fa8d80b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.179+0000 7fa8dffce640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d8161eb0 con 0x7fa8d806bff0 2023-12-02T01:30:35.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.179+0000 7fa8dffce640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d80cd8f0 con 0x7fa8d80b0ee0 2023-12-02T01:30:35.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.179+0000 7fa8dffce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80cdbd0 con 0x7fa8d8161100 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8de56b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8d80b0ee0 0x7fa8d80b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8ddd6a640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa8d806bff0 0x7fa8d806c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55102/0 (socket says 172.21.15.1:55102) 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8ddd6a640 1 -- 172.21.15.1:0/1817935494 learned_addr learned my addr 172.21.15.1:0/1817935494 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8dd569640 1 --2- 172.21.15.1:0/1817935494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8de56b640 1 -- 172.21.15.1:0/1817935494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 msgr2=0x7fa8d8161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8de56b640 1 --2- 172.21.15.1:0/1817935494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8de56b640 1 -- 172.21.15.1:0/1817935494 >> v1:172.21.15.1:6789/0 conn(0x7fa8d806bff0 legacy=0x7fa8d806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8de56b640 1 -- 172.21.15.1:0/1817935494 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d80cdeb0 con 0x7fa8d80b0ee0 2023-12-02T01:30:35.182 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.180+0000 7fa8dcd68640 1 -- 172.21.15.1:0/1817935494 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269304359 0 0) 0x7fa8d8161eb0 con 0x7fa8d806bff0 2023-12-02T01:30:35.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8de56b640 1 --2- 172.21.15.1:0/1817935494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d80b0ee0 0x7fa8d80b1360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009d90 tx=0x7fa8d002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5745e75dff9b5b4a server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.183 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dcd68640 1 -- 172.21.15.1:0/1817935494 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d002cc50 con 0x7fa8d80b0ee0 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dcd68640 1 -- 172.21.15.1:0/1817935494 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d002cdb0 con 0x7fa8d80b0ee0 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dcd68640 1 -- 172.21.15.1:0/1817935494 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0034660 con 0x7fa8d80b0ee0 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dffce640 1 -- 172.21.15.1:0/1817935494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d80b0ee0 msgr2=0x7fa8d80b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dffce640 1 --2- 172.21.15.1:0/1817935494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d80b0ee0 0x7fa8d80b1360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009d90 tx=0x7fa8d002bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dffce640 1 -- 172.21.15.1:0/1817935494 shutdown_connections 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dffce640 1 --2- 172.21.15.1:0/1817935494 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dffce640 1 --2- 172.21.15.1:0/1817935494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d80b0ee0 0x7fa8d80b1360 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.181+0000 7fa8dffce640 1 -- 172.21.15.1:0/1817935494 >> 172.21.15.1:0/1817935494 conn(0x7fa8d80d0f60 msgr2=0x7fa8d80d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.182+0000 7fa8dffce640 1 -- 172.21.15.1:0/1817935494 shutdown_connections 2023-12-02T01:30:35.184 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.182+0000 7fa8dffce640 1 -- 172.21.15.1:0/1817935494 wait complete. 2023-12-02T01:30:35.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 Processor -- start 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 -- start start 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d806bff0 0x7fa8d8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d80b0ee0 0x7fa8d8159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80aede0 con 0x7fa8d806bff0 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8151bb0 con 0x7fa8d80b0ee0 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.183+0000 7fa8dffce640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80aead0 con 0x7fa8d8161100 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d806bff0 0x7fa8d8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d806bff0 0x7fa8d8153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37902/0 (socket says 172.21.15.1:37902) 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 -- 172.21.15.1:0/204402618 learned_addr learned my addr 172.21.15.1:0/204402618 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8de56b640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8dd569640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d80b0ee0 0x7fa8d8159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 -- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 msgr2=0x7fa8d8151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 -- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d80b0ee0 msgr2=0x7fa8d8159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d80b0ee0 0x7fa8d8159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 -- 172.21.15.1:0/204402618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0009a70 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ddd6a640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d806bff0 0x7fa8d8153ba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c4d0 tx=0x7fa8c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ce7fc640 1 -- 172.21.15.1:0/204402618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80074e0 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ce7fc640 1 -- 172.21.15.1:0/204402618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8007660 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d80ce830 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8ce7fc640 1 -- 172.21.15.1:0/204402618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8004a20 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.184+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d81540e0 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.185+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d8068470 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.186+0000 7fa8ce7fc640 1 -- 172.21.15.1:0/204402618 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8c8004b80 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.186+0000 7fa8ce7fc640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa8bc06ae70 0x7fa8bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.186+0000 7fa8ce7fc640 1 -- 172.21.15.1:0/204402618 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa8c8088760 con 0x7fa8d806bff0 2023-12-02T01:30:35.189 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.186+0000 7fa8dd569640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa8bc06ae70 0x7fa8bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.190 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.187+0000 7fa8dd569640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa8bc06ae70 0x7fa8bc06d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8d809ee70 tx=0x7fa8d4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.190+0000 7fa8ce7fc640 1 -- 172.21.15.1:0/204402618 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8c8053b80 con 0x7fa8d806bff0 2023-12-02T01:30:35.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.434+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa8d80b6d60 con 0x7fa8d806bff0 2023-12-02T01:30:35.436 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.435+0000 7fa8ce7fc640 1 -- 172.21.15.1:0/204402618 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa8c8018020 con 0x7fa8d806bff0 2023-12-02T01:30:35.436 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:35.436 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGpleFwkGBAAITiRuWpXczedcnLptKnnlw==", 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGplVNhnJRAAu4ddZCm+qUWTih2nzCkrdA==", 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.c", 2023-12-02T01:30:35.438 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGplFj8zIBAANJ06XhaYfqIpRXPI+ikd4g==", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.d", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGplgfK5LBAAN9og1AhLP8hmFqP9b8z9DA==", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-12-02T01:30:35.439 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBSiGplqBeHGRAA5fPUANudtFc3/JC37eMC0Q==", 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.440 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBViGplRqS5GBAAsoEuYQs3z79q6ZXcO5Jiig==", 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBYiGplbuL4FxAApq4Bxa2J9KHDc83lv0VliA==", 2023-12-02T01:30:35.441 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.442 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.442 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.442 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBbiGpl7Y2AFxAAyWfYQKbDlxpbDtgvrso12w==", 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBhiGplmm75IRAA/5O9X6Qfg6STJP/LohsYIQ==", 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBkiGplQrSKHxAAWb/WIC80OZl0t14qLNc01Q==", 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.444 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBniGplzne9HRAATiHD4eSgkVMDXtMPgbyw9w==", 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.445 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBqiGplv5imHBAABqJyOVfN2fQvo5Ir4RDCQw==", 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGplxfg6MRAA+vtsoFgV7M1UyKLtt5Ugrw==", 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.446 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.1", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGpl3hWdOBAArzu02qjNXpKlL2QFnznCzA==", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-12-02T01:30:35.447 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.2", 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGpl4RsMNRAA3R86c7JBo/OLA6nw61j7yQ==", 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.448 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.3", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBRiGplSSTRAhAAlK+59Jpc1p0Q2F7cnSBswA==", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBPiGplFu4DNhAAQIWhqAPScVugg8AwpI5aLQ==", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2023-12-02T01:30:35.449 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-mds", 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBwiGplOaFxGxAAl96U5V3fxW3Hhpsog0K4xw==", 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-mds" 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-mgr", 2023-12-02T01:30:35.450 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBwiGpl76lxGxAAeSxPCDRmTI/j9F4+j8YcpQ==", 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-osd", 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBwiGplgbFxGxAAn8MSGdM8GsEGTMoIopIqAQ==", 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-osd" 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rbd", 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBwiGpl9bhxGxAAre5PFs3YfiohuKwe3Eiueg==", 2023-12-02T01:30:35.451 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBwiGplasBxGxAAFQkDPQ+PfWxuVNsFWc48zQ==", 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rgw", 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBwiGplY8hxGxAAgyvTqBN1qi1XJbiOGbSOKw==", 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.452 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGplEm9EFBAATP84GWPREy2Maye5AjRQkQ==", 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2023-12-02T01:30:35.453 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQBQiGplQkGSEBAAGTjP+dMFURFpZgDusYN/VQ==", 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2023-12-02T01:30:35.454 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa8bc06ae70 msgr2=0x7fa8bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa8bc06ae70 0x7fa8bc06d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8d809ee70 tx=0x7fa8d4009190 comp rx=0 tx=0).stop 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d806bff0 msgr2=0x7fa8d8153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d806bff0 0x7fa8d8153ba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c4d0 tx=0x7fa8c800c990 comp rx=0 tx=0).stop 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 shutdown_connections 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d8161100 0x7fa8d8151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa8bc06ae70 0x7fa8bc06d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d80b0ee0 0x7fa8d8159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 --2- 172.21.15.1:0/204402618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8d806bff0 0x7fa8d8153ba0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 >> 172.21.15.1:0/204402618 conn(0x7fa8d80d0f60 msgr2=0x7fa8d806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:35.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 shutdown_connections 2023-12-02T01:30:35.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.437+0000 7fa8dffce640 1 -- 172.21.15.1:0/204402618 wait complete. 2023-12-02T01:30:35.457 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-02T01:30:35.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.562+0000 7f01a759e640 1 Processor -- start 2023-12-02T01:30:35.564 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.563+0000 7f01a759e640 1 -- start start 2023-12-02T01:30:35.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.563+0000 7f01a759e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f01a80d1c10 0x7f01a80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.565 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.563+0000 7f01a759e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b3f70 0x7f01a80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.563+0000 7f01a759e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80d1110 con 0x7f01a80b33d0 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.563+0000 7f01a759e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80b3d90 con 0x7f01a80d1c10 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.563+0000 7f01a759e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80b47d0 con 0x7f01a80b3f70 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a5d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f01a80d1c10 0x7f01a80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a5d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f01a80d1c10 0x7f01a80cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37918/0 (socket says 172.21.15.1:37918) 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a5d9b640 1 -- 172.21.15.1:0/1159297088 learned_addr learned my addr 172.21.15.1:0/1159297088 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a6d9d640 1 --2- 172.21.15.1:0/1159297088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b3f70 0x7f01a80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a5d9b640 1 -- 172.21.15.1:0/1159297088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b3f70 msgr2=0x7f01a80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a5d9b640 1 --2- 172.21.15.1:0/1159297088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b3f70 0x7f01a80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a5d9b640 1 -- 172.21.15.1:0/1159297088 >> v1:172.21.15.167:6789/0 conn(0x7f01a80b33d0 legacy=0x7f01a80d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.564+0000 7f01a5d9b640 1 -- 172.21.15.1:0/1159297088 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80d3e30 con 0x7f01a80d1c10 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.565+0000 7f01a5d9b640 1 --2- 172.21.15.1:0/1159297088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a80cdf10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0190009870 tx=0x7f019002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62614500366e9f28 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.565+0000 7f01a559a640 1 -- 172.21.15.1:0/1159297088 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190031640 con 0x7f01a80d1c10 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.565+0000 7f01a559a640 1 -- 172.21.15.1:0/1159297088 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900317a0 con 0x7f01a80d1c10 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.565+0000 7f01a559a640 1 -- 172.21.15.1:0/1159297088 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190031b30 con 0x7f01a80d1c10 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.565+0000 7f01a759e640 1 -- 172.21.15.1:0/1159297088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 msgr2=0x7f01a80cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.565+0000 7f01a759e640 1 --2- 172.21.15.1:0/1159297088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a80cdf10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0190009870 tx=0x7f019002b8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.566+0000 7f01a759e640 1 -- 172.21.15.1:0/1159297088 shutdown_connections 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.566+0000 7f01a759e640 1 --2- 172.21.15.1:0/1159297088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b3f70 0x7f01a80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.566+0000 7f01a759e640 1 --2- 172.21.15.1:0/1159297088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a80cdf10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.566+0000 7f01a759e640 1 -- 172.21.15.1:0/1159297088 >> 172.21.15.1:0/1159297088 conn(0x7f01a80d2f20 msgr2=0x7f01a80d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.566+0000 7f01a759e640 1 -- 172.21.15.1:0/1159297088 shutdown_connections 2023-12-02T01:30:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.566+0000 7f01a759e640 1 -- 172.21.15.1:0/1159297088 wait complete. 2023-12-02T01:30:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.567+0000 7f01a759e640 1 Processor -- start 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.567+0000 7f01a759e640 1 -- start start 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a759e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b33d0 0x7f01a815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a80b3f70 0x7f01a80afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a81e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a759e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80b11b0 con 0x7f01a80d1c10 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a815ea20 con 0x7f01a80b3f70 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a759e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80b1640 con 0x7f01a80b33d0 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a81e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a81e9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37920/0 (socket says 172.21.15.1:37920) 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 -- 172.21.15.1:0/1258554406 learned_addr learned my addr 172.21.15.1:0/1258554406 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a659c640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b33d0 0x7f01a815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a5d9b640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a80b3f70 0x7f01a80afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 -- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b33d0 msgr2=0x7f01a815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b33d0 0x7f01a815e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 -- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a80b3f70 msgr2=0x7f01a80afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a80b3f70 0x7f01a80afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 -- 172.21.15.1:0/1258554406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900094d0 con 0x7f01a80d1c10 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a6d9d640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a81e9340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0198009dd0 tx=0x7f019800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f019effd640 1 -- 172.21.15.1:0/1258554406 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198014480 con 0x7f01a80d1c10 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f019effd640 1 -- 172.21.15.1:0/1258554406 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800f040 con 0x7f01a80d1c10 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.568+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80b05a0 con 0x7f01a80d1c10 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.569+0000 7f019effd640 1 -- 172.21.15.1:0/1258554406 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198014840 con 0x7f01a80d1c10 2023-12-02T01:30:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.569+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80b0b60 con 0x7f01a80d1c10 2023-12-02T01:30:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.570+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a80b1360 con 0x7f01a80d1c10 2023-12-02T01:30:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.570+0000 7f019effd640 1 -- 172.21.15.1:0/1258554406 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01980149a0 con 0x7f01a80d1c10 2023-12-02T01:30:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.570+0000 7f019effd640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f018806ae40 0x7f018806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.571+0000 7f019effd640 1 -- 172.21.15.1:0/1258554406 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0198089c50 con 0x7f01a80d1c10 2023-12-02T01:30:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.571+0000 7f01a659c640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f018806ae40 0x7f018806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.571+0000 7f01a659c640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f018806ae40 0x7f018806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01a81f6ac0 tx=0x7f01a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.575+0000 7f019effd640 1 -- 172.21.15.1:0/1258554406 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01a80b1360 con 0x7f01a80d1c10 2023-12-02T01:30:35.818 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.816+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f01a80b1360 con 0x7f01a80d1c10 2023-12-02T01:30:35.819 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.818+0000 7f019effd640 1 -- 172.21.15.1:0/1258554406 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f01a80b1360 con 0x7f01a80d1c10 2023-12-02T01:30:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f018806ae40 msgr2=0x7f018806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f018806ae40 0x7f018806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01a81f6ac0 tx=0x7f01a0009040 comp rx=0 tx=0).stop 2023-12-02T01:30:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 msgr2=0x7f01a81e9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.822 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a81e9340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0198009dd0 tx=0x7f019800c490 comp rx=0 tx=0).stop 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 shutdown_connections 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01a80d1c10 0x7f01a81e9340 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f018806ae40 0x7f018806d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a80b3f70 0x7f01a80afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 --2- 172.21.15.1:0/1258554406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a80b33d0 0x7f01a815e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 >> 172.21.15.1:0/1258554406 conn(0x7f01a80d2f20 msgr2=0x7f01a815ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.820+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 shutdown_connections 2023-12-02T01:30:35.823 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.821+0000 7f01a759e640 1 -- 172.21.15.1:0/1258554406 wait complete. 2023-12-02T01:30:35.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-02T01:30:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.938+0000 7f077fe56640 1 Processor -- start 2023-12-02T01:30:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.938+0000 7f077fe56640 1 -- start start 2023-12-02T01:30:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077fe56640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07780b6b50 0x7f07780cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077fe56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0778099970 0x7f0778099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077fe56640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780b3590 con 0x7f07780cc390 2023-12-02T01:30:35.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077fe56640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077806b310 con 0x7f07780b6b50 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077fe56640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077809a2d0 con 0x7f0778099970 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077dbf2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07780b6b50 0x7f07780cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077dbf2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f07780b6b50 0x7f07780cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37924/0 (socket says 172.21.15.1:37924) 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077dbf2640 1 -- 172.21.15.1:0/2370584384 learned_addr learned my addr 172.21.15.1:0/2370584384 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077d3f1640 1 --2- 172.21.15.1:0/2370584384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0778099970 0x7f0778099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077dbf2640 1 -- 172.21.15.1:0/2370584384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0778099970 msgr2=0x7f0778099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077dbf2640 1 --2- 172.21.15.1:0/2370584384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0778099970 0x7f0778099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077dbf2640 1 -- 172.21.15.1:0/2370584384 >> v1:172.21.15.167:6789/0 conn(0x7f07780cc390 legacy=0x7f07780cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.939+0000 7f077dbf2640 1 -- 172.21.15.1:0/2370584384 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780b37c0 con 0x7f07780b6b50 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.940+0000 7f077dbf2640 1 --2- 172.21.15.1:0/2370584384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07780b6b50 0x7f07780cfd40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0774009870 tx=0x7f077402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335a5b7e14f0a465 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.940+0000 7f077cbf0640 1 -- 172.21.15.1:0/2370584384 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077402f840 con 0x7f07780b6b50 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.940+0000 7f077cbf0640 1 -- 172.21.15.1:0/2370584384 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077402f9a0 con 0x7f07780b6b50 2023-12-02T01:30:35.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.940+0000 7f077cbf0640 1 -- 172.21.15.1:0/2370584384 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077402fd30 con 0x7f07780b6b50 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 -- 172.21.15.1:0/2370584384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07780b6b50 msgr2=0x7f07780cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 --2- 172.21.15.1:0/2370584384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07780b6b50 0x7f07780cfd40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0774009870 tx=0x7f077402ba20 comp rx=0 tx=0).stop 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 -- 172.21.15.1:0/2370584384 shutdown_connections 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 --2- 172.21.15.1:0/2370584384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0778099970 0x7f0778099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 --2- 172.21.15.1:0/2370584384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07780b6b50 0x7f07780cfd40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 -- 172.21.15.1:0/2370584384 >> 172.21.15.1:0/2370584384 conn(0x7f07780b2a70 msgr2=0x7f07780b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 -- 172.21.15.1:0/2370584384 shutdown_connections 2023-12-02T01:30:35.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.941+0000 7f077fe56640 1 -- 172.21.15.1:0/2370584384 wait complete. 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.942+0000 7f077fe56640 1 Processor -- start 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.942+0000 7f077fe56640 1 -- start start 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077fe56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0778099970 0x7f07781f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077fe56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07780b6b50 0x7f07780c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077fe56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07780cc390 0x7f07780c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077fe56640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c5ed0 con 0x7f0778099970 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077fe56640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07781f3930 con 0x7f07780cc390 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077fe56640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c4ff0 con 0x7f07780b6b50 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0778099970 0x7f07781f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0778099970 0x7f07781f33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37926/0 (socket says 172.21.15.1:37926) 2023-12-02T01:30:35.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 -- 172.21.15.1:0/3407494484 learned_addr learned my addr 172.21.15.1:0/3407494484 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077e3f3640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07780cc390 0x7f07780c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077d3f1640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07780b6b50 0x7f07780c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 -- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07780b6b50 msgr2=0x7f07780c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07780b6b50 0x7f07780c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 -- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07780cc390 msgr2=0x7f07780c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07780cc390 0x7f07780c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077dbf2640 1 -- 172.21.15.1:0/3407494484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740094d0 con 0x7f0778099970 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.943+0000 7f077e3f3640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07780cc390 0x7f07780c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.944+0000 7f077dbf2640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0778099970 0x7f07781f33f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0774000c00 tx=0x7f0774004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.944+0000 7f076e7fc640 1 -- 172.21.15.1:0/3407494484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774045070 con 0x7f0778099970 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.944+0000 7f076e7fc640 1 -- 172.21.15.1:0/3407494484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774037a40 con 0x7f0778099970 2023-12-02T01:30:35.949 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.944+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07780c52c0 con 0x7f0778099970 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.944+0000 7f076e7fc640 1 -- 172.21.15.1:0/3407494484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774037df0 con 0x7f0778099970 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.944+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780c5880 con 0x7f0778099970 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.945+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077815afe0 con 0x7f0778099970 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.945+0000 7f076e7fc640 1 -- 172.21.15.1:0/3407494484 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f077404a410 con 0x7f0778099970 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.946+0000 7f076e7fc640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f075c06ae70 0x7f075c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.946+0000 7f076e7fc640 1 -- 172.21.15.1:0/3407494484 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f077403c070 con 0x7f0778099970 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.946+0000 7f077d3f1640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f075c06ae70 0x7f075c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:35.950 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.946+0000 7f077d3f1640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f075c06ae70 0x7f075c06d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f07780b5e10 tx=0x7f0768008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:35.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:35.950+0000 7f076e7fc640 1 -- 172.21.15.1:0/3407494484 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07740769c0 con 0x7f0778099970 2023-12-02T01:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.195+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f077809ef40 con 0x7f0778099970 2023-12-02T01:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.197+0000 7f076e7fc640 1 -- 172.21.15.1:0/3407494484 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0774079fe0 con 0x7f0778099970 2023-12-02T01:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f075c06ae70 msgr2=0x7f075c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f075c06ae70 0x7f075c06d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f07780b5e10 tx=0x7f0768008040 comp rx=0 tx=0).stop 2023-12-02T01:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0778099970 msgr2=0x7f07781f33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0778099970 0x7f07781f33f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0774000c00 tx=0x7f0774004730 comp rx=0 tx=0).stop 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 shutdown_connections 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f075c06ae70 0x7f075c06d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07780cc390 0x7f07780c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07780b6b50 0x7f07780c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 --2- 172.21.15.1:0/3407494484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0778099970 0x7f07781f33f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 >> 172.21.15.1:0/3407494484 conn(0x7f07780b2a70 msgr2=0x7f077806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 shutdown_connections 2023-12-02T01:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.199+0000 7f077fe56640 1 -- 172.21.15.1:0/3407494484 wait complete. 2023-12-02T01:30:36.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-02T01:30:36.318 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.317+0000 7f792cdd0640 1 Processor -- start 2023-12-02T01:30:36.319 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.317+0000 7f792cdd0640 1 -- start start 2023-12-02T01:30:36.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f792cdd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815d690 0x7f792815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f792cdd0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792809a720 con 0x7f792806ec60 2023-12-02T01:30:36.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f792cdd0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7928099b10 con 0x7f792806e460 2023-12-02T01:30:36.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f792cdd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792815e9d0 con 0x7f792815d690 2023-12-02T01:30:36.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f792659c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f792806ec60 0x7f792806f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55108/0 (socket says 172.21.15.1:55108) 2023-12-02T01:30:36.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f792659c640 1 -- 172.21.15.1:0/374082929 learned_addr learned my addr 172.21.15.1:0/374082929 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:36.320 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f791ffff640 1 --2- 172.21.15.1:0/374082929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815d690 0x7f792815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f7925d9b640 1 -- 172.21.15.1:0/374082929 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396199326 0 0) 0x7f792809a720 con 0x7f792806ec60 2023-12-02T01:30:36.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f7925d9b640 1 -- 172.21.15.1:0/374082929 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7914003520 con 0x7f792806ec60 2023-12-02T01:30:36.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f7925d9b640 1 -- 172.21.15.1:0/374082929 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643699226 0 0) 0x7f7928099b10 con 0x7f792806e460 2023-12-02T01:30:36.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f7925d9b640 1 -- 172.21.15.1:0/374082929 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792809a720 con 0x7f792806e460 2023-12-02T01:30:36.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f791ffff640 1 -- 172.21.15.1:0/374082929 >> v1:172.21.15.167:6789/0 conn(0x7f792806e460 legacy=0x7f79280cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f791ffff640 1 -- 172.21.15.1:0/374082929 >> v1:172.21.15.1:6789/0 conn(0x7f792806ec60 legacy=0x7f792806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.321 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.318+0000 7f791ffff640 1 -- 172.21.15.1:0/374082929 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928099df0 con 0x7f792815d690 2023-12-02T01:30:36.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.319+0000 7f791ffff640 1 --2- 172.21.15.1:0/374082929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815d690 0x7f792815e490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79100097d0 tx=0x7f791002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a676fa1b00697fa server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:36.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.319+0000 7f7925d9b640 1 -- 172.21.15.1:0/374082929 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910031770 con 0x7f792815d690 2023-12-02T01:30:36.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.319+0000 7f7925d9b640 1 -- 172.21.15.1:0/374082929 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100318d0 con 0x7f792815d690 2023-12-02T01:30:36.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.319+0000 7f7925d9b640 1 -- 172.21.15.1:0/374082929 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910031c60 con 0x7f792815d690 2023-12-02T01:30:36.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.320+0000 7f792cdd0640 1 -- 172.21.15.1:0/374082929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815d690 msgr2=0x7f792815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.322 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.320+0000 7f792cdd0640 1 --2- 172.21.15.1:0/374082929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815d690 0x7f792815e490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79100097d0 tx=0x7f791002b810 comp rx=0 tx=0).stop 2023-12-02T01:30:36.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.320+0000 7f792cdd0640 1 -- 172.21.15.1:0/374082929 shutdown_connections 2023-12-02T01:30:36.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.320+0000 7f792cdd0640 1 --2- 172.21.15.1:0/374082929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815d690 0x7f792815e490 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.320+0000 7f792cdd0640 1 -- 172.21.15.1:0/374082929 >> 172.21.15.1:0/374082929 conn(0x7f79280b2a20 msgr2=0x7f79280b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:36.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.320+0000 7f792cdd0640 1 -- 172.21.15.1:0/374082929 shutdown_connections 2023-12-02T01:30:36.323 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.320+0000 7f792cdd0640 1 -- 172.21.15.1:0/374082929 wait complete. 2023-12-02T01:30:36.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.321+0000 7f792cdd0640 1 Processor -- start 2023-12-02T01:30:36.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.321+0000 7f792cdd0640 1 -- start start 2023-12-02T01:30:36.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f792cdd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f792806e460 0x7f79280b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.325 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f792cdd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f792806ec60 0x7f79280b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f792cdd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815b970 0x7f792815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f792cdd0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792815c340 con 0x7f792806ec60 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f792cdd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7928159920 con 0x7f792806e460 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f792cdd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792815a1c0 con 0x7f792815b970 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f791ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f792806ec60 0x7f79280b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f791ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f792806ec60 0x7f79280b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37942/0 (socket says 172.21.15.1:37942) 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f791ffff640 1 -- 172.21.15.1:0/3400531980 learned_addr learned my addr 172.21.15.1:0/3400531980 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f792659c640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f792806e460 0x7f79280b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f7926d9d640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815b970 0x7f792815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f791ffff640 1 -- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815b970 msgr2=0x7f792815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.326 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f791ffff640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815b970 0x7f792815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f791ffff640 1 -- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f792806e460 msgr2=0x7f79280b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.322+0000 7f791ffff640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f792806e460 0x7f79280b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.323+0000 7f791ffff640 1 -- 172.21.15.1:0/3400531980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7910009400 con 0x7f792806ec60 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.323+0000 7f791ffff640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f792806ec60 0x7f79280b63f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f791002b850 tx=0x7f79100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.323+0000 7f791effd640 1 -- 172.21.15.1:0/3400531980 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910032810 con 0x7f792806ec60 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.323+0000 7f791effd640 1 -- 172.21.15.1:0/3400531980 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910032970 con 0x7f792806ec60 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.323+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79280b4a70 con 0x7f792806ec60 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.323+0000 7f791effd640 1 -- 172.21.15.1:0/3400531980 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910032d20 con 0x7f792806ec60 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.323+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7928159b70 con 0x7f792806ec60 2023-12-02T01:30:36.327 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.324+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792815a370 con 0x7f792806ec60 2023-12-02T01:30:36.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.324+0000 7f791effd640 1 -- 172.21.15.1:0/3400531980 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f791004d3f0 con 0x7f792806ec60 2023-12-02T01:30:36.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.325+0000 7f791effd640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f790806ae40 0x7f790806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.325+0000 7f791effd640 1 -- 172.21.15.1:0/3400531980 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79100aac70 con 0x7f792806ec60 2023-12-02T01:30:36.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.325+0000 7f792659c640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f790806ae40 0x7f790806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.328 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.325+0000 7f792659c640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f790806ae40 0x7f790806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7918000f60 tx=0x7f7918009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:36.330 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.329+0000 7f791effd640 1 -- 172.21.15.1:0/3400531980 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f792815a370 con 0x7f792806ec60 2023-12-02T01:30:36.574 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.573+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f792815a330 con 0x7f792806ec60 2023-12-02T01:30:36.576 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.575+0000 7f791effd640 1 -- 172.21.15.1:0/3400531980 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7910076070 con 0x7f792806ec60 2023-12-02T01:30:36.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f790806ae40 msgr2=0x7f790806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.579 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f790806ae40 0x7f790806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7918000f60 tx=0x7f7918009040 comp rx=0 tx=0).stop 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f792806ec60 msgr2=0x7f79280b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f792806ec60 0x7f79280b63f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f791002b850 tx=0x7f79100046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 shutdown_connections 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f792815b970 0x7f792815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f792806ec60 0x7f79280b63f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f790806ae40 0x7f790806d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 --2- 172.21.15.1:0/3400531980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f792806e460 0x7f79280b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 >> 172.21.15.1:0/3400531980 conn(0x7f79280b2a20 msgr2=0x7f792806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 shutdown_connections 2023-12-02T01:30:36.580 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.578+0000 7f792cdd0640 1 -- 172.21.15.1:0/3400531980 wait complete. 2023-12-02T01:30:36.590 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-02T01:30:36.697 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.696+0000 7fa70ea4f640 1 Processor -- start 2023-12-02T01:30:36.698 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.696+0000 7fa70ea4f640 1 -- start start 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70ea4f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa7080cfd40 0x7fa70806c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70ea4f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7080b3590 con 0x7fa70809a080 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70ea4f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70806b310 con 0x7fa7080b6b50 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70ea4f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7080cd3a0 con 0x7fa7080cfd40 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70cfec640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa7080cfd40 0x7fa70806c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa7077fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa70809a080 0x7fa70806bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55116/0 (socket says 172.21.15.1:55116) 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa7077fe640 1 -- 172.21.15.1:0/3067456263 learned_addr learned my addr 172.21.15.1:0/3067456263 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70cfec640 1 -- 172.21.15.1:0/3067456263 >> v1:172.21.15.167:6789/0 conn(0x7fa7080b6b50 legacy=0x7fa708099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70cfec640 1 -- 172.21.15.1:0/3067456263 >> v1:172.21.15.1:6789/0 conn(0x7fa70809a080 legacy=0x7fa70806bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa70cfec640 1 -- 172.21.15.1:0/3067456263 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7080b37c0 con 0x7fa7080cfd40 2023-12-02T01:30:36.699 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.697+0000 7fa706ffd640 1 -- 172.21.15.1:0/3067456263 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449284148 0 0) 0x7fa7080b3590 con 0x7fa70809a080 2023-12-02T01:30:36.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.698+0000 7fa70cfec640 1 --2- 172.21.15.1:0/3067456263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080cfd40 0x7fa70806c360 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa700009d90 tx=0x7fa70002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6d2762e6b5cef3 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:36.700 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.698+0000 7fa706ffd640 1 -- 172.21.15.1:0/3067456263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70002cd00 con 0x7fa7080cfd40 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.698+0000 7fa706ffd640 1 -- 172.21.15.1:0/3067456263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70002ce60 con 0x7fa7080cfd40 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.698+0000 7fa706ffd640 1 -- 172.21.15.1:0/3067456263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700034660 con 0x7fa7080cfd40 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.699+0000 7fa70ea4f640 1 -- 172.21.15.1:0/3067456263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080cfd40 msgr2=0x7fa70806c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.699+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/3067456263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080cfd40 0x7fa70806c360 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa700009d90 tx=0x7fa70002bf50 comp rx=0 tx=0).stop 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.699+0000 7fa70ea4f640 1 -- 172.21.15.1:0/3067456263 shutdown_connections 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.699+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/3067456263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080cfd40 0x7fa70806c360 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.699+0000 7fa70ea4f640 1 -- 172.21.15.1:0/3067456263 >> 172.21.15.1:0/3067456263 conn(0x7fa7080b2a70 msgr2=0x7fa7080b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.699+0000 7fa70ea4f640 1 -- 172.21.15.1:0/3067456263 shutdown_connections 2023-12-02T01:30:36.701 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.699+0000 7fa70ea4f640 1 -- 172.21.15.1:0/3067456263 wait complete. 2023-12-02T01:30:36.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.700+0000 7fa70ea4f640 1 Processor -- start 2023-12-02T01:30:36.702 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.700+0000 7fa70ea4f640 1 -- start start 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70ea4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa70809a080 0x7fa70814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70ea4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080b6b50 0x7fa70815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70ea4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7080cfd40 0x7fa70815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70ea4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70814f9b0 con 0x7fa7080b6b50 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70ea4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70815dd70 con 0x7fa70809a080 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70ea4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70815e050 con 0x7fa7080cfd40 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080b6b50 0x7fa70815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080b6b50 0x7fa70815ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37960/0 (socket says 172.21.15.1:37960) 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 -- 172.21.15.1:0/2984262785 learned_addr learned my addr 172.21.15.1:0/2984262785 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa707fff640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa70809a080 0x7fa70814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.704 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70cfec640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7080cfd40 0x7fa70815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 -- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7080cfd40 msgr2=0x7fa70815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7080cfd40 0x7fa70815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 -- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa70809a080 msgr2=0x7fa70814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa70809a080 0x7fa70814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 -- 172.21.15.1:0/2984262785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700009a70 con 0x7fa7080b6b50 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa70cfec640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7080cfd40 0x7fa70815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.701+0000 7fa7077fe640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080b6b50 0x7fa70815ee10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800c4d0 tx=0x7fa6f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.702+0000 7fa704ff9640 1 -- 172.21.15.1:0/2984262785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80074e0 con 0x7fa7080b6b50 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.702+0000 7fa704ff9640 1 -- 172.21.15.1:0/2984262785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8007660 con 0x7fa7080b6b50 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.702+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70815e330 con 0x7fa7080b6b50 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.702+0000 7fa704ff9640 1 -- 172.21.15.1:0/2984262785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8004a20 con 0x7fa7080b6b50 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.702+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70815e8f0 con 0x7fa7080b6b50 2023-12-02T01:30:36.705 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.703+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70815eb10 con 0x7fa7080b6b50 2023-12-02T01:30:36.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.703+0000 7fa704ff9640 1 -- 172.21.15.1:0/2984262785 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6f8004b80 con 0x7fa7080b6b50 2023-12-02T01:30:36.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.703+0000 7fa704ff9640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6f406ae40 0x7fa6f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:36.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.703+0000 7fa704ff9640 1 -- 172.21.15.1:0/2984262785 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa6f8088760 con 0x7fa7080b6b50 2023-12-02T01:30:36.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.703+0000 7fa707fff640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6f406ae40 0x7fa6f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:36.706 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.704+0000 7fa707fff640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6f406ae40 0x7fa6f406d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc004ea0 tx=0x7fa6fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:36.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.708+0000 7fa704ff9640 1 -- 172.21.15.1:0/2984262785 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6f8053bf0 con 0x7fa7080b6b50 2023-12-02T01:30:36.951 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.949+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa70809ef40 con 0x7fa7080b6b50 2023-12-02T01:30:36.952 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.951+0000 7fa704ff9640 1 -- 172.21.15.1:0/2984262785 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa6f80180a0 con 0x7fa7080b6b50 2023-12-02T01:30:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6f406ae40 msgr2=0x7fa6f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6f406ae40 0x7fa6f406d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc004ea0 tx=0x7fa6fc009040 comp rx=0 tx=0).stop 2023-12-02T01:30:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080b6b50 msgr2=0x7fa70815ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080b6b50 0x7fa70815ee10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800c4d0 tx=0x7fa6f800c990 comp rx=0 tx=0).stop 2023-12-02T01:30:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 shutdown_connections 2023-12-02T01:30:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7080cfd40 0x7fa70815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7080b6b50 0x7fa70815ee10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6f406ae40 0x7fa6f406d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 --2- 172.21.15.1:0/2984262785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa70809a080 0x7fa70814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:36.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 >> 172.21.15.1:0/2984262785 conn(0x7fa7080b2a70 msgr2=0x7fa70806e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:36.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 shutdown_connections 2023-12-02T01:30:36.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:36.953+0000 7fa70ea4f640 1 -- 172.21.15.1:0/2984262785 wait complete. 2023-12-02T01:30:36.966 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-02T01:30:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.073+0000 7f307e3a0640 1 Processor -- start 2023-12-02T01:30:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.073+0000 7f307e3a0640 1 -- start start 2023-12-02T01:30:37.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f307e3a0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 0x7f30780b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f307e3a0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30780b1740 con 0x7f30780b1e50 2023-12-02T01:30:37.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f307e3a0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30780b1900 con 0x7f30780b1360 2023-12-02T01:30:37.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f307e3a0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30780ccd50 con 0x7f30780cf9f0 2023-12-02T01:30:37.083 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f307db9f640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f30780b1e50 0x7f30780b4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55124/0 (socket says 172.21.15.1:55124) 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f307db9f640 1 -- 172.21.15.1:0/4026605803 learned_addr learned my addr 172.21.15.1:0/4026605803 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f307cb9d640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 0x7f30780b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768965965 0 0) 0x7f3070001490 con 0x7f30780b1e50 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3064003520 con 0x7f30780b1e50 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 361185971 0 0) 0x7f3064003520 con 0x7f30780b1e50 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 msgr2=0x7f30780b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 0x7f30780b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 >> v1:172.21.15.167:6789/0 conn(0x7f30780b1360 legacy=0x7f30780cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780d1b70 con 0x7f30780b1e50 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f3070001b80 con 0x7f30780b1e50 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 >> v1:172.21.15.1:6789/0 conn(0x7f30780b1e50 legacy=0x7f30780b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30640039a0 0x7f3064003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.084 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3064004350 0x7f3064004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 0x7f3064005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30780ccd50 con 0x7f30640039a0 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306400b980 con 0x7f3064004350 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.074+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306400bb40 con 0x7f30780cf9f0 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307d39e640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30640039a0 0x7f3064003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307cb9d640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3064004350 0x7f3064004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307db9f640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 0x7f3064005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307d39e640 1 -- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 msgr2=0x7f3064005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307d39e640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30780cf9f0 0x7f3064005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307d39e640 1 -- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3064004350 msgr2=0x7f3064004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307d39e640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3064004350 0x7f3064004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.075+0000 7f307d39e640 1 -- 172.21.15.1:0/4026605803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064003520 con 0x7f30640039a0 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307d39e640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30640039a0 0x7f3064003d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3074001860 tx=0x7f30640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce51bafc7652a69c server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.085 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074033630 con 0x7f30640039a0 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30740337b0 con 0x7f30640039a0 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f306ffff640 1 -- 172.21.15.1:0/4026605803 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074033b60 con 0x7f30640039a0 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307e3a0640 1 -- 172.21.15.1:0/4026605803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30640039a0 msgr2=0x7f3064003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307e3a0640 1 --2- 172.21.15.1:0/4026605803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30640039a0 0x7f3064003d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3074001860 tx=0x7f30640057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307db9f640 1 -- 172.21.15.1:0/4026605803 reap_dead start 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307e3a0640 1 -- 172.21.15.1:0/4026605803 shutdown_connections 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307e3a0640 1 -- 172.21.15.1:0/4026605803 >> 172.21.15.1:0/4026605803 conn(0x7f30780d0d00 msgr2=0x7f30780d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307e3a0640 1 -- 172.21.15.1:0/4026605803 shutdown_connections 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.076+0000 7f307e3a0640 1 -- 172.21.15.1:0/4026605803 wait complete. 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 Processor -- start 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 -- start start 2023-12-02T01:30:37.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30640039a0 0x7f30781f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f307815a6f0 0x7f307815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3078146d20 0x7f30781471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3078156c90 con 0x7f307815a6f0 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30781f17b0 con 0x7f30640039a0 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307e3a0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3078156a90 con 0x7f3078146d20 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307cb9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f307815a6f0 0x7f307815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307cb9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f307815a6f0 0x7f307815ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37974/0 (socket says 172.21.15.1:37974) 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.078+0000 7f307cb9d640 1 -- 172.21.15.1:0/2374653493 learned_addr learned my addr 172.21.15.1:0/2374653493 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307d39e640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30640039a0 0x7f30781f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307db9f640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3078146d20 0x7f30781471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307cb9d640 1 -- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3078146d20 msgr2=0x7f30781471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307cb9d640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3078146d20 0x7f30781471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307cb9d640 1 -- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30640039a0 msgr2=0x7f30781f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307cb9d640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30640039a0 0x7f30781f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307cb9d640 1 -- 172.21.15.1:0/2374653493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30781f19a0 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307d39e640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30640039a0 0x7f30781f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307cb9d640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f307815a6f0 0x7f307815ab70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30680118e0 tx=0x7f3068011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f306dffb640 1 -- 172.21.15.1:0/2374653493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800faf0 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f306dffb640 1 -- 172.21.15.1:0/2374653493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800fc50 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3078154e70 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f306dffb640 1 -- 172.21.15.1:0/2374653493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068014440 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.079+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3078155430 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.080+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30780b4d90 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.081+0000 7f306dffb640 1 -- 172.21.15.1:0/2374653493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30680145a0 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.081+0000 7f306dffb640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f305c06ae70 0x7f305c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.081+0000 7f306dffb640 1 -- 172.21.15.1:0/2374653493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3068089a70 con 0x7f307815a6f0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.081+0000 7f307d39e640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f305c06ae70 0x7f305c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.082+0000 7f307d39e640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f305c06ae70 0x7f305c06d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3074001860 tx=0x7f3074031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.085+0000 7f306dffb640 1 -- 172.21.15.1:0/2374653493 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3068054e70 con 0x7f307815a6f0 2023-12-02T01:30:37.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.331+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f307804e840 con 0x7f307815a6f0 2023-12-02T01:30:37.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.333+0000 7f306dffb640 1 -- 172.21.15.1:0/2374653493 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3068058490 con 0x7f307815a6f0 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f305c06ae70 msgr2=0x7f305c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f305c06ae70 0x7f305c06d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3074001860 tx=0x7f3074031000 comp rx=0 tx=0).stop 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f307815a6f0 msgr2=0x7f307815ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f307815a6f0 0x7f307815ab70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30680118e0 tx=0x7f3068011da0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 shutdown_connections 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3078146d20 0x7f30781471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f307815a6f0 0x7f307815ab70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f305c06ae70 0x7f305c06d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 --2- 172.21.15.1:0/2374653493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30640039a0 0x7f30781f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 >> 172.21.15.1:0/2374653493 conn(0x7f30780d0d00 msgr2=0x7f30780d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 shutdown_connections 2023-12-02T01:30:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.335+0000 7f307e3a0640 1 -- 172.21.15.1:0/2374653493 wait complete. 2023-12-02T01:30:37.347 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-02T01:30:37.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.453+0000 7f65aa93e640 1 Processor -- start 2023-12-02T01:30:37.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.453+0000 7f65aa93e640 1 -- start start 2023-12-02T01:30:37.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.454+0000 7f65aa93e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f65a406abe0 0x7f65a40b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.454+0000 7f65aa93e640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a40cf790 con 0x7f65a4071d40 2023-12-02T01:30:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.454+0000 7f65aa93e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a4072160 con 0x7f65a41465d0 2023-12-02T01:30:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.454+0000 7f65aa93e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a4161d80 con 0x7f65a406abe0 2023-12-02T01:30:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.454+0000 7f65a37fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f65a406abe0 0x7f65a40b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.454+0000 7f65a8edb640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f65a4071d40 0x7f65a40cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55140/0 (socket says 172.21.15.1:55140) 2023-12-02T01:30:37.456 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.454+0000 7f65a8edb640 1 -- 172.21.15.1:0/806959832 learned_addr learned my addr 172.21.15.1:0/806959832 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:37.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a37fe640 1 -- 172.21.15.1:0/806959832 >> v1:172.21.15.167:6789/0 conn(0x7f65a41465d0 legacy=0x7f65a406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a37fe640 1 -- 172.21.15.1:0/806959832 >> v1:172.21.15.1:6789/0 conn(0x7f65a4071d40 legacy=0x7f65a40cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a37fe640 1 -- 172.21.15.1:0/806959832 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a41614e0 con 0x7f65a406abe0 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a2ffd640 1 -- 172.21.15.1:0/806959832 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012502487 0 0) 0x7f65a40cf790 con 0x7f65a4071d40 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a37fe640 1 --2- 172.21.15.1:0/806959832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a406abe0 0x7f65a40b2ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f65940097a0 tx=0x7f659402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7097568afd09e0ea server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a2ffd640 1 -- 172.21.15.1:0/806959832 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594031830 con 0x7f65a406abe0 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a2ffd640 1 -- 172.21.15.1:0/806959832 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594031990 con 0x7f65a406abe0 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.455+0000 7f65a2ffd640 1 -- 172.21.15.1:0/806959832 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594031d20 con 0x7f65a406abe0 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.456+0000 7f65aa93e640 1 -- 172.21.15.1:0/806959832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a406abe0 msgr2=0x7f65a40b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.456+0000 7f65aa93e640 1 --2- 172.21.15.1:0/806959832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a406abe0 0x7f65a40b2ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f65940097a0 tx=0x7f659402b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.456+0000 7f65aa93e640 1 -- 172.21.15.1:0/806959832 shutdown_connections 2023-12-02T01:30:37.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.456+0000 7f65aa93e640 1 --2- 172.21.15.1:0/806959832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a406abe0 0x7f65a40b2ee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.456+0000 7f65aa93e640 1 -- 172.21.15.1:0/806959832 >> 172.21.15.1:0/806959832 conn(0x7f65a40cc930 msgr2=0x7f65a40ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:37.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.456+0000 7f65aa93e640 1 -- 172.21.15.1:0/806959832 shutdown_connections 2023-12-02T01:30:37.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.456+0000 7f65aa93e640 1 -- 172.21.15.1:0/806959832 wait complete. 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.457+0000 7f65aa93e640 1 Processor -- start 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.457+0000 7f65aa93e640 1 -- start start 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65aa93e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a406abe0 0x7f65a4160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65aa93e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a4071d40 0x7f65a40adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65aa93e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a41465d0 0x7f65a413d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65aa93e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4160590 con 0x7f65a41465d0 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65aa93e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40acb10 con 0x7f65a4071d40 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65aa93e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40acdf0 con 0x7f65a406abe0 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a8edb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a41465d0 0x7f65a413d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a8edb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a41465d0 0x7f65a413d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37990/0 (socket says 172.21.15.1:37990) 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a8edb640 1 -- 172.21.15.1:0/2015030241 learned_addr learned my addr 172.21.15.1:0/2015030241 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:37.461 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a37fe640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a4071d40 0x7f65a40adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a3fff640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a406abe0 0x7f65a4160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a8edb640 1 -- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a406abe0 msgr2=0x7f65a4160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a8edb640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a406abe0 0x7f65a4160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a8edb640 1 -- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a4071d40 msgr2=0x7f65a40adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.458+0000 7f65a8edb640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a4071d40 0x7f65a40adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65a8edb640 1 -- 172.21.15.1:0/2015030241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594009400 con 0x7f65a41465d0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65a3fff640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a406abe0 0x7f65a4160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65a8edb640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a41465d0 0x7f65a413d0f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c7e0 tx=0x7f659c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2015030241 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00a640 con 0x7f65a41465d0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2015030241 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00a7c0 con 0x7f65a41465d0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a40ad0d0 con 0x7f65a41465d0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2015030241 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00ab70 con 0x7f65a41465d0 2023-12-02T01:30:37.462 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.459+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a40ad690 con 0x7f65a41465d0 2023-12-02T01:30:37.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.460+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a40ad880 con 0x7f65a41465d0 2023-12-02T01:30:37.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.460+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2015030241 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f659c00acd0 con 0x7f65a41465d0 2023-12-02T01:30:37.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.461+0000 7f65a0ff9640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.461+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2015030241 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f659c088b60 con 0x7f65a41465d0 2023-12-02T01:30:37.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.461+0000 7f65a3fff640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.464 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.461+0000 7f65a3fff640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f65a40ae6b0 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.466 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.465+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2015030241 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f659c053f60 con 0x7f65a41465d0 2023-12-02T01:30:37.709 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.708+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f65a406e6a0 con 0x7f65a41465d0 2023-12-02T01:30:37.711 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.709+0000 7f65a0ff9640 1 -- 172.21.15.1:0/2015030241 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f659c018020 con 0x7f65a41465d0 2023-12-02T01:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 msgr2=0x7f659006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f65a40ae6b0 tx=0x7f6598008040 comp rx=0 tx=0).stop 2023-12-02T01:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a41465d0 msgr2=0x7f65a413d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a41465d0 0x7f65a413d0f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c7e0 tx=0x7f659c00cca0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 shutdown_connections 2023-12-02T01:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65a41465d0 0x7f65a413d0f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f659006ae40 0x7f659006d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65a4071d40 0x7f65a40adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 --2- 172.21.15.1:0/2015030241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f65a406abe0 0x7f65a4160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 >> 172.21.15.1:0/2015030241 conn(0x7f65a40cc930 msgr2=0x7f65a40b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.711+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 shutdown_connections 2023-12-02T01:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.712+0000 7f65aa93e640 1 -- 172.21.15.1:0/2015030241 wait complete. 2023-12-02T01:30:37.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:37.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.829+0000 7f2ba5017640 1 Processor -- start 2023-12-02T01:30:37.830 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.829+0000 7f2ba5017640 1 -- start start 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.829+0000 7f2ba5017640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ba015e820 0x7f2ba0099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.829+0000 7f2ba5017640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba00cf730 0x7f2ba00cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.829+0000 7f2ba5017640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00cb830 con 0x7f2ba0099eb0 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.829+0000 7f2ba5017640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00cc390 con 0x7f2ba015e820 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.829+0000 7f2ba5017640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00cba60 con 0x7f2ba00cf730 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9f59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba00cf730 0x7f2ba00cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ba015e820 0x7f2ba0099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ba015e820 0x7f2ba0099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:59400/0 (socket says 172.21.15.1:59400) 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9f59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba00cf730 0x7f2ba00cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:48284/0 (socket says 172.21.15.1:48284) 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9ed9d640 1 -- 172.21.15.1:0/2790724901 learned_addr learned my addr 172.21.15.1:0/2790724901 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9e59c640 1 --1- 172.21.15.1:0/2790724901 >> v1:172.21.15.167:6789/0 conn(0x7f2ba0099eb0 0x7f2ba00cf020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:54034/0 (socket says 172.21.15.1:54034) 2023-12-02T01:30:37.832 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9ed9d640 1 -- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba00cf730 msgr2=0x7f2ba00cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9ed9d640 1 --2- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba00cf730 0x7f2ba00cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9ed9d640 1 -- 172.21.15.1:0/2790724901 >> v1:172.21.15.167:6789/0 conn(0x7f2ba0099eb0 legacy=0x7f2ba00cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9ed9d640 1 -- 172.21.15.1:0/2790724901 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba009a310 con 0x7f2ba015e820 2023-12-02T01:30:37.833 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.830+0000 7f2b9f59e640 1 --2- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba00cf730 0x7f2ba00cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.831+0000 7f2b9ed9d640 1 --2- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba0099970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009870 tx=0x7f2b9802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44deac1a5a705ac1 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.831+0000 7f2b9dd9b640 1 -- 172.21.15.1:0/2790724901 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98031640 con 0x7f2ba015e820 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.831+0000 7f2b9dd9b640 1 -- 172.21.15.1:0/2790724901 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980317a0 con 0x7f2ba015e820 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.831+0000 7f2b9dd9b640 1 -- 172.21.15.1:0/2790724901 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98031b30 con 0x7f2ba015e820 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 -- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 msgr2=0x7f2ba0099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 --2- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba0099970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009870 tx=0x7f2b9802b8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 -- 172.21.15.1:0/2790724901 shutdown_connections 2023-12-02T01:30:37.834 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 --2- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba00cf730 0x7f2ba00cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 --2- 172.21.15.1:0/2790724901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba0099970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 -- 172.21.15.1:0/2790724901 >> 172.21.15.1:0/2790724901 conn(0x7f2ba00d0f20 msgr2=0x7f2ba00d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 -- 172.21.15.1:0/2790724901 shutdown_connections 2023-12-02T01:30:37.835 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.832+0000 7f2ba5017640 1 -- 172.21.15.1:0/2790724901 wait complete. 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.833+0000 7f2ba5017640 1 Processor -- start 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.833+0000 7f2ba5017640 1 -- start start 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2ba5017640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba0099eb0 0x7f2ba015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2ba5017640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00cf730 0x7f2ba015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2ba5017640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2ba5017640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00ca380 con 0x7f2ba00cf730 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2ba5017640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba015aac0 con 0x7f2ba015e820 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2ba5017640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00caec0 con 0x7f2ba0099eb0 2023-12-02T01:30:37.837 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2b9e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00cf730 0x7f2ba015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2b9e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00cf730 0x7f2ba015a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38004/0 (socket says 172.21.15.1:38004) 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.834+0000 7f2b9e59c640 1 -- 172.21.15.1:0/857560445 learned_addr learned my addr 172.21.15.1:0/857560445 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9f59e640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9ed9d640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba0099eb0 0x7f2ba015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9e59c640 1 -- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba0099eb0 msgr2=0x7f2ba015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9e59c640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba0099eb0 0x7f2ba015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9e59c640 1 -- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 msgr2=0x7f2ba015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9e59c640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba015a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9e59c640 1 -- 172.21.15.1:0/857560445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009a70 con 0x7f2ba00cf730 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9f59e640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b9e59c640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00cf730 0x7f2ba015a040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c410 tx=0x7f2b8800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.838 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b977fe640 1 -- 172.21.15.1:0/857560445 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880074e0 con 0x7f2ba00cf730 2023-12-02T01:30:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b977fe640 1 -- 172.21.15.1:0/857560445 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88007640 con 0x7f2ba00cf730 2023-12-02T01:30:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b980094d0 con 0x7f2ba00cf730 2023-12-02T01:30:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2b977fe640 1 -- 172.21.15.1:0/857560445 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880049e0 con 0x7f2ba00cf730 2023-12-02T01:30:37.839 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.835+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00ca870 con 0x7f2ba00cf730 2023-12-02T01:30:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.836+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba0067420 con 0x7f2ba00cf730 2023-12-02T01:30:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.837+0000 7f2b977fe640 1 -- 172.21.15.1:0/857560445 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b88004b40 con 0x7f2ba00cf730 2023-12-02T01:30:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.837+0000 7f2b977fe640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b8006ae40 0x7f2b8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.837+0000 7f2b977fe640 1 -- 172.21.15.1:0/857560445 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b88088c60 con 0x7f2ba00cf730 2023-12-02T01:30:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.837+0000 7f2b9ed9d640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b8006ae40 0x7f2b8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:37.840 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.838+0000 7f2b9ed9d640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b8006ae40 0x7f2b8006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b98036000 tx=0x7f2b9803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:37.843 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:37.841+0000 7f2b977fe640 1 -- 172.21.15.1:0/857560445 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b88054060 con 0x7f2ba00cf730 2023-12-02T01:30:38.019 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.018+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba00cb000 con 0x7f2ba00cf730 2023-12-02T01:30:38.020 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.019+0000 7f2b977fe640 1 -- 172.21.15.1:0/857560445 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f2b88057680 con 0x7f2ba00cf730 2023-12-02T01:30:38.020 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:38.020 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":29,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:35.057044+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:38.022 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b8006ae40 msgr2=0x7f2b8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b8006ae40 0x7f2b8006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b98036000 tx=0x7f2b9803c040 comp rx=0 tx=0).stop 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00cf730 msgr2=0x7f2ba015a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00cf730 0x7f2ba015a040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c410 tx=0x7f2b8800c8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 shutdown_connections 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f2b8006ae40 0x7f2b8006d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ba015e820 0x7f2ba015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ba00cf730 0x7f2ba015a040 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 --2- 172.21.15.1:0/857560445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ba0099eb0 0x7f2ba015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 >> 172.21.15.1:0/857560445 conn(0x7f2ba00d0f20 msgr2=0x7f2ba00af160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 shutdown_connections 2023-12-02T01:30:38.023 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.021+0000 7f2ba5017640 1 -- 172.21.15.1:0/857560445 wait complete. 2023-12-02T01:30:38.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-02T01:29:32.688456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-02T01:30:38.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-02T01:30:38.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.141+0000 7f88bf505640 1 Processor -- start 2023-12-02T01:30:38.143 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.141+0000 7f88bf505640 1 -- start start 2023-12-02T01:30:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bf505640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f88b8160b70 0x7f88b80d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bf505640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f88b80b2aa0 0x7f88b80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.144 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bf505640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b80cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bf505640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b80ce360 con 0x7f88b8160b70 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bf505640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b80b2f20 con 0x7f88b80b2aa0 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bf505640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80cdd50 con 0x7f88b80ced30 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bd2a1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f88b8160b70 0x7f88b80d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bd2a1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f88b8160b70 0x7f88b80d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38014/0 (socket says 172.21.15.1:38014) 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bd2a1640 1 -- 172.21.15.1:0/220519007 learned_addr learned my addr 172.21.15.1:0/220519007 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.142+0000 7f88bcaa0640 1 --2- 172.21.15.1:0/220519007 >> v2:172.21.15.167:3300/0 conn(0x7f88b80b2aa0 0x7f88b80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bdaa2640 1 --2- 172.21.15.1:0/220519007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b80cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bd2a1640 1 -- 172.21.15.1:0/220519007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 msgr2=0x7f88b80cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bd2a1640 1 --2- 172.21.15.1:0/220519007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b80cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bd2a1640 1 -- 172.21.15.1:0/220519007 >> v2:172.21.15.167:3300/0 conn(0x7f88b80b2aa0 msgr2=0x7f88b80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bd2a1640 1 --2- 172.21.15.1:0/220519007 >> v2:172.21.15.167:3300/0 conn(0x7f88b80b2aa0 0x7f88b80ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bd2a1640 1 -- 172.21.15.1:0/220519007 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80d1c70 con 0x7f88b8160b70 2023-12-02T01:30:38.145 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bdaa2640 1 --2- 172.21.15.1:0/220519007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b80cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.143+0000 7f88bd2a1640 1 --2- 172.21.15.1:0/220519007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b8160b70 0x7f88b80d1570 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f88b80d2e30 tx=0x7f88a802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a4a9971862ab25 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88b7fff640 1 -- 172.21.15.1:0/220519007 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a802ca70 con 0x7f88b8160b70 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88b7fff640 1 -- 172.21.15.1:0/220519007 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a802cbd0 con 0x7f88b8160b70 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88b7fff640 1 -- 172.21.15.1:0/220519007 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80343f0 con 0x7f88b8160b70 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 -- 172.21.15.1:0/220519007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b8160b70 msgr2=0x7f88b80d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 --2- 172.21.15.1:0/220519007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b8160b70 0x7f88b80d1570 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f88b80d2e30 tx=0x7f88a802bed0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 -- 172.21.15.1:0/220519007 shutdown_connections 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 --2- 172.21.15.1:0/220519007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b80cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 --2- 172.21.15.1:0/220519007 >> v2:172.21.15.167:3300/0 conn(0x7f88b80b2aa0 0x7f88b80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 --2- 172.21.15.1:0/220519007 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b8160b70 0x7f88b80d1570 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 -- 172.21.15.1:0/220519007 >> 172.21.15.1:0/220519007 conn(0x7f88b809c470 msgr2=0x7f88b80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 -- 172.21.15.1:0/220519007 shutdown_connections 2023-12-02T01:30:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.144+0000 7f88bf505640 1 -- 172.21.15.1:0/220519007 wait complete. 2023-12-02T01:30:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.145+0000 7f88bf505640 1 Processor -- start 2023-12-02T01:30:38.148 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.145+0000 7f88bf505640 1 -- start start 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bf505640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b80b2aa0 0x7f88b80cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bf505640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b81f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bf505640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88b8160b70 0x7f88b815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bf505640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8159980 con 0x7f88b80b2aa0 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bf505640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80cb260 con 0x7f88b8160b70 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bf505640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80cb540 con 0x7f88b80ced30 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bd2a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b80b2aa0 0x7f88b80cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bd2a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b80b2aa0 0x7f88b80cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38026/0 (socket says 172.21.15.1:38026) 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bd2a1640 1 -- 172.21.15.1:0/1767707924 learned_addr learned my addr 172.21.15.1:0/1767707924 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.146+0000 7f88bcaa0640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b81f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bdaa2640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88b8160b70 0x7f88b815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bd2a1640 1 -- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 msgr2=0x7f88b81f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bd2a1640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b81f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bd2a1640 1 -- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88b8160b70 msgr2=0x7f88b815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bd2a1640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88b8160b70 0x7f88b815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bd2a1640 1 -- 172.21.15.1:0/1767707924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8009b30 con 0x7f88b80b2aa0 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bcaa0640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b81f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bdaa2640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88b8160b70 0x7f88b815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bd2a1640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b80b2aa0 0x7f88b80cc5e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f88a8000f80 tx=0x7f88a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88b5ffb640 1 -- 172.21.15.1:0/1767707924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8009510 con 0x7f88b80b2aa0 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88b5ffb640 1 -- 172.21.15.1:0/1767707924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a803e450 con 0x7f88b80b2aa0 2023-12-02T01:30:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88b5ffb640 1 -- 172.21.15.1:0/1767707924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a803e800 con 0x7f88b80b2aa0 2023-12-02T01:30:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b80cb820 con 0x7f88b80b2aa0 2023-12-02T01:30:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.147+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b80cbde0 con 0x7f88b80b2aa0 2023-12-02T01:30:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.148+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b80a1150 con 0x7f88b80b2aa0 2023-12-02T01:30:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.149+0000 7f88b5ffb640 1 -- 172.21.15.1:0/1767707924 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88a803e960 con 0x7f88b80b2aa0 2023-12-02T01:30:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.149+0000 7f88b5ffb640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f88a406ae40 0x7f88a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.149+0000 7f88b5ffb640 1 -- 172.21.15.1:0/1767707924 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f88a80ac0a0 con 0x7f88b80b2aa0 2023-12-02T01:30:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.149+0000 7f88bcaa0640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f88a406ae40 0x7f88a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.149+0000 7f88bcaa0640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f88a406ae40 0x7f88a406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f88b80b4180 tx=0x7f88ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.153+0000 7f88b5ffb640 1 -- 172.21.15.1:0/1767707924 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88a8077420 con 0x7f88b80b2aa0 2023-12-02T01:30:38.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.330+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88b80cd550 con 0x7f88b80b2aa0 2023-12-02T01:30:38.332 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.330+0000 7f88b5ffb640 1 -- 172.21.15.1:0/1767707924 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88a807aa40 con 0x7f88b80b2aa0 2023-12-02T01:30:38.332 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2023-12-02T01:30:38.334 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.332+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f88a406ae40 msgr2=0x7f88a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.332+0000 7f88bf505640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f88a406ae40 0x7f88a406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f88b80b4180 tx=0x7f88ac008040 comp rx=0 tx=0).stop 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b80b2aa0 msgr2=0x7f88b80cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b80b2aa0 0x7f88b80cc5e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f88a8000f80 tx=0x7f88a8004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 shutdown_connections 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f88a406ae40 0x7f88a406d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88b8160b70 0x7f88b815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88b80ced30 0x7f88b81f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 --2- 172.21.15.1:0/1767707924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88b80b2aa0 0x7f88b80cc5e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 >> 172.21.15.1:0/1767707924 conn(0x7f88b809c470 msgr2=0x7f88b80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 shutdown_connections 2023-12-02T01:30:38.335 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.333+0000 7f88bf505640 1 -- 172.21.15.1:0/1767707924 wait complete. 2023-12-02T01:30:38.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-02T01:30:38.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.449+0000 7fb5ef100640 1 Processor -- start 2023-12-02T01:30:38.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5ef100640 1 -- start start 2023-12-02T01:30:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5ef100640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5e815d3e0 0x7fb5e80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5ef100640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e80b5f90 con 0x7fb5e80ced30 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5ef100640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e80b61e0 con 0x7fb5e80d1e30 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5ef100640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e80cf170 con 0x7fb5e815d3e0 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5ece9c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb5e815d3e0 0x7fb5e80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5e7fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb5e80ced30 0x7fb5e80d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55146/0 (socket says 172.21.15.1:55146) 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.450+0000 7fb5e7fff640 1 -- 172.21.15.1:0/144178503 learned_addr learned my addr 172.21.15.1:0/144178503 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.451+0000 7fb5ece9c640 1 -- 172.21.15.1:0/144178503 >> v1:172.21.15.167:6789/0 conn(0x7fb5e80d1e30 legacy=0x7fb5e80b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.451+0000 7fb5ece9c640 1 -- 172.21.15.1:0/144178503 >> v1:172.21.15.1:6789/0 conn(0x7fb5e80ced30 legacy=0x7fb5e80d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.451+0000 7fb5ece9c640 1 -- 172.21.15.1:0/144178503 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80b64c0 con 0x7fb5e815d3e0 2023-12-02T01:30:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.451+0000 7fb5e77fe640 1 -- 172.21.15.1:0/144178503 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102638112 0 0) 0x7fb5e80b5f90 con 0x7fb5e80ced30 2023-12-02T01:30:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ece9c640 1 --2- 172.21.15.1:0/144178503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e815d3e0 0x7fb5e80ce7f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097a0 tx=0x7fb5dc02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5047e2e87de5e9a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5e77fe640 1 -- 172.21.15.1:0/144178503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc02f810 con 0x7fb5e815d3e0 2023-12-02T01:30:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5e77fe640 1 -- 172.21.15.1:0/144178503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc02f970 con 0x7fb5e815d3e0 2023-12-02T01:30:38.454 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5e77fe640 1 -- 172.21.15.1:0/144178503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc02fd00 con 0x7fb5e815d3e0 2023-12-02T01:30:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ef100640 1 -- 172.21.15.1:0/144178503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e815d3e0 msgr2=0x7fb5e80ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ef100640 1 --2- 172.21.15.1:0/144178503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e815d3e0 0x7fb5e80ce7f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097a0 tx=0x7fb5dc02b9f0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ef100640 1 -- 172.21.15.1:0/144178503 shutdown_connections 2023-12-02T01:30:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ef100640 1 --2- 172.21.15.1:0/144178503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e815d3e0 0x7fb5e80ce7f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ef100640 1 -- 172.21.15.1:0/144178503 >> 172.21.15.1:0/144178503 conn(0x7fb5e809c480 msgr2=0x7fb5e80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ef100640 1 -- 172.21.15.1:0/144178503 shutdown_connections 2023-12-02T01:30:38.455 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.452+0000 7fb5ef100640 1 -- 172.21.15.1:0/144178503 wait complete. 2023-12-02T01:30:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.453+0000 7fb5ef100640 1 Processor -- start 2023-12-02T01:30:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.454+0000 7fb5ef100640 1 -- start start 2023-12-02T01:30:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.454+0000 7fb5ef100640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e80ced30 0x7fb5e81576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.454+0000 7fb5ef100640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e80d1e30 0x7fb5e80c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.454+0000 7fb5ef100640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e815d3e0 0x7fb5e80cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.454+0000 7fb5ef100640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e81545e0 con 0x7fb5e80d1e30 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.454+0000 7fb5ef100640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80c9250 con 0x7fb5e80ced30 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.454+0000 7fb5ef100640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8156630 con 0x7fb5e815d3e0 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e80d1e30 0x7fb5e80c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e80d1e30 0x7fb5e80c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38052/0 (socket says 172.21.15.1:38052) 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5ece9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e80ced30 0x7fb5e81576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 -- 172.21.15.1:0/982059839 learned_addr learned my addr 172.21.15.1:0/982059839 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5ed69d640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e815d3e0 0x7fb5e80cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 -- 172.21.15.1:0/982059839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e815d3e0 msgr2=0x7fb5e80cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e815d3e0 0x7fb5e80cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 -- 172.21.15.1:0/982059839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e80ced30 msgr2=0x7fb5e81576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e80ced30 0x7fb5e81576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 -- 172.21.15.1:0/982059839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009400 con 0x7fb5e80d1e30 2023-12-02T01:30:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e7fff640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e80d1e30 0x7fb5e80c8d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c4d0 tx=0x7fb5d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e57fa640 1 -- 172.21.15.1:0/982059839 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40074e0 con 0x7fb5e80d1e30 2023-12-02T01:30:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e57fa640 1 -- 172.21.15.1:0/982059839 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4007640 con 0x7fb5e80d1e30 2023-12-02T01:30:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e8156910 con 0x7fb5e80d1e30 2023-12-02T01:30:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5e57fa640 1 -- 172.21.15.1:0/982059839 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4004a20 con 0x7fb5e80d1e30 2023-12-02T01:30:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.455+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e8156ed0 con 0x7fb5e80d1e30 2023-12-02T01:30:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.456+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e8067420 con 0x7fb5e80d1e30 2023-12-02T01:30:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.457+0000 7fb5e57fa640 1 -- 172.21.15.1:0/982059839 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5d4004b80 con 0x7fb5e80d1e30 2023-12-02T01:30:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.457+0000 7fb5e57fa640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb5cc06ae40 0x7fb5cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.457+0000 7fb5e57fa640 1 -- 172.21.15.1:0/982059839 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb5d4088720 con 0x7fb5e80d1e30 2023-12-02T01:30:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.457+0000 7fb5ece9c640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb5cc06ae40 0x7fb5cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.460 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.458+0000 7fb5ece9c640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb5cc06ae40 0x7fb5cc06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc036000 tx=0x7fb5dc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.462+0000 7fb5e57fa640 1 -- 172.21.15.1:0/982059839 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb5d4053bd0 con 0x7fb5e80d1e30 2023-12-02T01:30:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.639+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb5e80d1500 con 0x7fb5e80d1e30 2023-12-02T01:30:38.641 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.639+0000 7fb5e57fa640 1 -- 172.21.15.1:0/982059839 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb5d4018090 con 0x7fb5e80d1e30 2023-12-02T01:30:38.641 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:38.642 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2023-12-02T01:30:38.642 INFO:teuthology.orchestra.run.smithi001.stdout: { 2023-12-02T01:30:38.642 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2023-12-02T01:30:38.642 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2023-12-02T01:30:38.642 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:38.642 INFO:teuthology.orchestra.run.smithi001.stdout:] 2023-12-02T01:30:38.643 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb5cc06ae40 msgr2=0x7fb5cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb5cc06ae40 0x7fb5cc06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc036000 tx=0x7fb5dc008030 comp rx=0 tx=0).stop 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e80d1e30 msgr2=0x7fb5e80c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e80d1e30 0x7fb5e80c8d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c4d0 tx=0x7fb5d400c990 comp rx=0 tx=0).stop 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 shutdown_connections 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5e815d3e0 0x7fb5e80cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5e80d1e30 0x7fb5e80c8d10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fb5cc06ae40 0x7fb5cc06d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 --2- 172.21.15.1:0/982059839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e80ced30 0x7fb5e81576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 >> 172.21.15.1:0/982059839 conn(0x7fb5e809c480 msgr2=0x7fb5e80d1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 shutdown_connections 2023-12-02T01:30:38.644 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.641+0000 7fb5ef100640 1 -- 172.21.15.1:0/982059839 wait complete. 2023-12-02T01:30:38.654 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-02T01:30:38.654 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-02T01:30:38.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.763+0000 7f30a7fff640 1 Processor -- start 2023-12-02T01:30:38.765 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.763+0000 7f30a7fff640 1 -- start start 2023-12-02T01:30:38.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a80d0b30 0x7f30a80d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a7fff640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a80d1b90 con 0x7f30a80d1730 2023-12-02T01:30:38.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a7fff640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a80ced60 con 0x7f30a815d300 2023-12-02T01:30:38.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a7fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80cf040 con 0x7f30a80d0b30 2023-12-02T01:30:38.766 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a77fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f30a80d1730 0x7f30a80b2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55152/0 (socket says 172.21.15.1:55152) 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a77fe640 1 -- 172.21.15.1:0/2573967800 learned_addr learned my addr 172.21.15.1:0/2573967800 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a67fc640 1 --2- 172.21.15.1:0/2573967800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a80d0b30 0x7f30a80d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770716174 0 0) 0x7f30a80d1b90 con 0x7f30a80d1730 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3094003520 con 0x7f30a80d1730 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61177929 0 0) 0x7f30a80ced60 con 0x7f30a815d300 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30a80d1b90 con 0x7f30a815d300 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 820446528 0 0) 0x7f3094003520 con 0x7f30a80d1730 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a67fc640 1 -- 172.21.15.1:0/2573967800 >> v1:172.21.15.167:6789/0 conn(0x7f30a815d300 legacy=0x7f30a80ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a67fc640 1 -- 172.21.15.1:0/2573967800 >> v1:172.21.15.1:6789/0 conn(0x7f30a80d1730 legacy=0x7f30a80b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.767 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.764+0000 7f30a67fc640 1 -- 172.21.15.1:0/2573967800 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a80cf320 con 0x7f30a80d0b30 2023-12-02T01:30:38.768 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.765+0000 7f30a67fc640 1 --2- 172.21.15.1:0/2573967800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a80d0b30 0x7f30a80d11f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30900097d0 tx=0x7f309002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e78489dbbeeed1d server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.765+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980019f0 con 0x7f30a80d0b30 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090031580 con 0x7f30a80d0b30 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a5ffb640 1 -- 172.21.15.1:0/2573967800 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900318f0 con 0x7f30a80d0b30 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a7fff640 1 -- 172.21.15.1:0/2573967800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a80d0b30 msgr2=0x7f30a80d11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a7fff640 1 --2- 172.21.15.1:0/2573967800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a80d0b30 0x7f30a80d11f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30900097d0 tx=0x7f309002b8a0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a7fff640 1 -- 172.21.15.1:0/2573967800 shutdown_connections 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a7fff640 1 --2- 172.21.15.1:0/2573967800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a80d0b30 0x7f30a80d11f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a7fff640 1 -- 172.21.15.1:0/2573967800 >> 172.21.15.1:0/2573967800 conn(0x7f30a809c300 msgr2=0x7f30a80d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a7fff640 1 -- 172.21.15.1:0/2573967800 shutdown_connections 2023-12-02T01:30:38.769 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.766+0000 7f30a7fff640 1 -- 172.21.15.1:0/2573967800 wait complete. 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 Processor -- start 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 -- start start 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a80d0b30 0x7f30a8156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a80d1730 0x7f30a8155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a815d300 0x7f30a815f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a81562f0 con 0x7f30a80d0b30 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8160260 con 0x7f30a80d1730 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a7fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8160540 con 0x7f30a815d300 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a80d0b30 0x7f30a8156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a80d0b30 0x7f30a8156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38062/0 (socket says 172.21.15.1:38062) 2023-12-02T01:30:38.772 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.768+0000 7f30a6ffd640 1 -- 172.21.15.1:0/1083536528 learned_addr learned my addr 172.21.15.1:0/1083536528 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a67fc640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a80d1730 0x7f30a8155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a77fe640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a815d300 0x7f30a815f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a6ffd640 1 -- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a815d300 msgr2=0x7f30a815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a6ffd640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a815d300 0x7f30a815f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a6ffd640 1 -- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a80d1730 msgr2=0x7f30a8155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a6ffd640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a80d1730 0x7f30a8155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a6ffd640 1 -- 172.21.15.1:0/1083536528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009400 con 0x7f30a80d0b30 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a77fe640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a815d300 0x7f30a815f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a67fc640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a80d1730 0x7f30a8155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a6ffd640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a80d0b30 0x7f30a8156450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f30a000c430 tx=0x7f30a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f309f7fe640 1 -- 172.21.15.1:0/1083536528 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00052d0 con 0x7f30a80d0b30 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f309f7fe640 1 -- 172.21.15.1:0/1083536528 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a0005450 con 0x7f30a80d0b30 2023-12-02T01:30:38.773 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f309f7fe640 1 -- 172.21.15.1:0/1083536528 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a0003830 con 0x7f30a80d0b30 2023-12-02T01:30:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a80c73b0 con 0x7f30a80d0b30 2023-12-02T01:30:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.769+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a815fee0 con 0x7f30a80d0b30 2023-12-02T01:30:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.770+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a80c7210 con 0x7f30a80d0b30 2023-12-02T01:30:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.771+0000 7f309f7fe640 1 -- 172.21.15.1:0/1083536528 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30a0003990 con 0x7f30a80d0b30 2023-12-02T01:30:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.771+0000 7f309f7fe640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f308806ae40 0x7f308806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:38.774 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.771+0000 7f309f7fe640 1 -- 172.21.15.1:0/1083536528 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f30a0088950 con 0x7f30a80d0b30 2023-12-02T01:30:38.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.771+0000 7f30a67fc640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f308806ae40 0x7f308806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:38.775 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.772+0000 7f30a67fc640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f308806ae40 0x7f308806d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3090036000 tx=0x7f309003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:38.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.775+0000 7f309f7fe640 1 -- 172.21.15.1:0/1083536528 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30a80c7210 con 0x7f30a80d0b30 2023-12-02T01:30:38.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:38.951+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f30a80c78d0 con 0x7f30a80d0b30 2023-12-02T01:30:39.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.059+0000 7f309f7fe640 1 -- 172.21.15.1:0/1083536528 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f30a80c78d0 con 0x7f30a80d0b30 2023-12-02T01:30:39.061 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2023-12-02T01:30:39.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f308806ae40 msgr2=0x7f308806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:39.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f308806ae40 0x7f308806d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3090036000 tx=0x7f309003d040 comp rx=0 tx=0).stop 2023-12-02T01:30:39.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a80d0b30 msgr2=0x7f30a8156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:39.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a80d0b30 0x7f30a8156450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f30a000c430 tx=0x7f30a000c8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 shutdown_connections 2023-12-02T01:30:39.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30a815d300 0x7f30a815f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f308806ae40 0x7f308806d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a80d1730 0x7f30a8155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.064 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 --2- 172.21.15.1:0/1083536528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a80d0b30 0x7f30a8156450 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.061+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 >> 172.21.15.1:0/1083536528 conn(0x7f30a809c300 msgr2=0x7f30a806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:39.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.062+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 shutdown_connections 2023-12-02T01:30:39.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.062+0000 7f30a7fff640 1 -- 172.21.15.1:0/1083536528 wait complete. 2023-12-02T01:30:39.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-02T01:30:39.191 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.190+0000 7fe92d048640 1 Processor -- start 2023-12-02T01:30:39.192 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.190+0000 7fe92d048640 1 -- start start 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92d048640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe92815d7b0 0x7fe9280cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92d048640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280d0050 0x7fe9280b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92d048640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280b04d0 con 0x7fe9280b0ea0 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92d048640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280d04d0 con 0x7fe92815d7b0 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92d048640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280d1e40 con 0x7fe9280d0050 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe926d9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe92815d7b0 0x7fe9280cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92759e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe9280b0ea0 0x7fe9280b1330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55164/0 (socket says 172.21.15.1:55164) 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92759e640 1 -- 172.21.15.1:0/23116782 learned_addr learned my addr 172.21.15.1:0/23116782 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe926d9d640 1 --2- 172.21.15.1:0/23116782 >> v2:172.21.15.1:3300/0 conn(0x7fe92815d7b0 0x7fe9280cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38068/0 (socket says 172.21.15.1:38068) 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe91ffff640 1 --2- 172.21.15.1:0/23116782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280d0050 0x7fe9280b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe926d9d640 1 -- 172.21.15.1:0/23116782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280d0050 msgr2=0x7fe9280b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe926d9d640 1 --2- 172.21.15.1:0/23116782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280d0050 0x7fe9280b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe926d9d640 1 -- 172.21.15.1:0/23116782 >> v1:172.21.15.1:6789/0 conn(0x7fe9280b0ea0 legacy=0x7fe9280b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe926d9d640 1 -- 172.21.15.1:0/23116782 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280afe80 con 0x7fe92815d7b0 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe92659c640 1 -- 172.21.15.1:0/23116782 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122229663 0 0) 0x7fe9280b04d0 con 0x7fe9280b0ea0 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.191+0000 7fe91ffff640 1 --2- 172.21.15.1:0/23116782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280d0050 0x7fe9280b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.192+0000 7fe926d9d640 1 --2- 172.21.15.1:0/23116782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe92815d7b0 0x7fe9280cfb10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe9180097a0 tx=0x7fe91802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3eae44fd4f83d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.192+0000 7fe92659c640 1 -- 172.21.15.1:0/23116782 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918031830 con 0x7fe92815d7b0 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.192+0000 7fe92659c640 1 -- 172.21.15.1:0/23116782 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918031990 con 0x7fe92815d7b0 2023-12-02T01:30:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.192+0000 7fe92659c640 1 -- 172.21.15.1:0/23116782 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918031d20 con 0x7fe92815d7b0 2023-12-02T01:30:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 -- 172.21.15.1:0/23116782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe92815d7b0 msgr2=0x7fe9280cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 --2- 172.21.15.1:0/23116782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe92815d7b0 0x7fe9280cfb10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe9180097a0 tx=0x7fe91802b8d0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 -- 172.21.15.1:0/23116782 shutdown_connections 2023-12-02T01:30:39.198 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 --2- 172.21.15.1:0/23116782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280d0050 0x7fe9280b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 --2- 172.21.15.1:0/23116782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe92815d7b0 0x7fe9280cfb10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 -- 172.21.15.1:0/23116782 >> 172.21.15.1:0/23116782 conn(0x7fe92809c480 msgr2=0x7fe9280d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 -- 172.21.15.1:0/23116782 shutdown_connections 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.193+0000 7fe92d048640 1 -- 172.21.15.1:0/23116782 wait complete. 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.194+0000 7fe92d048640 1 Processor -- start 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.194+0000 7fe92d048640 1 -- start start 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92d048640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280b0ea0 0x7fe9280a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92d048640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9280d0050 0x7fe9280b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92d048640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92815d7b0 0x7fe9280b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92d048640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92814c680 con 0x7fe9280d0050 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92d048640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280b87c0 con 0x7fe92815d7b0 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92d048640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280b8aa0 con 0x7fe9280b0ea0 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9280d0050 0x7fe9280b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9280d0050 0x7fe9280b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38084/0 (socket says 172.21.15.1:38084) 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 -- 172.21.15.1:0/3625710809 learned_addr learned my addr 172.21.15.1:0/3625710809 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe926d9d640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280b0ea0 0x7fe9280a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92759e640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92815d7b0 0x7fe9280b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 -- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280b0ea0 msgr2=0x7fe9280a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280b0ea0 0x7fe9280a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 -- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92815d7b0 msgr2=0x7fe9280b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92815d7b0 0x7fe9280b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 -- 172.21.15.1:0/3625710809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009400 con 0x7fe9280d0050 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe92759e640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92815d7b0 0x7fe9280b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91ffff640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9280d0050 0x7fe9280b3d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c7f0 tx=0x7fe91000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.195+0000 7fe91f7fe640 1 -- 172.21.15.1:0/3625710809 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910007a30 con 0x7fe9280d0050 2023-12-02T01:30:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.196+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9280b8d80 con 0x7fe9280d0050 2023-12-02T01:30:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.196+0000 7fe91f7fe640 1 -- 172.21.15.1:0/3625710809 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910007b90 con 0x7fe9280d0050 2023-12-02T01:30:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.196+0000 7fe91f7fe640 1 -- 172.21.15.1:0/3625710809 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000ce40 con 0x7fe9280d0050 2023-12-02T01:30:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.196+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9280b7a60 con 0x7fe9280d0050 2023-12-02T01:30:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.197+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92814c7c0 con 0x7fe9280d0050 2023-12-02T01:30:39.201 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.197+0000 7fe91f7fe640 1 -- 172.21.15.1:0/3625710809 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9100113f0 con 0x7fe9280d0050 2023-12-02T01:30:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.197+0000 7fe91f7fe640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe90806ae40 0x7fe90806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.198+0000 7fe91f7fe640 1 -- 172.21.15.1:0/3625710809 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe910089720 con 0x7fe9280d0050 2023-12-02T01:30:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.198+0000 7fe926d9d640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe90806ae40 0x7fe90806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:39.202 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.198+0000 7fe926d9d640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe90806ae40 0x7fe90806d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe918036000 tx=0x7fe918008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:39.203 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.202+0000 7fe91f7fe640 1 -- 172.21.15.1:0/3625710809 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe92814c7c0 con 0x7fe9280d0050 2023-12-02T01:30:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:39.378+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe92814c7c0 con 0x7fe9280d0050 2023-12-02T01:30:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.064+0000 7fe91f7fe640 1 -- 172.21.15.1:0/3625710809 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe92814c7c0 con 0x7fe9280d0050 2023-12-02T01:30:40.066 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2023-12-02T01:30:40.069 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.067+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe90806ae40 msgr2=0x7fe90806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:40.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.067+0000 7fe92d048640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe90806ae40 0x7fe90806d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe918036000 tx=0x7fe918008030 comp rx=0 tx=0).stop 2023-12-02T01:30:40.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.067+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9280d0050 msgr2=0x7fe9280b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:40.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.067+0000 7fe92d048640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9280d0050 0x7fe9280b3d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c7f0 tx=0x7fe91000cbf0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.070 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.068+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 shutdown_connections 2023-12-02T01:30:40.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.068+0000 7fe92d048640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fe90806ae40 0x7fe90806d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.068+0000 7fe92d048640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92815d7b0 0x7fe9280b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.068+0000 7fe92d048640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9280d0050 0x7fe9280b3d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.068+0000 7fe92d048640 1 --2- 172.21.15.1:0/3625710809 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9280b0ea0 0x7fe9280a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.071 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.068+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 >> 172.21.15.1:0/3625710809 conn(0x7fe92809c480 msgr2=0x7fe92806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:40.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.071+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 shutdown_connections 2023-12-02T01:30:40.073 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.071+0000 7fe92d048640 1 -- 172.21.15.1:0/3625710809 wait complete. 2023-12-02T01:30:40.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-02T01:30:40.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.209+0000 7f4b63539640 1 Processor -- start 2023-12-02T01:30:40.211 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.209+0000 7f4b63539640 1 -- start start 2023-12-02T01:30:40.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.210+0000 7f4b63539640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b5c0b6b50 0x7f4b5c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:40.212 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.210+0000 7f4b63539640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c06bc50 0x7f4b5c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.210+0000 7f4b63539640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c0b3590 con 0x7f4b5c099970 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.210+0000 7f4b63539640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c06b310 con 0x7f4b5c0b6b50 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.210+0000 7f4b63539640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0cd3a0 con 0x7f4b5c06bc50 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b612d5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b5c0b6b50 0x7f4b5c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b61ad6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c06bc50 0x7f4b5c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b60ad4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4b5c099970 0x7f4b5c099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:54070/0 (socket says 172.21.15.1:54070) 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b60ad4640 1 -- 172.21.15.1:0/1576029934 learned_addr learned my addr 172.21.15.1:0/1576029934 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b612d5640 1 -- 172.21.15.1:0/1576029934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c06bc50 msgr2=0x7f4b5c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:40.213 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b612d5640 1 --2- 172.21.15.1:0/1576029934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c06bc50 0x7f4b5c06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b612d5640 1 -- 172.21.15.1:0/1576029934 >> v1:172.21.15.167:6789/0 conn(0x7f4b5c099970 legacy=0x7f4b5c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b5bfff640 1 -- 172.21.15.1:0/1576029934 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739738894 0 0) 0x7f4b5c0b3590 con 0x7f4b5c099970 2023-12-02T01:30:40.214 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.211+0000 7f4b612d5640 1 -- 172.21.15.1:0/1576029934 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0b37c0 con 0x7f4b5c0b6b50 2023-12-02T01:30:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b612d5640 1 --2- 172.21.15.1:0/1576029934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0cfd40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b540097a0 tx=0x7f4b5402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbfa0aad49c0aca9 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b5bfff640 1 -- 172.21.15.1:0/1576029934 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54030610 con 0x7f4b5c0b6b50 2023-12-02T01:30:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b5bfff640 1 -- 172.21.15.1:0/1576029934 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b54030770 con 0x7f4b5c0b6b50 2023-12-02T01:30:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b5bfff640 1 -- 172.21.15.1:0/1576029934 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54030b00 con 0x7f4b5c0b6b50 2023-12-02T01:30:40.219 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b63539640 1 -- 172.21.15.1:0/1576029934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 msgr2=0x7f4b5c0cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b63539640 1 --2- 172.21.15.1:0/1576029934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0cfd40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b540097a0 tx=0x7f4b5402b960 comp rx=0 tx=0).stop 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b63539640 1 -- 172.21.15.1:0/1576029934 shutdown_connections 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b63539640 1 --2- 172.21.15.1:0/1576029934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c06bc50 0x7f4b5c06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.212+0000 7f4b63539640 1 --2- 172.21.15.1:0/1576029934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0cfd40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.213+0000 7f4b63539640 1 -- 172.21.15.1:0/1576029934 >> 172.21.15.1:0/1576029934 conn(0x7f4b5c0b2a70 msgr2=0x7f4b5c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.213+0000 7f4b63539640 1 -- 172.21.15.1:0/1576029934 shutdown_connections 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.213+0000 7f4b63539640 1 -- 172.21.15.1:0/1576029934 wait complete. 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 Processor -- start 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 -- start start 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c06bc50 0x7f4b5c0c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c099970 0x7f4b5c0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c15d600 con 0x7f4b5c06bc50 2023-12-02T01:30:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c9250 con 0x7f4b5c0b6b50 2023-12-02T01:30:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.214+0000 7f4b63539640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c9530 con 0x7f4b5c099970 2023-12-02T01:30:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c06bc50 0x7f4b5c0c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c06bc50 0x7f4b5c0c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38094/0 (socket says 172.21.15.1:38094) 2023-12-02T01:30:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 -- 172.21.15.1:0/3774048777 learned_addr learned my addr 172.21.15.1:0/3774048777 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b61ad6640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b60ad4640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c099970 0x7f4b5c0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 -- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c099970 msgr2=0x7f4b5c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c099970 0x7f4b5c0ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 -- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 msgr2=0x7f4b5c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 -- 172.21.15.1:0/3774048777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b54009400 con 0x7f4b5c06bc50 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b61ad6640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b612d5640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c06bc50 0x7f4b5c0c9bd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4b540098c0 tx=0x7f4b540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b59ffb640 1 -- 172.21.15.1:0/3774048777 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5403e070 con 0x7f4b5c06bc50 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b59ffb640 1 -- 172.21.15.1:0/3774048777 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b54030e10 con 0x7f4b5c06bc50 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b59ffb640 1 -- 172.21.15.1:0/3774048777 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54039c30 con 0x7f4b5c06bc50 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.215+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c0c9810 con 0x7f4b5c06bc50 2023-12-02T01:30:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.216+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c159e10 con 0x7f4b5c06bc50 2023-12-02T01:30:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.217+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c0c7ea0 con 0x7f4b5c06bc50 2023-12-02T01:30:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.217+0000 7f4b59ffb640 1 -- 172.21.15.1:0/3774048777 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b5404b400 con 0x7f4b5c06bc50 2023-12-02T01:30:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.218+0000 7f4b59ffb640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4b4806ae40 0x7f4b4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.218+0000 7f4b59ffb640 1 -- 172.21.15.1:0/3774048777 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4b540ab780 con 0x7f4b5c06bc50 2023-12-02T01:30:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.218+0000 7f4b60ad4640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4b4806ae40 0x7f4b4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.218+0000 7f4b60ad4640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4b4806ae40 0x7f4b4806d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0d09e0 tx=0x7f4b50007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.222+0000 7f4b59ffb640 1 -- 172.21.15.1:0/3774048777 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b54076930 con 0x7f4b5c06bc50 2023-12-02T01:30:40.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:40.438+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4b5c0cbe50 con 0x7f4b5c06bc50 2023-12-02T01:30:41.297 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.295+0000 7f4b59ffb640 1 -- 172.21.15.1:0/3774048777 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4b5c0cbe50 con 0x7f4b5c06bc50 2023-12-02T01:30:41.297 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 4 and data pool 5 2023-12-02T01:30:41.300 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4b4806ae40 msgr2=0x7f4b4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4b4806ae40 0x7f4b4806d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0d09e0 tx=0x7f4b50007d50 comp rx=0 tx=0).stop 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c06bc50 msgr2=0x7f4b5c0c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c06bc50 0x7f4b5c0c9bd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4b540098c0 tx=0x7f4b540046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 shutdown_connections 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f4b4806ae40 0x7f4b4806d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0b6b50 0x7f4b5c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5c099970 0x7f4b5c0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 --2- 172.21.15.1:0/3774048777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c06bc50 0x7f4b5c0c9bd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.299+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 >> 172.21.15.1:0/3774048777 conn(0x7f4b5c0b2a70 msgr2=0x7f4b5c06fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:41.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.300+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 shutdown_connections 2023-12-02T01:30:41.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.300+0000 7f4b63539640 1 -- 172.21.15.1:0/3774048777 wait complete. 2023-12-02T01:30:41.319 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.429+0000 7f687a96f640 1 Processor -- start 2023-12-02T01:30:41.431 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.429+0000 7f687a96f640 1 -- start start 2023-12-02T01:30:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f687a96f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6874099970 0x7f6874099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f687a96f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f687409a530 0x7f68740cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f687a96f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68740d0070 con 0x7f68740cf890 2023-12-02T01:30:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f687a96f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68740cbb50 con 0x7f6874099970 2023-12-02T01:30:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f687a96f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687409a290 con 0x7f687409a530 2023-12-02T01:30:41.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f6873fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6874099970 0x7f6874099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f6873fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6874099970 0x7f6874099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38104/0 (socket says 172.21.15.1:38104) 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f6873fff640 1 -- 172.21.15.1:0/634479616 learned_addr learned my addr 172.21.15.1:0/634479616 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f6873fff640 1 -- 172.21.15.1:0/634479616 >> v2:172.21.15.167:3300/0 conn(0x7f687409a530 msgr2=0x7f68740cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f68737fe640 1 --2- 172.21.15.1:0/634479616 >> v2:172.21.15.167:3300/0 conn(0x7f687409a530 0x7f68740cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f6873fff640 1 --2- 172.21.15.1:0/634479616 >> v2:172.21.15.167:3300/0 conn(0x7f687409a530 0x7f68740cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f6873fff640 1 -- 172.21.15.1:0/634479616 >> v1:172.21.15.167:6789/0 conn(0x7f68740cf890 legacy=0x7f68740b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f6873fff640 1 -- 172.21.15.1:0/634479616 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740cfd90 con 0x7f6874099970 2023-12-02T01:30:41.433 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.430+0000 7f68737fe640 1 --2- 172.21.15.1:0/634479616 >> v2:172.21.15.167:3300/0 conn(0x7f687409a530 0x7f68740cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:41.434 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.431+0000 7f6873fff640 1 --2- 172.21.15.1:0/634479616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f6874099d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6874160110 tx=0x7f686802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a46b83c28f0ede server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.431+0000 7f6872ffd640 1 -- 172.21.15.1:0/634479616 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868031870 con 0x7f6874099970 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.431+0000 7f6872ffd640 1 -- 172.21.15.1:0/634479616 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680319d0 con 0x7f6874099970 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.431+0000 7f6872ffd640 1 -- 172.21.15.1:0/634479616 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868031d60 con 0x7f6874099970 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 -- 172.21.15.1:0/634479616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 msgr2=0x7f6874099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 --2- 172.21.15.1:0/634479616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f6874099d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6874160110 tx=0x7f686802b910 comp rx=0 tx=0).stop 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 -- 172.21.15.1:0/634479616 shutdown_connections 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 --2- 172.21.15.1:0/634479616 >> v2:172.21.15.167:3300/0 conn(0x7f687409a530 0x7f68740cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 --2- 172.21.15.1:0/634479616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f6874099d50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 -- 172.21.15.1:0/634479616 >> 172.21.15.1:0/634479616 conn(0x7f68740b2a70 msgr2=0x7f68740b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 -- 172.21.15.1:0/634479616 shutdown_connections 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.432+0000 7f687a96f640 1 -- 172.21.15.1:0/634479616 wait complete. 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.433+0000 7f687a96f640 1 Processor -- start 2023-12-02T01:30:41.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.433+0000 7f687a96f640 1 -- start start 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f687a96f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f687414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f687a96f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f687409a530 0x7f68740c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f687a96f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740cf890 0x7f68740b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f687a96f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68740b4940 con 0x7f6874099970 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f687a96f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68740b4c20 con 0x7f68740cf890 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f687a96f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740b4f00 con 0x7f687409a530 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f6873fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f687414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f6873fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f687414a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38110/0 (socket says 172.21.15.1:38110) 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f6873fff640 1 -- 172.21.15.1:0/3974974565 learned_addr learned my addr 172.21.15.1:0/3974974565 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f6878f0c640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740cf890 0x7f68740b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.434+0000 7f68737fe640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f687409a530 0x7f68740c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6873fff640 1 -- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f687409a530 msgr2=0x7f68740c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6873fff640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f687409a530 0x7f68740c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6873fff640 1 -- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740cf890 msgr2=0x7f68740b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6873fff640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740cf890 0x7f68740b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6873fff640 1 -- 172.21.15.1:0/3974974565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680094d0 con 0x7f6874099970 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6878f0c640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740cf890 0x7f68740b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6873fff640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f687414a280 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6868000c00 tx=0x7f68680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6870ff9640 1 -- 172.21.15.1:0/3974974565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868031840 con 0x7f6874099970 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6870ff9640 1 -- 172.21.15.1:0/3974974565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680443f0 con 0x7f6874099970 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68740b51e0 con 0x7f6874099970 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f6870ff9640 1 -- 172.21.15.1:0/3974974565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68680447a0 con 0x7f6874099970 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.435+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687414a7c0 con 0x7f6874099970 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.436+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68740b5700 con 0x7f6874099970 2023-12-02T01:30:41.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.436+0000 7f6870ff9640 1 -- 172.21.15.1:0/3974974565 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f686804d450 con 0x7f6874099970 2023-12-02T01:30:41.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.437+0000 7f6870ff9640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f686006ae40 0x7f686006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.437+0000 7f6870ff9640 1 -- 172.21.15.1:0/3974974565 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f686802d040 con 0x7f6874099970 2023-12-02T01:30:41.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.437+0000 7f68737fe640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f686006ae40 0x7f686006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.437+0000 7f68737fe640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f686006ae40 0x7f686006d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f68740685d0 tx=0x7f6864008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:41.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.441+0000 7f6870ff9640 1 -- 172.21.15.1:0/3974974565 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68740b5700 con 0x7f6874099970 2023-12-02T01:30:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.618+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68740d0070 con 0x7f6874099970 2023-12-02T01:30:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.619+0000 7f6870ff9640 1 -- 172.21.15.1:0/3974974565 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f68740d0070 con 0x7f6874099970 2023-12-02T01:30:41.621 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":32,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:40.439388+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:30:38.982860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-02T01:30:39.409109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f686006ae40 msgr2=0x7f686006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f686006ae40 0x7f686006d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f68740685d0 tx=0x7f6864008040 comp rx=0 tx=0).stop 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 msgr2=0x7f687414a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f687414a280 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6868000c00 tx=0x7f68680046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 shutdown_connections 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f686006ae40 0x7f686006d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68740cf890 0x7f68740b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f687409a530 0x7f68740c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 --2- 172.21.15.1:0/3974974565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874099970 0x7f687414a280 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 >> 172.21.15.1:0/3974974565 conn(0x7f68740b2a70 msgr2=0x7f68740afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 shutdown_connections 2023-12-02T01:30:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.621+0000 7f687a96f640 1 -- 172.21.15.1:0/3974974565 wait complete. 2023-12-02T01:30:41.634 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:41.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.739+0000 7ff3aebde640 1 Processor -- start 2023-12-02T01:30:41.740 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.739+0000 7ff3aebde640 1 -- start start 2023-12-02T01:30:41.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3aebde640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff3a8142d20 0x7ff3a8071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3aebde640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a80b1df0 0x7ff3a806d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3aebde640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a80b3130 con 0x7ff3a806da60 2023-12-02T01:30:41.742 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3aebde640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a806def0 con 0x7ff3a8142d20 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3aebde640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a8143100 con 0x7ff3a80b1df0 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3ac97a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff3a8142d20 0x7ff3a8071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3ac97a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff3a8142d20 0x7ff3a8071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45038/0 (socket says 172.21.15.1:45038) 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3ac97a640 1 -- 172.21.15.1:0/40966932 learned_addr learned my addr 172.21.15.1:0/40966932 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3a7fff640 1 --2- 172.21.15.1:0/40966932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a80b1df0 0x7ff3a806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3ac97a640 1 -- 172.21.15.1:0/40966932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a80b1df0 msgr2=0x7ff3a806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3ac97a640 1 --2- 172.21.15.1:0/40966932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a80b1df0 0x7ff3a806d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3ac97a640 1 -- 172.21.15.1:0/40966932 >> v1:172.21.15.167:6789/0 conn(0x7ff3a806da60 legacy=0x7ff3a80b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3ac97a640 1 -- 172.21.15.1:0/40966932 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a80b2250 con 0x7ff3a8142d20 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.740+0000 7ff3a7fff640 1 --2- 172.21.15.1:0/40966932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a80b1df0 0x7ff3a806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.741+0000 7ff3ac97a640 1 --2- 172.21.15.1:0/40966932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a8142d20 0x7ff3a8071f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00bb10 tx=0x7ff39c02e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b5441c1041564c server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.741+0000 7ff3a77fe640 1 -- 172.21.15.1:0/40966932 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c036440 con 0x7ff3a8142d20 2023-12-02T01:30:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.741+0000 7ff3a77fe640 1 -- 172.21.15.1:0/40966932 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c0365a0 con 0x7ff3a8142d20 2023-12-02T01:30:41.744 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.741+0000 7ff3a77fe640 1 -- 172.21.15.1:0/40966932 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c036930 con 0x7ff3a8142d20 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.741+0000 7ff3aebde640 1 -- 172.21.15.1:0/40966932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a8142d20 msgr2=0x7ff3a8071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.741+0000 7ff3aebde640 1 --2- 172.21.15.1:0/40966932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a8142d20 0x7ff3a8071f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00bb10 tx=0x7ff39c02e150 comp rx=0 tx=0).stop 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.742+0000 7ff3aebde640 1 -- 172.21.15.1:0/40966932 shutdown_connections 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.742+0000 7ff3aebde640 1 --2- 172.21.15.1:0/40966932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a80b1df0 0x7ff3a806d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.742+0000 7ff3aebde640 1 --2- 172.21.15.1:0/40966932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a8142d20 0x7ff3a8071f00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.742+0000 7ff3aebde640 1 -- 172.21.15.1:0/40966932 >> 172.21.15.1:0/40966932 conn(0x7ff3a80b0af0 msgr2=0x7ff3a80b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.742+0000 7ff3aebde640 1 -- 172.21.15.1:0/40966932 shutdown_connections 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.742+0000 7ff3aebde640 1 -- 172.21.15.1:0/40966932 wait complete. 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.743+0000 7ff3aebde640 1 Processor -- start 2023-12-02T01:30:41.745 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.743+0000 7ff3aebde640 1 -- start start 2023-12-02T01:30:41.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3aebde640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a806da60 0x7ff3a815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.747 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3aebde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a80b1df0 0x7ff3a80aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3aebde640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a8142d20 0x7ff3a813d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3aebde640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815aba0 con 0x7ff3a80b1df0 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3aebde640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815ae80 con 0x7ff3a8142d20 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3aebde640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815b160 con 0x7ff3a806da60 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a80b1df0 0x7ff3a80aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a80b1df0 0x7ff3a80aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45048/0 (socket says 172.21.15.1:45048) 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 -- 172.21.15.1:0/161437965 learned_addr learned my addr 172.21.15.1:0/161437965 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3ac97a640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a806da60 0x7ff3a815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3ad17b640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a8142d20 0x7ff3a813d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 -- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a806da60 msgr2=0x7ff3a815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a806da60 0x7ff3a815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 -- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a8142d20 msgr2=0x7ff3a813d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a8142d20 0x7ff3a813d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.748 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 -- 172.21.15.1:0/161437965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c00b770 con 0x7ff3a80b1df0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a7fff640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a80b1df0 0x7ff3a80aa620 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff39400e730 tx=0x7ff39400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a57fa640 1 -- 172.21.15.1:0/161437965 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394004230 con 0x7ff3a80b1df0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.744+0000 7ff3a57fa640 1 -- 172.21.15.1:0/161437965 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff394004390 con 0x7ff3a80b1df0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.745+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a815b440 con 0x7ff3a80b1df0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.745+0000 7ff3a57fa640 1 -- 172.21.15.1:0/161437965 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400c8f0 con 0x7ff3a80b1df0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.745+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a8159ea0 con 0x7ff3a80b1df0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.746+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a8067420 con 0x7ff3a80b1df0 2023-12-02T01:30:41.749 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.746+0000 7ff3a57fa640 1 -- 172.21.15.1:0/161437965 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff39400ca50 con 0x7ff3a80b1df0 2023-12-02T01:30:41.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.746+0000 7ff3a57fa640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff38c06ae40 0x7ff38c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:41.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.747+0000 7ff3a57fa640 1 -- 172.21.15.1:0/161437965 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff394089160 con 0x7ff3a80b1df0 2023-12-02T01:30:41.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.747+0000 7ff3ac97a640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff38c06ae40 0x7ff38c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:41.750 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.747+0000 7ff3ac97a640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff38c06ae40 0x7ff38c06d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff39c038000 tx=0x7ff39c032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:41.752 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.751+0000 7ff3a57fa640 1 -- 172.21.15.1:0/161437965 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3940542c0 con 0x7ff3a80b1df0 2023-12-02T01:30:41.931 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.930+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3a80b3560 con 0x7ff3a80b1df0 2023-12-02T01:30:41.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.931+0000 7ff3a57fa640 1 -- 172.21.15.1:0/161437965 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16534 (secure 0 0 0) 0x7ff3940578e0 con 0x7ff3a80b1df0 2023-12-02T01:30:41.932 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:41.933 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":32,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:40.439388+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:30:38.982860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-02T01:30:39.409109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:41.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.932+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff38c06ae40 msgr2=0x7ff38c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.932+0000 7ff3aebde640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff38c06ae40 0x7ff38c06d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff39c038000 tx=0x7ff39c032000 comp rx=0 tx=0).stop 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a80b1df0 msgr2=0x7ff3a80aa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a80b1df0 0x7ff3a80aa620 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff39400e730 tx=0x7ff39400ebf0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 shutdown_connections 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff38c06ae40 0x7ff38c06d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3a8142d20 0x7ff3a813d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3a80b1df0 0x7ff3a80aa620 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 --2- 172.21.15.1:0/161437965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3a806da60 0x7ff3a815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 >> 172.21.15.1:0/161437965 conn(0x7ff3a80b0af0 msgr2=0x7ff3a81432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 shutdown_connections 2023-12-02T01:30:41.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:41.933+0000 7ff3aebde640 1 -- 172.21.15.1:0/161437965 wait complete. 2023-12-02T01:30:41.945 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-02T01:30:42.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.052+0000 7febebb05640 1 Processor -- start 2023-12-02T01:30:42.054 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.052+0000 7febebb05640 1 -- start start 2023-12-02T01:30:42.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febebb05640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7febe40b6b50 0x7febe40cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febebb05640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7febe406bc50 0x7febe406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febebb05640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40b3590 con 0x7febe4099970 2023-12-02T01:30:42.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febebb05640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe406b310 con 0x7febe406bc50 2023-12-02T01:30:42.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febebb05640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40cd3a0 con 0x7febe40b6b50 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febea0a2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7febe406bc50 0x7febe406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febea0a2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7febe406bc50 0x7febe406c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45058/0 (socket says 172.21.15.1:45058) 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.053+0000 7febea0a2640 1 -- 172.21.15.1:0/2085686919 learned_addr learned my addr 172.21.15.1:0/2085686919 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.054+0000 7febe98a1640 1 --2- 172.21.15.1:0/2085686919 >> v2:172.21.15.167:3300/0 conn(0x7febe40b6b50 0x7febe40cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.054+0000 7febea0a2640 1 -- 172.21.15.1:0/2085686919 >> v2:172.21.15.167:3300/0 conn(0x7febe40b6b50 msgr2=0x7febe40cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.054+0000 7febea0a2640 1 --2- 172.21.15.1:0/2085686919 >> v2:172.21.15.167:3300/0 conn(0x7febe40b6b50 0x7febe40cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.054+0000 7febea0a2640 1 -- 172.21.15.1:0/2085686919 >> v1:172.21.15.167:6789/0 conn(0x7febe4099970 legacy=0x7febe4099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:42.056 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.054+0000 7febea0a2640 1 -- 172.21.15.1:0/2085686919 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40b37c0 con 0x7febe406bc50 2023-12-02T01:30:42.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.054+0000 7febea0a2640 1 --2- 172.21.15.1:0/2085686919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe406c100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7febe4071790 tx=0x7febd402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49e59d5bdc246ea server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:42.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febe889f640 1 -- 172.21.15.1:0/2085686919 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd402cb20 con 0x7febe406bc50 2023-12-02T01:30:42.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febe889f640 1 -- 172.21.15.1:0/2085686919 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd402cc80 con 0x7febe406bc50 2023-12-02T01:30:42.057 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febe889f640 1 -- 172.21.15.1:0/2085686919 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40343f0 con 0x7febe406bc50 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 -- 172.21.15.1:0/2085686919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 msgr2=0x7febe406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 --2- 172.21.15.1:0/2085686919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe406c100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7febe4071790 tx=0x7febd402bf80 comp rx=0 tx=0).stop 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 -- 172.21.15.1:0/2085686919 shutdown_connections 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 --2- 172.21.15.1:0/2085686919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe406c100 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 --2- 172.21.15.1:0/2085686919 >> v2:172.21.15.167:3300/0 conn(0x7febe40b6b50 0x7febe40cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 -- 172.21.15.1:0/2085686919 >> 172.21.15.1:0/2085686919 conn(0x7febe40b2a70 msgr2=0x7febe40b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 -- 172.21.15.1:0/2085686919 shutdown_connections 2023-12-02T01:30:42.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.055+0000 7febebb05640 1 -- 172.21.15.1:0/2085686919 wait complete. 2023-12-02T01:30:42.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.056+0000 7febebb05640 1 Processor -- start 2023-12-02T01:30:42.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.056+0000 7febebb05640 1 -- start start 2023-12-02T01:30:42.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febebb05640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe40ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febebb05640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febe4099970 0x7febe414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.060 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febebb05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febe40b6b50 0x7febe414f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febebb05640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe41f42a0 con 0x7febe406bc50 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febebb05640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40b1a20 con 0x7febe40b6b50 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febebb05640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40b1740 con 0x7febe4099970 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febe98a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febe98a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe40ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45070/0 (socket says 172.21.15.1:45070) 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febe98a1640 1 -- 172.21.15.1:0/2351239766 learned_addr learned my addr 172.21.15.1:0/2351239766 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febe98a1640 1 -- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febe4099970 msgr2=0x7febe414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.057+0000 7febe98a1640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febe4099970 0x7febe414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febe98a1640 1 -- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febe40b6b50 msgr2=0x7febe414f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febea0a2640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febe40b6b50 0x7febe414f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febe98a1640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febe40b6b50 0x7febe414f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febe98a1640 1 -- 172.21.15.1:0/2351239766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009b30 con 0x7febe406bc50 2023-12-02T01:30:42.061 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febea0a2640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febe40b6b50 0x7febe414f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:42.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febe98a1640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe40ca490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7febdc00d5f0 tx=0x7febdc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:42.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febe27fc640 1 -- 172.21.15.1:0/2351239766 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0125f0 con 0x7febe406bc50 2023-12-02T01:30:42.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febe27fc640 1 -- 172.21.15.1:0/2351239766 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc012750 con 0x7febe406bc50 2023-12-02T01:30:42.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe415f2f0 con 0x7febe406bc50 2023-12-02T01:30:42.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febe27fc640 1 -- 172.21.15.1:0/2351239766 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc012b00 con 0x7febe406bc50 2023-12-02T01:30:42.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.058+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe415f8b0 con 0x7febe406bc50 2023-12-02T01:30:42.062 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.059+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe415fa70 con 0x7febe406bc50 2023-12-02T01:30:42.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.059+0000 7febe27fc640 1 -- 172.21.15.1:0/2351239766 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7febdc012c60 con 0x7febe406bc50 2023-12-02T01:30:42.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.060+0000 7febe27fc640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7febd006ae40 0x7febd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.060+0000 7febe27fc640 1 -- 172.21.15.1:0/2351239766 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febdc089ae0 con 0x7febe406bc50 2023-12-02T01:30:42.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.060+0000 7febe90a0640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7febd006ae40 0x7febd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.063 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.060+0000 7febe90a0640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7febd006ae40 0x7febd006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7febe415efe0 tx=0x7febd80079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:42.065 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.064+0000 7febe27fc640 1 -- 172.21.15.1:0/2351239766 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7febdc054b90 con 0x7febe406bc50 2023-12-02T01:30:42.282 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.281+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7febe409ef40 con 0x7febe406bc50 2023-12-02T01:30:42.298 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.297+0000 7febe27fc640 1 -- 172.21.15.1:0/2351239766 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7febdc0581b0 con 0x7febe406bc50 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7febd006ae40 msgr2=0x7febd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7febd006ae40 0x7febd006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7febe415efe0 tx=0x7febd80079b0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 msgr2=0x7febe40ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe40ca490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7febdc00d5f0 tx=0x7febdc00dab0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 shutdown_connections 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7febd006ae40 0x7febd006d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7febe40b6b50 0x7febe414f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7febe4099970 0x7febe414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 --2- 172.21.15.1:0/2351239766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7febe406bc50 0x7febe40ca490 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 >> 172.21.15.1:0/2351239766 conn(0x7febe40b2a70 msgr2=0x7febe40b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 shutdown_connections 2023-12-02T01:30:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.299+0000 7febebb05640 1 -- 172.21.15.1:0/2351239766 wait complete. 2023-12-02T01:30:42.311 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-02T01:30:42.311 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-02T01:30:42.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.419+0000 7f23a6236640 1 Processor -- start 2023-12-02T01:30:42.420 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.419+0000 7f23a6236640 1 -- start start 2023-12-02T01:30:42.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.419+0000 7f23a6236640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f23a015a6b0 0x7f23a006d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.419+0000 7f23a6236640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a006d660 0x7f23a00b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.419+0000 7f23a6236640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00cebe0 con 0x7f23a00ce800 2023-12-02T01:30:42.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.419+0000 7f23a6236640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a006db10 con 0x7f23a015a6b0 2023-12-02T01:30:42.421 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.419+0000 7f23a6236640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0070da0 con 0x7f23a006d660 2023-12-02T01:30:42.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a006d660 0x7f23a00b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f23a015a6b0 0x7f23a006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f23a015a6b0 0x7f23a006d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.1:50774/0 (socket says 172.21.15.1:50774) 2023-12-02T01:30:42.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a006d660 0x7f23a00b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.1:54756/0 (socket says 172.21.15.1:54756) 2023-12-02T01:30:42.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239effd640 1 -- 172.21.15.1:0/561959008 learned_addr learned my addr 172.21.15.1:0/561959008 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:42.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f23a00ce800 0x7f23a00702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:38778/0 (socket says 172.21.15.1:38778) 2023-12-02T01:30:42.422 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239effd640 1 -- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a006d660 msgr2=0x7f23a00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:42.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239effd640 1 --2- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a006d660 0x7f23a00b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239effd640 1 -- 172.21.15.1:0/561959008 >> v1:172.21.15.167:6789/0 conn(0x7f23a00ce800 legacy=0x7f23a00702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239effd640 1 -- 172.21.15.1:0/561959008 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0071080 con 0x7f23a015a6b0 2023-12-02T01:30:42.423 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.420+0000 7f239ffff640 1 --2- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a006d660 0x7f23a00b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:42.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.421+0000 7f239effd640 1 --2- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a015a6b0 0x7f23a006d120 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2394009870 tx=0x7f239402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b3c8c6cdb5e87b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:42.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.421+0000 7f239e7fc640 1 -- 172.21.15.1:0/561959008 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394031640 con 0x7f23a015a6b0 2023-12-02T01:30:42.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.421+0000 7f239e7fc640 1 -- 172.21.15.1:0/561959008 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940317a0 con 0x7f23a015a6b0 2023-12-02T01:30:42.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.421+0000 7f239e7fc640 1 -- 172.21.15.1:0/561959008 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394031b30 con 0x7f23a015a6b0 2023-12-02T01:30:42.424 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 -- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a015a6b0 msgr2=0x7f23a006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 --2- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a015a6b0 0x7f23a006d120 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2394009870 tx=0x7f239402b8f0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 -- 172.21.15.1:0/561959008 shutdown_connections 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 --2- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a006d660 0x7f23a00b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 --2- 172.21.15.1:0/561959008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a015a6b0 0x7f23a006d120 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 -- 172.21.15.1:0/561959008 >> 172.21.15.1:0/561959008 conn(0x7f23a006a8f0 msgr2=0x7f23a006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 -- 172.21.15.1:0/561959008 shutdown_connections 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.422+0000 7f23a6236640 1 -- 172.21.15.1:0/561959008 wait complete. 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.423+0000 7f23a6236640 1 Processor -- start 2023-12-02T01:30:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.423+0000 7f23a6236640 1 -- start start 2023-12-02T01:30:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f23a6236640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23a006d660 0x7f23a014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f23a6236640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a00ce800 0x7f23a00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f23a6236640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a015a6b0 0x7f23a01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f23a6236640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00a9a90 con 0x7f23a006d660 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f23a6236640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a014f5d0 con 0x7f23a00ce800 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f23a6236640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00a8f10 con 0x7f23a015a6b0 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23a006d660 0x7f23a014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23a006d660 0x7f23a014f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45076/0 (socket says 172.21.15.1:45076) 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 -- 172.21.15.1:0/1598131637 learned_addr learned my addr 172.21.15.1:0/1598131637 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239effd640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a00ce800 0x7f23a00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239ffff640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a015a6b0 0x7f23a01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 -- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a015a6b0 msgr2=0x7f23a01536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a015a6b0 0x7f23a01536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 -- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a00ce800 msgr2=0x7f23a00b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a00ce800 0x7f23a00b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.424+0000 7f239f7fe640 1 -- 172.21.15.1:0/1598131637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239800ab80 con 0x7f23a006d660 2023-12-02T01:30:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.425+0000 7f239f7fe640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23a006d660 0x7f23a014f090 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f239000c4d0 tx=0x7f239000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.425+0000 7f2387fff640 1 -- 172.21.15.1:0/1598131637 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390007480 con 0x7f23a006d660 2023-12-02T01:30:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.425+0000 7f2387fff640 1 -- 172.21.15.1:0/1598131637 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23900075e0 con 0x7f23a006d660 2023-12-02T01:30:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.425+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23940094d0 con 0x7f23a006d660 2023-12-02T01:30:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.425+0000 7f2387fff640 1 -- 172.21.15.1:0/1598131637 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900049e0 con 0x7f23a006d660 2023-12-02T01:30:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.425+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00a94d0 con 0x7f23a006d660 2023-12-02T01:30:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.426+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a0159b90 con 0x7f23a006d660 2023-12-02T01:30:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.426+0000 7f2387fff640 1 -- 172.21.15.1:0/1598131637 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2390004b40 con 0x7f23a006d660 2023-12-02T01:30:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.426+0000 7f2387fff640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f238c06ae40 0x7f238c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.427+0000 7f2387fff640 1 -- 172.21.15.1:0/1598131637 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2390088640 con 0x7f23a006d660 2023-12-02T01:30:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.427+0000 7f239effd640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f238c06ae40 0x7f238c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.427+0000 7f239effd640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f238c06ae40 0x7f238c06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2394036000 tx=0x7f239403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.431+0000 7f2387fff640 1 -- 172.21.15.1:0/1598131637 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23a0159b90 con 0x7f23a006d660 2023-12-02T01:30:42.648 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:42.647+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f23a0159b70 con 0x7f23a006d660 2023-12-02T01:30:43.305 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.303+0000 7f2387fff640 1 -- 172.21.15.1:0/1598131637 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f23900180c0 con 0x7f23a006d660 2023-12-02T01:30:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f238c06ae40 msgr2=0x7f238c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f238c06ae40 0x7f238c06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2394036000 tx=0x7f239403c040 comp rx=0 tx=0).stop 2023-12-02T01:30:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23a006d660 msgr2=0x7f23a014f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23a006d660 0x7f23a014f090 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f239000c4d0 tx=0x7f239000c990 comp rx=0 tx=0).stop 2023-12-02T01:30:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 shutdown_connections 2023-12-02T01:30:43.308 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a015a6b0 0x7f23a01536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f238c06ae40 0x7f238c06d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a00ce800 0x7f23a00b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 --2- 172.21.15.1:0/1598131637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23a006d660 0x7f23a014f090 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 >> 172.21.15.1:0/1598131637 conn(0x7f23a006a8f0 msgr2=0x7f23a006ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 shutdown_connections 2023-12-02T01:30:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.306+0000 7f23a6236640 1 -- 172.21.15.1:0/1598131637 wait complete. 2023-12-02T01:30:43.321 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-02T01:30:43.321 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:30:43.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.433+0000 7f23ee44f640 1 Processor -- start 2023-12-02T01:30:43.435 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.434+0000 7f23ee44f640 1 -- start start 2023-12-02T01:30:43.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.434+0000 7f23ee44f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.434+0000 7f23ee44f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f23e80d1e30 0x7f23e80b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.434+0000 7f23ee44f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80b5f90 con 0x7f23e80ced30 2023-12-02T01:30:43.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.434+0000 7f23ee44f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80cf170 con 0x7f23e80d1e30 2023-12-02T01:30:43.437 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.434+0000 7f23ee44f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b61e0 con 0x7f23e815d3e0 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e77fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f23e80ced30 0x7f23e80d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35870/0 (socket says 172.21.15.1:35870) 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e77fe640 1 -- 172.21.15.1:0/2472962669 learned_addr learned my addr 172.21.15.1:0/2472962669 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23ec9ec640 1 --2- 172.21.15.1:0/2472962669 >> v2:172.21.15.167:3300/0 conn(0x7f23e80d1e30 0x7f23e80b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e7fff640 1 --2- 172.21.15.1:0/2472962669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e6ffd640 1 -- 172.21.15.1:0/2472962669 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064581321 0 0) 0x7f23e80b5f90 con 0x7f23e80ced30 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e6ffd640 1 -- 172.21.15.1:0/2472962669 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d0003520 con 0x7f23e80ced30 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e6ffd640 1 -- 172.21.15.1:0/2472962669 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1875053572 0 0) 0x7f23d0003520 con 0x7f23e80ced30 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e7fff640 1 -- 172.21.15.1:0/2472962669 >> v2:172.21.15.167:3300/0 conn(0x7f23e80d1e30 msgr2=0x7f23e80b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:43.438 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e7fff640 1 --2- 172.21.15.1:0/2472962669 >> v2:172.21.15.167:3300/0 conn(0x7f23e80d1e30 0x7f23e80b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e7fff640 1 -- 172.21.15.1:0/2472962669 >> v1:172.21.15.1:6789/0 conn(0x7f23e80ced30 legacy=0x7f23e80d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23e7fff640 1 -- 172.21.15.1:0/2472962669 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80b64c0 con 0x7f23e815d3e0 2023-12-02T01:30:43.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.435+0000 7f23ec9ec640 1 --2- 172.21.15.1:0/2472962669 >> v2:172.21.15.167:3300/0 conn(0x7f23e80d1e30 0x7f23e80b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-02T01:30:43.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.436+0000 7f23e7fff640 1 --2- 172.21.15.1:0/2472962669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e80ce7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097d0 tx=0x7f23dc02b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=223150cf1e9bef35 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.436+0000 7f23e6ffd640 1 -- 172.21.15.1:0/2472962669 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8001670 con 0x7f23e815d3e0 2023-12-02T01:30:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.436+0000 7f23e6ffd640 1 -- 172.21.15.1:0/2472962669 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc02e050 con 0x7f23e815d3e0 2023-12-02T01:30:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.436+0000 7f23e6ffd640 1 -- 172.21.15.1:0/2472962669 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc030710 con 0x7f23e815d3e0 2023-12-02T01:30:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 -- 172.21.15.1:0/2472962669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 msgr2=0x7f23e80ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2472962669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e80ce7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097d0 tx=0x7f23dc02b770 comp rx=0 tx=0).stop 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 -- 172.21.15.1:0/2472962669 shutdown_connections 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2472962669 >> v2:172.21.15.167:3300/0 conn(0x7f23e80d1e30 0x7f23e80b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2472962669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e80ce7f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 -- 172.21.15.1:0/2472962669 >> 172.21.15.1:0/2472962669 conn(0x7f23e809c480 msgr2=0x7f23e80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 -- 172.21.15.1:0/2472962669 shutdown_connections 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.437+0000 7f23ee44f640 1 -- 172.21.15.1:0/2472962669 wait complete. 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.438+0000 7f23ee44f640 1 Processor -- start 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.438+0000 7f23ee44f640 1 -- start start 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23ee44f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e80ced30 0x7f23e815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23ee44f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23e80d1e30 0x7f23e80b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23ee44f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e81f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23ee44f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e809fc40 con 0x7f23e80d1e30 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23ee44f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e815e610 con 0x7f23e80ced30 2023-12-02T01:30:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23ee44f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e815ef70 con 0x7f23e815d3e0 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23e77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23e80d1e30 0x7f23e80b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23e77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23e80d1e30 0x7f23e80b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45082/0 (socket says 172.21.15.1:45082) 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23e77fe640 1 -- 172.21.15.1:0/2092456034 learned_addr learned my addr 172.21.15.1:0/2092456034 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.439+0000 7f23e7fff640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e80ced30 0x7f23e815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e77fe640 1 -- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 msgr2=0x7f23e81f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23ec9ec640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e81f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e77fe640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e81f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e77fe640 1 -- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e80ced30 msgr2=0x7f23e815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e77fe640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e80ced30 0x7f23e815ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e77fe640 1 -- 172.21.15.1:0/2092456034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0009a70 con 0x7f23e80d1e30 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e7fff640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e80ced30 0x7f23e815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e77fe640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23e80d1e30 0x7f23e80b45f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c780 tx=0x7f23d800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:43.444 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e4ff9640 1 -- 172.21.15.1:0/2092456034 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8005ad0 con 0x7f23e80d1e30 2023-12-02T01:30:43.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e4ff9640 1 -- 172.21.15.1:0/2092456034 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8005c50 con 0x7f23e80d1e30 2023-12-02T01:30:43.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc009400 con 0x7f23e80d1e30 2023-12-02T01:30:43.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23e4ff9640 1 -- 172.21.15.1:0/2092456034 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8007070 con 0x7f23e80d1e30 2023-12-02T01:30:43.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.440+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e81f3ad0 con 0x7f23e80d1e30 2023-12-02T01:30:43.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.441+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e815e750 con 0x7f23e80d1e30 2023-12-02T01:30:43.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.441+0000 7f23e4ff9640 1 -- 172.21.15.1:0/2092456034 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f23d80071d0 con 0x7f23e80d1e30 2023-12-02T01:30:43.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.442+0000 7f23e4ff9640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f23d406ae40 0x7f23d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.442+0000 7f23e4ff9640 1 -- 172.21.15.1:0/2092456034 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23d8089310 con 0x7f23e80d1e30 2023-12-02T01:30:43.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.442+0000 7f23e7fff640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f23d406ae40 0x7f23d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.442+0000 7f23e7fff640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f23d406ae40 0x7f23d406d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f23dc034000 tx=0x7f23dc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:43.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.446+0000 7f23e4ff9640 1 -- 172.21.15.1:0/2092456034 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23e815e750 con 0x7f23e80d1e30 2023-12-02T01:30:43.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.656+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23e815e750 con 0x7f23e80d1e30 2023-12-02T01:30:43.658 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.657+0000 7f23e4ff9640 1 -- 172.21.15.1:0/2092456034 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f23e815e750 con 0x7f23e80d1e30 2023-12-02T01:30:43.659 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:43.659 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3640152227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3640152227},{"type":"v1","addr":"172.21.15.167:6834","nonce":3640152227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/902530140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":902530140},{"type":"v1","addr":"172.21.15.167:6835","nonce":902530140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6836/3111515180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3111515180},{"type":"v1","addr":"172.21.15.1:6836","nonce":3111515180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:30:40.439691+0000","modified":"2023-12-02T01:30:42.648664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5316":{"gid":5316,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6837/4089525820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":4089525820},{"type":"v1","addr":"172.21.15.1:6837","nonce":4089525820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-02T01:30:43.659 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2023-12-02T01:30:43.660 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f23d406ae40 msgr2=0x7f23d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f23d406ae40 0x7f23d406d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f23dc034000 tx=0x7f23dc008030 comp rx=0 tx=0).stop 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23e80d1e30 msgr2=0x7f23e80b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23e80d1e30 0x7f23e80b45f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c780 tx=0x7f23d800cc40 comp rx=0 tx=0).stop 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 shutdown_connections 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23e815d3e0 0x7f23e81f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23e80d1e30 0x7f23e80b45f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f23d406ae40 0x7f23d406d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 --2- 172.21.15.1:0/2092456034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23e80ced30 0x7f23e815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 >> 172.21.15.1:0/2092456034 conn(0x7f23e809c480 msgr2=0x7f23e806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 shutdown_connections 2023-12-02T01:30:43.661 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.659+0000 7f23ee44f640 1 -- 172.21.15.1:0/2092456034 wait complete. 2023-12-02T01:30:43.671 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-02T01:30:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.775+0000 7f8b6c22b640 1 Processor -- start 2023-12-02T01:30:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.776+0000 7f8b6c22b640 1 -- start start 2023-12-02T01:30:43.778 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.776+0000 7f8b6c22b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b6415d3e0 0x7f8b640ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.776+0000 7f8b6c22b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640ced30 0x7f8b640d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.776+0000 7f8b6c22b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8b640d1c60 0x7f8b640b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.776+0000 7f8b6c22b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640cf170 con 0x7f8b640d1c60 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.776+0000 7f8b6c22b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640d20f0 con 0x7f8b6415d3e0 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.776+0000 7f8b6c22b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640b5f90 con 0x7f8b640ced30 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8b640d1c60 0x7f8b640b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8b640d1c60 0x7f8b640b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45088/0 (socket says 172.21.15.1:45088) 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/3225193741 learned_addr learned my addr 172.21.15.1:0/3225193741 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b69fc7640 1 --2- 172.21.15.1:0/3225193741 >> v2:172.21.15.167:3300/0 conn(0x7f8b6415d3e0 0x7f8b640ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b697c6640 1 --2- 172.21.15.1:0/3225193741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640ced30 0x7f8b640d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/3225193741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640ced30 msgr2=0x7f8b640d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 --2- 172.21.15.1:0/3225193741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640ced30 0x7f8b640d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/3225193741 >> v2:172.21.15.167:3300/0 conn(0x7f8b6415d3e0 msgr2=0x7f8b640ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 --2- 172.21.15.1:0/3225193741 >> v2:172.21.15.167:3300/0 conn(0x7f8b6415d3e0 0x7f8b640ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.777+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/3225193741 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640b61e0 con 0x7f8b640d1c60 2023-12-02T01:30:43.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6a7c8640 1 --2- 172.21.15.1:0/3225193741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b640d1c60 0x7f8b640b3db0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8b64073e20 tx=0x7f8b5402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be3473ddd28b6c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:43.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b68fc5640 1 -- 172.21.15.1:0/3225193741 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5402ca70 con 0x7f8b640d1c60 2023-12-02T01:30:43.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b68fc5640 1 -- 172.21.15.1:0/3225193741 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5402cbd0 con 0x7f8b640d1c60 2023-12-02T01:30:43.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b68fc5640 1 -- 172.21.15.1:0/3225193741 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540343f0 con 0x7f8b640d1c60 2023-12-02T01:30:43.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6c22b640 1 -- 172.21.15.1:0/3225193741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b640d1c60 msgr2=0x7f8b640b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.781 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/3225193741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b640d1c60 0x7f8b640b3db0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8b64073e20 tx=0x7f8b5402bed0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6c22b640 1 -- 172.21.15.1:0/3225193741 shutdown_connections 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/3225193741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b640d1c60 0x7f8b640b3db0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/3225193741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640ced30 0x7f8b640d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/3225193741 >> v2:172.21.15.167:3300/0 conn(0x7f8b6415d3e0 0x7f8b640ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.778+0000 7f8b6c22b640 1 -- 172.21.15.1:0/3225193741 >> 172.21.15.1:0/3225193741 conn(0x7f8b6409c480 msgr2=0x7f8b640d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.779+0000 7f8b6c22b640 1 -- 172.21.15.1:0/3225193741 shutdown_connections 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.779+0000 7f8b6c22b640 1 -- 172.21.15.1:0/3225193741 wait complete. 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.780+0000 7f8b6c22b640 1 Processor -- start 2023-12-02T01:30:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.780+0000 7f8b6c22b640 1 -- start start 2023-12-02T01:30:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.780+0000 7f8b6c22b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b640ced30 0x7f8b6414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.780+0000 7f8b6c22b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640d1c60 0x7f8b6409f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6c22b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b6415d3e0 0x7f8b6409fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6c22b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6414c040 con 0x7f8b6415d3e0 2023-12-02T01:30:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6c22b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6409cdf0 con 0x7f8b640ced30 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6c22b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640ccbd0 con 0x7f8b640d1c60 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b6415d3e0 0x7f8b6409fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b6415d3e0 0x7f8b6409fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45090/0 (socket says 172.21.15.1:45090) 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/1069556391 learned_addr learned my addr 172.21.15.1:0/1069556391 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b697c6640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640d1c60 0x7f8b6409f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b69fc7640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b640ced30 0x7f8b6414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640d1c60 msgr2=0x7f8b6409f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640d1c60 0x7f8b6409f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b640ced30 msgr2=0x7f8b6414aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b640ced30 0x7f8b6414aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 -- 172.21.15.1:0/1069556391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b54009b30 con 0x7f8b6415d3e0 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6a7c8640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b6415d3e0 0x7f8b6409fba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009f40 tx=0x7f8b54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b627fc640 1 -- 172.21.15.1:0/1069556391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54009510 con 0x7f8b6415d3e0 2023-12-02T01:30:43.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b627fc640 1 -- 172.21.15.1:0/1069556391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5403e450 con 0x7f8b6415d3e0 2023-12-02T01:30:43.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6414b980 con 0x7f8b6415d3e0 2023-12-02T01:30:43.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b627fc640 1 -- 172.21.15.1:0/1069556391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5403e800 con 0x7f8b6415d3e0 2023-12-02T01:30:43.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.781+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6414b420 con 0x7f8b6415d3e0 2023-12-02T01:30:43.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.782+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6414c180 con 0x7f8b6415d3e0 2023-12-02T01:30:43.786 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.783+0000 7f8b627fc640 1 -- 172.21.15.1:0/1069556391 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b5403e960 con 0x7f8b6415d3e0 2023-12-02T01:30:43.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.783+0000 7f8b627fc640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8b5006ae70 0x7f8b5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:43.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.783+0000 7f8b69fc7640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8b5006ae70 0x7f8b5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:43.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.783+0000 7f8b627fc640 1 -- 172.21.15.1:0/1069556391 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b540ac390 con 0x7f8b6415d3e0 2023-12-02T01:30:43.787 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.784+0000 7f8b69fc7640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8b5006ae70 0x7f8b5006d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009aa0 tx=0x7f8b5c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:43.789 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.788+0000 7f8b627fc640 1 -- 172.21.15.1:0/1069556391 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b6414c180 con 0x7f8b6415d3e0 2023-12-02T01:30:43.966 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.964+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b6414c180 con 0x7f8b6415d3e0 2023-12-02T01:30:43.967 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.965+0000 7f8b627fc640 1 -- 172.21.15.1:0/1069556391 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f8b6414c180 con 0x7f8b6415d3e0 2023-12-02T01:30:43.967 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:43.967 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","created":"2023-12-02T01:29:20.459958+0000","modified":"2023-12-02T01:30:42.066996+0000","last_up_change":"2023-12-02T01:29:31.131833+0000","last_in_change":"2023-12-02T01:29:22.769280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-02T01:29:32.688456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-02T01:30:38.982860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-02T01:30:39.409109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"579b11a8-a765-4522-8785-e7054aa31871","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6801","nonce":2189085040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6803","nonce":2189085040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6807","nonce":2189085040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2189085040},{"type":"v1","addr":"172.21.15.1:6805","nonce":2189085040}]},"public_addr":"172.21.15.1:6801/2189085040","cluster_addr":"172.21.15.1:6803/2189085040","heartbeat_back_addr":"172.21.15.1:6807/2189085040","heartbeat_front_addr":"172.21.15.1:6805/2189085040","state":["exists","up"]},{"osd":1,"uuid":"2796d820-f5d7-4015-9254-d32bf43ae9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6809","nonce":211191071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6811","nonce":211191071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6815","nonce":211191071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":211191071},{"type":"v1","addr":"172.21.15.1:6813","nonce":211191071}]},"public_addr":"172.21.15.1:6809/211191071","cluster_addr":"172.21.15.1:6811/211191071","heartbeat_back_addr":"172.21.15.1:6815/211191071","heartbeat_front_addr":"172.21.15.1:6813/211191071","state":["exists","up"]},{"osd":2,"uuid":"15a325f0-2ae3-4abd-bbc4-0cee4b5c81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6823","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6825","nonce":3438149164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6827","nonce":3438149164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6831","nonce":3438149164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3438149164},{"type":"v1","addr":"172.21.15.1:6829","nonce":3438149164}]},"public_addr":"172.21.15.1:6825/3438149164","cluster_addr":"172.21.15.1:6827/3438149164","heartbeat_back_addr":"172.21.15.1:6831/3438149164","heartbeat_front_addr":"172.21.15.1:6829/3438149164","state":["exists","up"]},{"osd":3,"uuid":"8c201366-3368-4769-9be2-73a2ee2d58de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6817","nonce":1775472868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6819","nonce":1775472868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6824","nonce":1775472868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":1775472868},{"type":"v1","addr":"172.21.15.1:6821","nonce":1775472868}]},"public_addr":"172.21.15.1:6817/1775472868","cluster_addr":"172.21.15.1:6819/1775472868","heartbeat_back_addr":"172.21.15.1:6824/1775472868","heartbeat_front_addr":"172.21.15.1:6821/1775472868","state":["exists","up"]},{"osd":4,"uuid":"03b03a57-dd1a-4a06-aea4-4537357626f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6801","nonce":2232039287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6803","nonce":2232039287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6807","nonce":2232039287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2232039287},{"type":"v1","addr":"172.21.15.167:6805","nonce":2232039287}]},"public_addr":"172.21.15.167:6801/2232039287","cluster_addr":"172.21.15.167:6803/2232039287","heartbeat_back_addr":"172.21.15.167:6807/2232039287","heartbeat_front_addr":"172.21.15.167:6805/2232039287","state":["exists","up"]},{"osd":5,"uuid":"f31557e6-a9e1-49ee-9577-05533fa03859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6817","nonce":1330589342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6819","nonce":1330589342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6826","nonce":1330589342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1330589342},{"type":"v1","addr":"172.21.15.167:6822","nonce":1330589342}]},"public_addr":"172.21.15.167:6817/1330589342","cluster_addr":"172.21.15.167:6819/1330589342","heartbeat_back_addr":"172.21.15.167:6826/1330589342","heartbeat_front_addr":"172.21.15.167:6822/1330589342","state":["exists","up"]},{"osd":6,"uuid":"f9698981-b1ac-440b-8d9d-b4e9c95d52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6823","nonce":2996316137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6825","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6827","nonce":2996316137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6831","nonce":2996316137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2996316137},{"type":"v1","addr":"172.21.15.167:6829","nonce":2996316137}]},"public_addr":"172.21.15.167:6823/2996316137","cluster_addr":"172.21.15.167:6827/2996316137","heartbeat_back_addr":"172.21.15.167:6831/2996316137","heartbeat_front_addr":"172.21.15.167:6829/2996316137","state":["exists","up"]},{"osd":7,"uuid":"c0f5c73c-31bb-4072-a7c6-eae14cae214e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6809","nonce":4092232180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6811","nonce":4092232180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6815","nonce":4092232180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4092232180},{"type":"v1","addr":"172.21.15.167:6813","nonce":4092232180}]},"public_addr":"172.21.15.167:6809/4092232180","cluster_addr":"172.21.15.167:6811/4092232180","heartbeat_back_addr":"172.21.15.167:6815/4092232180","heartbeat_front_addr":"172.21.15.167:6813/4092232180","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.897096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.915127+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.989980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.982085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.880573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.921562+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.955102+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-02T01:29:27.947138+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8b5006ae70 msgr2=0x7f8b5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8b5006ae70 0x7f8b5006d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009aa0 tx=0x7f8b5c009190 comp rx=0 tx=0).stop 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b6415d3e0 msgr2=0x7f8b6409fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b6415d3e0 0x7f8b6409fba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009f40 tx=0x7f8b54004a40 comp rx=0 tx=0).stop 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 shutdown_connections 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b6415d3e0 0x7f8b6409fba0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b640d1c60 0x7f8b6409f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f8b5006ae70 0x7f8b5006d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 --2- 172.21.15.1:0/1069556391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b640ced30 0x7f8b6414aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 >> 172.21.15.1:0/1069556391 conn(0x7f8b6409c480 msgr2=0x7f8b640cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:43.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 shutdown_connections 2023-12-02T01:30:43.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:43.967+0000 7f8b6c22b640 1 -- 172.21.15.1:0/1069556391 wait complete. 2023-12-02T01:30:43.980 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-02T01:30:43.980 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-02T01:30:44.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.084+0000 7f70bb3d7640 1 Processor -- start 2023-12-02T01:30:44.086 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70bb3d7640 1 -- start start 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70bb3d7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f70b415d3e0 0x7f70b40ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70bb3d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40d1e30 0x7f70b40b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70bb3d7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b40b5f90 con 0x7f70b40ced30 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70bb3d7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40cf170 con 0x7f70b415d3e0 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70bb3d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40b61e0 con 0x7f70b40d1e30 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70b8972640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f70b40ced30 0x7f70b40d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35882/0 (socket says 172.21.15.1:35882) 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.085+0000 7f70b8972640 1 -- 172.21.15.1:0/3761469452 learned_addr learned my addr 172.21.15.1:0/3761469452 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b9173640 1 --2- 172.21.15.1:0/3761469452 >> v2:172.21.15.167:3300/0 conn(0x7f70b415d3e0 0x7f70b40ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b9974640 1 --2- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40d1e30 0x7f70b40b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b3fff640 1 -- 172.21.15.1:0/3761469452 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208014975 0 0) 0x7f70b40b5f90 con 0x7f70b40ced30 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b3fff640 1 -- 172.21.15.1:0/3761469452 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f709c003520 con 0x7f70b40ced30 2023-12-02T01:30:44.088 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b9173640 1 -- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40d1e30 msgr2=0x7f70b40b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:44.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b9173640 1 --2- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40d1e30 0x7f70b40b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b3fff640 1 -- 172.21.15.1:0/3761469452 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751801337 0 0) 0x7f709c003520 con 0x7f70b40ced30 2023-12-02T01:30:44.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b9173640 1 -- 172.21.15.1:0/3761469452 >> v1:172.21.15.1:6789/0 conn(0x7f70b40ced30 legacy=0x7f70b40d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.089 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.086+0000 7f70b9173640 1 -- 172.21.15.1:0/3761469452 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b40b64c0 con 0x7f70b415d3e0 2023-12-02T01:30:44.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70b9173640 1 --2- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b415d3e0 0x7f70b40ce7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0097a0 tx=0x7f70ac02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82f7f610be99e427 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70b3fff640 1 -- 172.21.15.1:0/3761469452 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8001670 con 0x7f70b415d3e0 2023-12-02T01:30:44.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70b3fff640 1 -- 172.21.15.1:0/3761469452 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac02e050 con 0x7f70b415d3e0 2023-12-02T01:30:44.090 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70b3fff640 1 -- 172.21.15.1:0/3761469452 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac030710 con 0x7f70b415d3e0 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b415d3e0 msgr2=0x7f70b40ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b415d3e0 0x7f70b40ce7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0097a0 tx=0x7f70ac02b790 comp rx=0 tx=0).stop 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3761469452 shutdown_connections 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40d1e30 0x7f70b40b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3761469452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b415d3e0 0x7f70b40ce7f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.087+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3761469452 >> 172.21.15.1:0/3761469452 conn(0x7f70b409c480 msgr2=0x7f70b40d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.088+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3761469452 shutdown_connections 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.088+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3761469452 wait complete. 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 Processor -- start 2023-12-02T01:30:44.091 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 -- start start 2023-12-02T01:30:44.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40ced30 0x7f70b409e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b40d1e30 0x7f70b41f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.093 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70b415d3e0 0x7f70b40a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b409f260 con 0x7f70b415d3e0 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b409f540 con 0x7f70b40d1e30 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.089+0000 7f70bb3d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b409f820 con 0x7f70b40ced30 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70b415d3e0 0x7f70b40a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70b415d3e0 0x7f70b40a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45098/0 (socket says 172.21.15.1:45098) 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 -- 172.21.15.1:0/3052083459 learned_addr learned my addr 172.21.15.1:0/3052083459 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b8972640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b40d1e30 0x7f70b41f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9173640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40ced30 0x7f70b409e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 -- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40ced30 msgr2=0x7f70b409e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40ced30 0x7f70b409e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 -- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b40d1e30 msgr2=0x7f70b41f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.094 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b40d1e30 0x7f70b41f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 -- 172.21.15.1:0/3052083459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac009400 con 0x7f70b415d3e0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b8972640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b40d1e30 0x7f70b41f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b9974640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70b415d3e0 0x7f70b40a0430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ef90 tx=0x7f70a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b1ffb640 1 -- 172.21.15.1:0/3052083459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4009ca0 con 0x7f70b415d3e0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b1ffb640 1 -- 172.21.15.1:0/3052083459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400f040 con 0x7f70b415d3e0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b409fb00 con 0x7f70b415d3e0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70b1ffb640 1 -- 172.21.15.1:0/3052083459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40146c0 con 0x7f70b415d3e0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.090+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b409ed50 con 0x7f70b415d3e0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.091+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b409f030 con 0x7f70b415d3e0 2023-12-02T01:30:44.095 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.092+0000 7f70b1ffb640 1 -- 172.21.15.1:0/3052083459 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70a4014820 con 0x7f70b415d3e0 2023-12-02T01:30:44.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.092+0000 7f70b1ffb640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f70a006ae40 0x7f70a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.093+0000 7f70b1ffb640 1 -- 172.21.15.1:0/3052083459 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a408a510 con 0x7f70b415d3e0 2023-12-02T01:30:44.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.093+0000 7f70b9173640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f70a006ae40 0x7f70a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.096 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.093+0000 7f70b9173640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f70a006ae40 0x7f70a006d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f70ac034000 tx=0x7f70ac02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.098 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.097+0000 7f70b1ffb640 1 -- 172.21.15.1:0/3052083459 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70a40555b0 con 0x7f70b415d3e0 2023-12-02T01:30:44.270 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.269+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 --> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70b40b6d60 con 0x7f70a006ae40 2023-12-02T01:30:44.278 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.277+0000 7f70b1ffb640 1 -- 172.21.15.1:0/3052083459 <== mgr.4110 v2:172.21.15.1:6832/1281506213 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289727 (secure 0 0 0) 0x7f70ac041070 con 0x7f70a006ae40 2023-12-02T01:30:44.282 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:44.283 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f70a006ae40 msgr2=0x7f70a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f70a006ae40 0x7f70a006d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f70ac034000 tx=0x7f70ac02f000 comp rx=0 tx=0).stop 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70b415d3e0 msgr2=0x7f70b40a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70b415d3e0 0x7f70b40a0430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ef90 tx=0x7f70a400c490 comp rx=0 tx=0).stop 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 shutdown_connections 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70b415d3e0 0x7f70b40a0430 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f70a006ae40 0x7f70a006d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70b40d1e30 0x7f70b41f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 --2- 172.21.15.1:0/3052083459 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70b40ced30 0x7f70b409e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.285 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 >> 172.21.15.1:0/3052083459 conn(0x7f70b409c480 msgr2=0x7f70b406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 shutdown_connections 2023-12-02T01:30:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.280+0000 7f70bb3d7640 1 -- 172.21.15.1:0/3052083459 wait complete. 2023-12-02T01:30:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-12-02T01:30:42.643604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236816,"kb_used_data":3968,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737904,"statfs":{"total":773094113280,"available":772851613696,"internally_reserved":0,"allocated":4063232,"data_stored":2290242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000625"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088859+0000","last_change":"2023-12-02T01:30:41.085034+0000","last_active":"2023-12-02T01:30:41.088859+0000","last_peered":"2023-12-02T01:30:41.088859+0000","last_clean":"2023-12-02T01:30:41.088859+0000","last_became_active":"2023-12-02T01:30:41.084765+0000","last_became_peered":"2023-12-02T01:30:41.084765+0000","last_unstale":"2023-12-02T01:30:41.088859+0000","last_undegraded":"2023-12-02T01:30:41.088859+0000","last_fullsized":"2023-12-02T01:30:41.088859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:57.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082652+0000","last_change":"2023-12-02T01:30:41.077266+0000","last_active":"2023-12-02T01:30:41.082652+0000","last_peered":"2023-12-02T01:30:41.082652+0000","last_clean":"2023-12-02T01:30:41.082652+0000","last_became_active":"2023-12-02T01:30:41.076988+0000","last_became_peered":"2023-12-02T01:30:41.076988+0000","last_unstale":"2023-12-02T01:30:41.082652+0000","last_undegraded":"2023-12-02T01:30:41.082652+0000","last_fullsized":"2023-12-02T01:30:41.082652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:04:13.587931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091727+0000","last_change":"2023-12-02T01:30:41.088931+0000","last_active":"2023-12-02T01:30:41.091727+0000","last_peered":"2023-12-02T01:30:41.091727+0000","last_clean":"2023-12-02T01:30:41.091727+0000","last_became_active":"2023-12-02T01:30:41.087818+0000","last_became_peered":"2023-12-02T01:30:41.087818+0000","last_unstale":"2023-12-02T01:30:41.091727+0000","last_undegraded":"2023-12-02T01:30:41.091727+0000","last_fullsized":"2023-12-02T01:30:41.091727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:40:13.041462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091185+0000","last_change":"2023-12-02T01:30:41.086538+0000","last_active":"2023-12-02T01:30:41.091185+0000","last_peered":"2023-12-02T01:30:41.091185+0000","last_clean":"2023-12-02T01:30:41.091185+0000","last_became_active":"2023-12-02T01:30:41.086231+0000","last_became_peered":"2023-12-02T01:30:41.086231+0000","last_unstale":"2023-12-02T01:30:41.091185+0000","last_undegraded":"2023-12-02T01:30:41.091185+0000","last_fullsized":"2023-12-02T01:30:41.091185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:20.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088648+0000","last_change":"2023-12-02T01:30:41.087437+0000","last_active":"2023-12-02T01:30:41.088648+0000","last_peered":"2023-12-02T01:30:41.088648+0000","last_clean":"2023-12-02T01:30:41.088648+0000","last_became_active":"2023-12-02T01:30:41.087164+0000","last_became_peered":"2023-12-02T01:30:41.087164+0000","last_unstale":"2023-12-02T01:30:41.088648+0000","last_undegraded":"2023-12-02T01:30:41.088648+0000","last_fullsized":"2023-12-02T01:30:41.088648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:41:31.576632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.080096+0000","last_change":"2023-12-02T01:30:41.074056+0000","last_active":"2023-12-02T01:30:41.080096+0000","last_peered":"2023-12-02T01:30:41.080096+0000","last_clean":"2023-12-02T01:30:41.080096+0000","last_became_active":"2023-12-02T01:30:41.073777+0000","last_became_peered":"2023-12-02T01:30:41.073777+0000","last_unstale":"2023-12-02T01:30:41.080096+0000","last_undegraded":"2023-12-02T01:30:41.080096+0000","last_fullsized":"2023-12-02T01:30:41.080096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:21.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092043+0000","last_change":"2023-12-02T01:30:41.087765+0000","last_active":"2023-12-02T01:30:41.092043+0000","last_peered":"2023-12-02T01:30:41.092043+0000","last_clean":"2023-12-02T01:30:41.092043+0000","last_became_active":"2023-12-02T01:30:41.087495+0000","last_became_peered":"2023-12-02T01:30:41.087495+0000","last_unstale":"2023-12-02T01:30:41.092043+0000","last_undegraded":"2023-12-02T01:30:41.092043+0000","last_fullsized":"2023-12-02T01:30:41.092043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:30:46.988222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085981+0000","last_change":"2023-12-02T01:30:41.085087+0000","last_active":"2023-12-02T01:30:41.085981+0000","last_peered":"2023-12-02T01:30:41.085981+0000","last_clean":"2023-12-02T01:30:41.085981+0000","last_became_active":"2023-12-02T01:30:41.084761+0000","last_became_peered":"2023-12-02T01:30:41.084761+0000","last_unstale":"2023-12-02T01:30:41.085981+0000","last_undegraded":"2023-12-02T01:30:41.085981+0000","last_fullsized":"2023-12-02T01:30:41.085981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:27.439097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.094564+0000","last_change":"2023-12-02T01:30:41.089291+0000","last_active":"2023-12-02T01:30:41.094564+0000","last_peered":"2023-12-02T01:30:41.094564+0000","last_clean":"2023-12-02T01:30:41.094564+0000","last_became_active":"2023-12-02T01:30:41.088927+0000","last_became_peered":"2023-12-02T01:30:41.088927+0000","last_unstale":"2023-12-02T01:30:41.094564+0000","last_undegraded":"2023-12-02T01:30:41.094564+0000","last_fullsized":"2023-12-02T01:30:41.094564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:27:52.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091564+0000","last_change":"2023-12-02T01:30:41.087213+0000","last_active":"2023-12-02T01:30:41.091564+0000","last_peered":"2023-12-02T01:30:41.091564+0000","last_clean":"2023-12-02T01:30:41.091564+0000","last_became_active":"2023-12-02T01:30:41.086920+0000","last_became_peered":"2023-12-02T01:30:41.086920+0000","last_unstale":"2023-12-02T01:30:41.091564+0000","last_undegraded":"2023-12-02T01:30:41.091564+0000","last_fullsized":"2023-12-02T01:30:41.091564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:13.705046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092093+0000","last_change":"2023-12-02T01:30:41.088027+0000","last_active":"2023-12-02T01:30:41.092093+0000","last_peered":"2023-12-02T01:30:41.092093+0000","last_clean":"2023-12-02T01:30:41.092093+0000","last_became_active":"2023-12-02T01:30:41.087752+0000","last_became_peered":"2023-12-02T01:30:41.087752+0000","last_unstale":"2023-12-02T01:30:41.092093+0000","last_undegraded":"2023-12-02T01:30:41.092093+0000","last_fullsized":"2023-12-02T01:30:41.092093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:53:22.780041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.084633+0000","last_change":"2023-12-02T01:30:41.082340+0000","last_active":"2023-12-02T01:30:41.084633+0000","last_peered":"2023-12-02T01:30:41.084633+0000","last_clean":"2023-12-02T01:30:41.084633+0000","last_became_active":"2023-12-02T01:30:41.082068+0000","last_became_peered":"2023-12-02T01:30:41.082068+0000","last_unstale":"2023-12-02T01:30:41.084633+0000","last_undegraded":"2023-12-02T01:30:41.084633+0000","last_fullsized":"2023-12-02T01:30:41.084633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:03:44.736803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088957+0000","last_change":"2023-12-02T01:30:41.087667+0000","last_active":"2023-12-02T01:30:41.088957+0000","last_peered":"2023-12-02T01:30:41.088957+0000","last_clean":"2023-12-02T01:30:41.088957+0000","last_became_active":"2023-12-02T01:30:41.087390+0000","last_became_peered":"2023-12-02T01:30:41.087390+0000","last_unstale":"2023-12-02T01:30:41.088957+0000","last_undegraded":"2023-12-02T01:30:41.088957+0000","last_fullsized":"2023-12-02T01:30:41.088957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:14:54.297553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.083241+0000","last_change":"2023-12-02T01:30:41.079560+0000","last_active":"2023-12-02T01:30:41.083241+0000","last_peered":"2023-12-02T01:30:41.083241+0000","last_clean":"2023-12-02T01:30:41.083241+0000","last_became_active":"2023-12-02T01:30:41.079295+0000","last_became_peered":"2023-12-02T01:30:41.079295+0000","last_unstale":"2023-12-02T01:30:41.083241+0000","last_undegraded":"2023-12-02T01:30:41.083241+0000","last_fullsized":"2023-12-02T01:30:41.083241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:03:44.736803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.084767+0000","last_change":"2023-12-02T01:30:41.083899+0000","last_active":"2023-12-02T01:30:41.084767+0000","last_peered":"2023-12-02T01:30:41.084767+0000","last_clean":"2023-12-02T01:30:41.084767+0000","last_became_active":"2023-12-02T01:30:41.083619+0000","last_became_peered":"2023-12-02T01:30:41.083619+0000","last_unstale":"2023-12-02T01:30:41.084767+0000","last_undegraded":"2023-12-02T01:30:41.084767+0000","last_fullsized":"2023-12-02T01:30:41.084767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:59.902186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.094574+0000","last_change":"2023-12-02T01:30:41.089550+0000","last_active":"2023-12-02T01:30:41.094574+0000","last_peered":"2023-12-02T01:30:41.094574+0000","last_clean":"2023-12-02T01:30:41.094574+0000","last_became_active":"2023-12-02T01:30:41.089286+0000","last_became_peered":"2023-12-02T01:30:41.089286+0000","last_unstale":"2023-12-02T01:30:41.094574+0000","last_undegraded":"2023-12-02T01:30:41.094574+0000","last_fullsized":"2023-12-02T01:30:41.094574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:40:13.041462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092002+0000","last_change":"2023-12-02T01:30:41.087905+0000","last_active":"2023-12-02T01:30:41.092002+0000","last_peered":"2023-12-02T01:30:41.092002+0000","last_clean":"2023-12-02T01:30:41.092002+0000","last_became_active":"2023-12-02T01:30:41.086763+0000","last_became_peered":"2023-12-02T01:30:41.086763+0000","last_unstale":"2023-12-02T01:30:41.092002+0000","last_undegraded":"2023-12-02T01:30:41.092002+0000","last_fullsized":"2023-12-02T01:30:41.092002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:47:58.973857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090348+0000","last_change":"2023-12-02T01:30:41.089229+0000","last_active":"2023-12-02T01:30:41.090348+0000","last_peered":"2023-12-02T01:30:41.090348+0000","last_clean":"2023-12-02T01:30:41.090348+0000","last_became_active":"2023-12-02T01:30:41.088945+0000","last_became_peered":"2023-12-02T01:30:41.088945+0000","last_unstale":"2023-12-02T01:30:41.090348+0000","last_undegraded":"2023-12-02T01:30:41.090348+0000","last_fullsized":"2023-12-02T01:30:41.090348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:47:58.973857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090162+0000","last_change":"2023-12-02T01:30:41.088461+0000","last_active":"2023-12-02T01:30:41.090162+0000","last_peered":"2023-12-02T01:30:41.090162+0000","last_clean":"2023-12-02T01:30:41.090162+0000","last_became_active":"2023-12-02T01:30:41.088105+0000","last_became_peered":"2023-12-02T01:30:41.088105+0000","last_unstale":"2023-12-02T01:30:41.090162+0000","last_undegraded":"2023-12-02T01:30:41.090162+0000","last_fullsized":"2023-12-02T01:30:41.090162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:44.291133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088390+0000","last_change":"2023-12-02T01:30:41.083890+0000","last_active":"2023-12-02T01:30:41.088390+0000","last_peered":"2023-12-02T01:30:41.088390+0000","last_clean":"2023-12-02T01:30:41.088390+0000","last_became_active":"2023-12-02T01:30:41.083562+0000","last_became_peered":"2023-12-02T01:30:41.083562+0000","last_unstale":"2023-12-02T01:30:41.088390+0000","last_undegraded":"2023-12-02T01:30:41.088390+0000","last_fullsized":"2023-12-02T01:30:41.088390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:07:50.919716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082821+0000","last_change":"2023-12-02T01:30:41.079580+0000","last_active":"2023-12-02T01:30:41.082821+0000","last_peered":"2023-12-02T01:30:41.082821+0000","last_clean":"2023-12-02T01:30:41.082821+0000","last_became_active":"2023-12-02T01:30:41.078594+0000","last_became_peered":"2023-12-02T01:30:41.078594+0000","last_unstale":"2023-12-02T01:30:41.082821+0000","last_undegraded":"2023-12-02T01:30:41.082821+0000","last_fullsized":"2023-12-02T01:30:41.082821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:59.902186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.083713+0000","last_change":"2023-12-02T01:30:41.081041+0000","last_active":"2023-12-02T01:30:41.083713+0000","last_peered":"2023-12-02T01:30:41.083713+0000","last_clean":"2023-12-02T01:30:41.083713+0000","last_became_active":"2023-12-02T01:30:41.080614+0000","last_became_peered":"2023-12-02T01:30:41.080614+0000","last_unstale":"2023-12-02T01:30:41.083713+0000","last_undegraded":"2023-12-02T01:30:41.083713+0000","last_fullsized":"2023-12-02T01:30:41.083713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:55.896455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085891+0000","last_change":"2023-12-02T01:30:41.084317+0000","last_active":"2023-12-02T01:30:41.085891+0000","last_peered":"2023-12-02T01:30:41.085891+0000","last_clean":"2023-12-02T01:30:41.085891+0000","last_became_active":"2023-12-02T01:30:41.084028+0000","last_became_peered":"2023-12-02T01:30:41.084028+0000","last_unstale":"2023-12-02T01:30:41.085891+0000","last_undegraded":"2023-12-02T01:30:41.085891+0000","last_fullsized":"2023-12-02T01:30:41.085891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:37.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081649+0000","last_change":"2023-12-02T01:30:41.078798+0000","last_active":"2023-12-02T01:30:41.081649+0000","last_peered":"2023-12-02T01:30:41.081649+0000","last_clean":"2023-12-02T01:30:41.081649+0000","last_became_active":"2023-12-02T01:30:41.078516+0000","last_became_peered":"2023-12-02T01:30:41.078516+0000","last_unstale":"2023-12-02T01:30:41.081649+0000","last_undegraded":"2023-12-02T01:30:41.081649+0000","last_fullsized":"2023-12-02T01:30:41.081649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:36.859534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091394+0000","last_change":"2023-12-02T01:30:41.086968+0000","last_active":"2023-12-02T01:30:41.091394+0000","last_peered":"2023-12-02T01:30:41.091394+0000","last_clean":"2023-12-02T01:30:41.091394+0000","last_became_active":"2023-12-02T01:30:41.086663+0000","last_became_peered":"2023-12-02T01:30:41.086663+0000","last_unstale":"2023-12-02T01:30:41.091394+0000","last_undegraded":"2023-12-02T01:30:41.091394+0000","last_fullsized":"2023-12-02T01:30:41.091394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:59.902186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089477+0000","last_change":"2023-12-02T01:30:41.087551+0000","last_active":"2023-12-02T01:30:41.089477+0000","last_peered":"2023-12-02T01:30:41.089477+0000","last_clean":"2023-12-02T01:30:41.089477+0000","last_became_active":"2023-12-02T01:30:41.087240+0000","last_became_peered":"2023-12-02T01:30:41.087240+0000","last_unstale":"2023-12-02T01:30:41.089477+0000","last_undegraded":"2023-12-02T01:30:41.089477+0000","last_fullsized":"2023-12-02T01:30:41.089477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:46:33.187100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091206+0000","last_change":"2023-12-02T01:30:41.086453+0000","last_active":"2023-12-02T01:30:41.091206+0000","last_peered":"2023-12-02T01:30:41.091206+0000","last_clean":"2023-12-02T01:30:41.091206+0000","last_became_active":"2023-12-02T01:30:41.085961+0000","last_became_peered":"2023-12-02T01:30:41.085961+0000","last_unstale":"2023-12-02T01:30:41.091206+0000","last_undegraded":"2023-12-02T01:30:41.091206+0000","last_fullsized":"2023-12-02T01:30:41.091206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:55.896455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081431+0000","last_change":"2023-12-02T01:30:41.077362+0000","last_active":"2023-12-02T01:30:41.081431+0000","last_peered":"2023-12-02T01:30:41.081431+0000","last_clean":"2023-12-02T01:30:41.081431+0000","last_became_active":"2023-12-02T01:30:41.076687+0000","last_became_peered":"2023-12-02T01:30:41.076687+0000","last_unstale":"2023-12-02T01:30:41.081431+0000","last_undegraded":"2023-12-02T01:30:41.081431+0000","last_fullsized":"2023-12-02T01:30:41.081431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:04:13.587931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086212+0000","last_change":"2023-12-02T01:30:41.082735+0000","last_active":"2023-12-02T01:30:41.086212+0000","last_peered":"2023-12-02T01:30:41.086212+0000","last_clean":"2023-12-02T01:30:41.086212+0000","last_became_active":"2023-12-02T01:30:41.081899+0000","last_became_peered":"2023-12-02T01:30:41.081899+0000","last_unstale":"2023-12-02T01:30:41.086212+0000","last_undegraded":"2023-12-02T01:30:41.086212+0000","last_fullsized":"2023-12-02T01:30:41.086212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:31:09.912553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089218+0000","last_change":"2023-12-02T01:30:41.085798+0000","last_active":"2023-12-02T01:30:41.089218+0000","last_peered":"2023-12-02T01:30:41.089218+0000","last_clean":"2023-12-02T01:30:41.089218+0000","last_became_active":"2023-12-02T01:30:41.085541+0000","last_became_peered":"2023-12-02T01:30:41.085541+0000","last_unstale":"2023-12-02T01:30:41.089218+0000","last_undegraded":"2023-12-02T01:30:41.089218+0000","last_fullsized":"2023-12-02T01:30:41.089218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:09.500813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082702+0000","last_change":"2023-12-02T01:30:41.080872+0000","last_active":"2023-12-02T01:30:41.082702+0000","last_peered":"2023-12-02T01:30:41.082702+0000","last_clean":"2023-12-02T01:30:41.082702+0000","last_became_active":"2023-12-02T01:30:41.080576+0000","last_became_peered":"2023-12-02T01:30:41.080576+0000","last_unstale":"2023-12-02T01:30:41.082702+0000","last_undegraded":"2023-12-02T01:30:41.082702+0000","last_fullsized":"2023-12-02T01:30:41.082702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:24:34.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091989+0000","last_change":"2023-12-02T01:30:41.087086+0000","last_active":"2023-12-02T01:30:41.091989+0000","last_peered":"2023-12-02T01:30:41.091989+0000","last_clean":"2023-12-02T01:30:41.091989+0000","last_became_active":"2023-12-02T01:30:41.086604+0000","last_became_peered":"2023-12-02T01:30:41.086604+0000","last_unstale":"2023-12-02T01:30:41.091989+0000","last_undegraded":"2023-12-02T01:30:41.091989+0000","last_fullsized":"2023-12-02T01:30:41.091989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:38.017077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086827+0000","last_change":"2023-12-02T01:30:41.085015+0000","last_active":"2023-12-02T01:30:41.086827+0000","last_peered":"2023-12-02T01:30:41.086827+0000","last_clean":"2023-12-02T01:30:41.086827+0000","last_became_active":"2023-12-02T01:30:41.084684+0000","last_became_peered":"2023-12-02T01:30:41.084684+0000","last_unstale":"2023-12-02T01:30:41.086827+0000","last_undegraded":"2023-12-02T01:30:41.086827+0000","last_fullsized":"2023-12-02T01:30:41.086827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:20.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309677+0000","last_change":"2023-12-02T01:30:40.086590+0000","last_active":"2023-12-02T01:30:41.309677+0000","last_peered":"2023-12-02T01:30:41.309677+0000","last_clean":"2023-12-02T01:30:41.309677+0000","last_became_active":"2023-12-02T01:30:40.086189+0000","last_became_peered":"2023-12-02T01:30:40.086189+0000","last_unstale":"2023-12-02T01:30:41.309677+0000","last_undegraded":"2023-12-02T01:30:41.309677+0000","last_fullsized":"2023-12-02T01:30:41.309677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:19.462353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085127+0000","last_change":"2023-12-02T01:30:41.082667+0000","last_active":"2023-12-02T01:30:41.085127+0000","last_peered":"2023-12-02T01:30:41.085127+0000","last_clean":"2023-12-02T01:30:41.085127+0000","last_became_active":"2023-12-02T01:30:41.081477+0000","last_became_peered":"2023-12-02T01:30:41.081477+0000","last_unstale":"2023-12-02T01:30:41.085127+0000","last_undegraded":"2023-12-02T01:30:41.085127+0000","last_fullsized":"2023-12-02T01:30:41.085127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:27:52.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.305260+0000","last_change":"2023-12-02T01:30:40.083305+0000","last_active":"2023-12-02T01:30:41.305260+0000","last_peered":"2023-12-02T01:30:41.305260+0000","last_clean":"2023-12-02T01:30:41.305260+0000","last_became_active":"2023-12-02T01:30:40.083016+0000","last_became_peered":"2023-12-02T01:30:40.083016+0000","last_unstale":"2023-12-02T01:30:41.305260+0000","last_undegraded":"2023-12-02T01:30:41.305260+0000","last_fullsized":"2023-12-02T01:30:41.305260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:54.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085313+0000","last_change":"2023-12-02T01:30:41.083381+0000","last_active":"2023-12-02T01:30:41.085313+0000","last_peered":"2023-12-02T01:30:41.085313+0000","last_clean":"2023-12-02T01:30:41.085313+0000","last_became_active":"2023-12-02T01:30:41.082613+0000","last_became_peered":"2023-12-02T01:30:41.082613+0000","last_unstale":"2023-12-02T01:30:41.085313+0000","last_undegraded":"2023-12-02T01:30:41.085313+0000","last_fullsized":"2023-12-02T01:30:41.085313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:26:21.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.308301+0000","last_change":"2023-12-02T01:30:40.087586+0000","last_active":"2023-12-02T01:30:41.308301+0000","last_peered":"2023-12-02T01:30:41.308301+0000","last_clean":"2023-12-02T01:30:41.308301+0000","last_became_active":"2023-12-02T01:30:40.087341+0000","last_became_peered":"2023-12-02T01:30:40.087341+0000","last_unstale":"2023-12-02T01:30:41.308301+0000","last_undegraded":"2023-12-02T01:30:41.308301+0000","last_fullsized":"2023-12-02T01:30:41.308301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:30:45.984065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090078+0000","last_change":"2023-12-02T01:30:41.086127+0000","last_active":"2023-12-02T01:30:41.090078+0000","last_peered":"2023-12-02T01:30:41.090078+0000","last_clean":"2023-12-02T01:30:41.090078+0000","last_became_active":"2023-12-02T01:30:41.085653+0000","last_became_peered":"2023-12-02T01:30:41.085653+0000","last_unstale":"2023-12-02T01:30:41.090078+0000","last_undegraded":"2023-12-02T01:30:41.090078+0000","last_fullsized":"2023-12-02T01:30:41.090078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:57.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306417+0000","last_change":"2023-12-02T01:30:40.083526+0000","last_active":"2023-12-02T01:30:41.306417+0000","last_peered":"2023-12-02T01:30:41.306417+0000","last_clean":"2023-12-02T01:30:41.306417+0000","last_became_active":"2023-12-02T01:30:40.083098+0000","last_became_peered":"2023-12-02T01:30:40.083098+0000","last_unstale":"2023-12-02T01:30:41.306417+0000","last_undegraded":"2023-12-02T01:30:41.306417+0000","last_fullsized":"2023-12-02T01:30:41.306417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:59:41.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092115+0000","last_change":"2023-12-02T01:30:41.088638+0000","last_active":"2023-12-02T01:30:41.092115+0000","last_peered":"2023-12-02T01:30:41.092115+0000","last_clean":"2023-12-02T01:30:41.092115+0000","last_became_active":"2023-12-02T01:30:41.088348+0000","last_became_peered":"2023-12-02T01:30:41.088348+0000","last_unstale":"2023-12-02T01:30:41.092115+0000","last_undegraded":"2023-12-02T01:30:41.092115+0000","last_fullsized":"2023-12-02T01:30:41.092115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:05.557203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306344+0000","last_change":"2023-12-02T01:30:40.077543+0000","last_active":"2023-12-02T01:30:41.306344+0000","last_peered":"2023-12-02T01:30:41.306344+0000","last_clean":"2023-12-02T01:30:41.306344+0000","last_became_active":"2023-12-02T01:30:40.077245+0000","last_became_peered":"2023-12-02T01:30:40.077245+0000","last_unstale":"2023-12-02T01:30:41.306344+0000","last_undegraded":"2023-12-02T01:30:41.306344+0000","last_fullsized":"2023-12-02T01:30:41.306344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081610+0000","last_change":"2023-12-02T01:30:41.077337+0000","last_active":"2023-12-02T01:30:41.081610+0000","last_peered":"2023-12-02T01:30:41.081610+0000","last_clean":"2023-12-02T01:30:41.081610+0000","last_became_active":"2023-12-02T01:30:41.077061+0000","last_became_peered":"2023-12-02T01:30:41.077061+0000","last_unstale":"2023-12-02T01:30:41.081610+0000","last_undegraded":"2023-12-02T01:30:41.081610+0000","last_fullsized":"2023-12-02T01:30:41.081610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:09.500813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306446+0000","last_change":"2023-12-02T01:30:40.077645+0000","last_active":"2023-12-02T01:30:41.306446+0000","last_peered":"2023-12-02T01:30:41.306446+0000","last_clean":"2023-12-02T01:30:41.306446+0000","last_became_active":"2023-12-02T01:30:40.077367+0000","last_became_peered":"2023-12-02T01:30:40.077367+0000","last_unstale":"2023-12-02T01:30:41.306446+0000","last_undegraded":"2023-12-02T01:30:41.306446+0000","last_fullsized":"2023-12-02T01:30:41.306446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:04.553045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092025+0000","last_change":"2023-12-02T01:30:41.086414+0000","last_active":"2023-12-02T01:30:41.092025+0000","last_peered":"2023-12-02T01:30:41.092025+0000","last_clean":"2023-12-02T01:30:41.092025+0000","last_became_active":"2023-12-02T01:30:41.086141+0000","last_became_peered":"2023-12-02T01:30:41.086141+0000","last_unstale":"2023-12-02T01:30:41.092025+0000","last_undegraded":"2023-12-02T01:30:41.092025+0000","last_fullsized":"2023-12-02T01:30:41.092025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:10:33.769076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.068841+0000","last_change":"2023-12-02T01:30:40.078775+0000","last_active":"2023-12-02T01:30:41.068841+0000","last_peered":"2023-12-02T01:30:41.068841+0000","last_clean":"2023-12-02T01:30:41.068841+0000","last_became_active":"2023-12-02T01:30:40.078496+0000","last_became_peered":"2023-12-02T01:30:40.078496+0000","last_unstale":"2023-12-02T01:30:41.068841+0000","last_undegraded":"2023-12-02T01:30:41.068841+0000","last_fullsized":"2023-12-02T01:30:41.068841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:54.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090072+0000","last_change":"2023-12-02T01:30:41.086082+0000","last_active":"2023-12-02T01:30:41.090072+0000","last_peered":"2023-12-02T01:30:41.090072+0000","last_clean":"2023-12-02T01:30:41.090072+0000","last_became_active":"2023-12-02T01:30:41.085785+0000","last_became_peered":"2023-12-02T01:30:41.085785+0000","last_unstale":"2023-12-02T01:30:41.090072+0000","last_undegraded":"2023-12-02T01:30:41.090072+0000","last_fullsized":"2023-12-02T01:30:41.090072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:31:09.912553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071943+0000","last_change":"2023-12-02T01:30:40.080238+0000","last_active":"2023-12-02T01:30:41.071943+0000","last_peered":"2023-12-02T01:30:41.071943+0000","last_clean":"2023-12-02T01:30:41.071943+0000","last_became_active":"2023-12-02T01:30:40.079869+0000","last_became_peered":"2023-12-02T01:30:40.079869+0000","last_unstale":"2023-12-02T01:30:41.071943+0000","last_undegraded":"2023-12-02T01:30:41.071943+0000","last_fullsized":"2023-12-02T01:30:41.071943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:56.535630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081363+0000","last_change":"2023-12-02T01:30:41.078422+0000","last_active":"2023-12-02T01:30:41.081363+0000","last_peered":"2023-12-02T01:30:41.081363+0000","last_clean":"2023-12-02T01:30:41.081363+0000","last_became_active":"2023-12-02T01:30:41.078164+0000","last_became_peered":"2023-12-02T01:30:41.078164+0000","last_unstale":"2023-12-02T01:30:41.081363+0000","last_undegraded":"2023-12-02T01:30:41.081363+0000","last_fullsized":"2023-12-02T01:30:41.081363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:05.557203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.069582+0000","last_change":"2023-12-02T01:30:40.082501+0000","last_active":"2023-12-02T01:30:41.069582+0000","last_peered":"2023-12-02T01:30:41.069582+0000","last_clean":"2023-12-02T01:30:41.069582+0000","last_became_active":"2023-12-02T01:30:40.082228+0000","last_became_peered":"2023-12-02T01:30:40.082228+0000","last_unstale":"2023-12-02T01:30:41.069582+0000","last_undegraded":"2023-12-02T01:30:41.069582+0000","last_fullsized":"2023-12-02T01:30:41.069582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:37.012920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090256+0000","last_change":"2023-12-02T01:30:41.089109+0000","last_active":"2023-12-02T01:30:41.090256+0000","last_peered":"2023-12-02T01:30:41.090256+0000","last_clean":"2023-12-02T01:30:41.090256+0000","last_became_active":"2023-12-02T01:30:41.088805+0000","last_became_peered":"2023-12-02T01:30:41.088805+0000","last_unstale":"2023-12-02T01:30:41.090256+0000","last_undegraded":"2023-12-02T01:30:41.090256+0000","last_fullsized":"2023-12-02T01:30:41.090256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:40:13.041462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.074380+0000","last_change":"2023-12-02T01:30:40.083872+0000","last_active":"2023-12-02T01:30:41.074380+0000","last_peered":"2023-12-02T01:30:41.074380+0000","last_clean":"2023-12-02T01:30:41.074380+0000","last_became_active":"2023-12-02T01:30:40.083583+0000","last_became_peered":"2023-12-02T01:30:40.083583+0000","last_unstale":"2023-12-02T01:30:41.074380+0000","last_undegraded":"2023-12-02T01:30:41.074380+0000","last_fullsized":"2023-12-02T01:30:41.074380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:58.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088592+0000","last_change":"2023-12-02T01:30:41.086059+0000","last_active":"2023-12-02T01:30:41.088592+0000","last_peered":"2023-12-02T01:30:41.088592+0000","last_clean":"2023-12-02T01:30:41.088592+0000","last_became_active":"2023-12-02T01:30:41.085603+0000","last_became_peered":"2023-12-02T01:30:41.085603+0000","last_unstale":"2023-12-02T01:30:41.088592+0000","last_undegraded":"2023-12-02T01:30:41.088592+0000","last_fullsized":"2023-12-02T01:30:41.088592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:05.557203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309940+0000","last_change":"2023-12-02T01:30:40.084168+0000","last_active":"2023-12-02T01:30:41.309940+0000","last_peered":"2023-12-02T01:30:41.309940+0000","last_clean":"2023-12-02T01:30:41.309940+0000","last_became_active":"2023-12-02T01:30:40.083551+0000","last_became_peered":"2023-12-02T01:30:40.083551+0000","last_unstale":"2023-12-02T01:30:41.309940+0000","last_undegraded":"2023-12-02T01:30:41.309940+0000","last_fullsized":"2023-12-02T01:30:41.309940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:30:45.984065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091692+0000","last_change":"2023-12-02T01:30:41.088175+0000","last_active":"2023-12-02T01:30:41.091692+0000","last_peered":"2023-12-02T01:30:41.091692+0000","last_clean":"2023-12-02T01:30:41.091692+0000","last_became_active":"2023-12-02T01:30:41.087897+0000","last_became_peered":"2023-12-02T01:30:41.087897+0000","last_unstale":"2023-12-02T01:30:41.091692+0000","last_undegraded":"2023-12-02T01:30:41.091692+0000","last_fullsized":"2023-12-02T01:30:41.091692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:38.017077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.311325+0000","last_change":"2023-12-02T01:30:40.086406+0000","last_active":"2023-12-02T01:30:41.311325+0000","last_peered":"2023-12-02T01:30:41.311325+0000","last_clean":"2023-12-02T01:30:41.311325+0000","last_became_active":"2023-12-02T01:30:40.086165+0000","last_became_peered":"2023-12-02T01:30:40.086165+0000","last_unstale":"2023-12-02T01:30:41.311325+0000","last_undegraded":"2023-12-02T01:30:41.311325+0000","last_fullsized":"2023-12-02T01:30:41.311325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:53:21.775883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091473+0000","last_change":"2023-12-02T01:30:41.087701+0000","last_active":"2023-12-02T01:30:41.091473+0000","last_peered":"2023-12-02T01:30:41.091473+0000","last_clean":"2023-12-02T01:30:41.091473+0000","last_became_active":"2023-12-02T01:30:41.087428+0000","last_became_peered":"2023-12-02T01:30:41.087428+0000","last_unstale":"2023-12-02T01:30:41.091473+0000","last_undegraded":"2023-12-02T01:30:41.091473+0000","last_fullsized":"2023-12-02T01:30:41.091473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:24:34.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309691+0000","last_change":"2023-12-02T01:30:40.079481+0000","last_active":"2023-12-02T01:30:41.309691+0000","last_peered":"2023-12-02T01:30:41.309691+0000","last_clean":"2023-12-02T01:30:41.309691+0000","last_became_active":"2023-12-02T01:30:40.079002+0000","last_became_peered":"2023-12-02T01:30:40.079002+0000","last_unstale":"2023-12-02T01:30:41.309691+0000","last_undegraded":"2023-12-02T01:30:41.309691+0000","last_fullsized":"2023-12-02T01:30:41.309691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:20.522410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082804+0000","last_change":"2023-12-02T01:30:41.078044+0000","last_active":"2023-12-02T01:30:41.082804+0000","last_peered":"2023-12-02T01:30:41.082804+0000","last_clean":"2023-12-02T01:30:41.082804+0000","last_became_active":"2023-12-02T01:30:41.077738+0000","last_became_peered":"2023-12-02T01:30:41.077738+0000","last_unstale":"2023-12-02T01:30:41.082804+0000","last_undegraded":"2023-12-02T01:30:41.082804+0000","last_fullsized":"2023-12-02T01:30:41.082804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:27.439097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082292+0000","last_change":"2023-12-02T01:30:40.078514+0000","last_active":"2023-12-02T01:30:41.082292+0000","last_peered":"2023-12-02T01:30:41.082292+0000","last_clean":"2023-12-02T01:30:41.082292+0000","last_became_active":"2023-12-02T01:30:40.078206+0000","last_became_peered":"2023-12-02T01:30:40.078206+0000","last_unstale":"2023-12-02T01:30:41.082292+0000","last_undegraded":"2023-12-02T01:30:41.082292+0000","last_fullsized":"2023-12-02T01:30:41.082292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:35.855377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092007+0000","last_change":"2023-12-02T01:30:41.087982+0000","last_active":"2023-12-02T01:30:41.092007+0000","last_peered":"2023-12-02T01:30:41.092007+0000","last_clean":"2023-12-02T01:30:41.092007+0000","last_became_active":"2023-12-02T01:30:41.087685+0000","last_became_peered":"2023-12-02T01:30:41.087685+0000","last_unstale":"2023-12-02T01:30:41.092007+0000","last_undegraded":"2023-12-02T01:30:41.092007+0000","last_fullsized":"2023-12-02T01:30:41.092007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:03:44.736803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.068830+0000","last_change":"2023-12-02T01:30:40.082732+0000","last_active":"2023-12-02T01:30:41.068830+0000","last_peered":"2023-12-02T01:30:41.068830+0000","last_clean":"2023-12-02T01:30:41.068830+0000","last_became_active":"2023-12-02T01:30:40.082462+0000","last_became_peered":"2023-12-02T01:30:40.082462+0000","last_unstale":"2023-12-02T01:30:41.068830+0000","last_undegraded":"2023-12-02T01:30:41.068830+0000","last_fullsized":"2023-12-02T01:30:41.068830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:19.462353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086372+0000","last_change":"2023-12-02T01:30:41.084202+0000","last_active":"2023-12-02T01:30:41.086372+0000","last_peered":"2023-12-02T01:30:41.086372+0000","last_clean":"2023-12-02T01:30:41.086372+0000","last_became_active":"2023-12-02T01:30:41.083935+0000","last_became_peered":"2023-12-02T01:30:41.083935+0000","last_unstale":"2023-12-02T01:30:41.086372+0000","last_undegraded":"2023-12-02T01:30:41.086372+0000","last_fullsized":"2023-12-02T01:30:41.086372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:40:17.969654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309038+0000","last_change":"2023-12-02T01:30:40.086970+0000","last_active":"2023-12-02T01:30:41.309038+0000","last_peered":"2023-12-02T01:30:41.309038+0000","last_clean":"2023-12-02T01:30:41.309038+0000","last_became_active":"2023-12-02T01:30:40.086721+0000","last_became_peered":"2023-12-02T01:30:40.086721+0000","last_unstale":"2023-12-02T01:30:41.309038+0000","last_undegraded":"2023-12-02T01:30:41.309038+0000","last_fullsized":"2023-12-02T01:30:41.309038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:58.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086590+0000","last_change":"2023-12-02T01:30:41.084253+0000","last_active":"2023-12-02T01:30:41.086590+0000","last_peered":"2023-12-02T01:30:41.086590+0000","last_clean":"2023-12-02T01:30:41.086590+0000","last_became_active":"2023-12-02T01:30:41.083982+0000","last_became_peered":"2023-12-02T01:30:41.083982+0000","last_unstale":"2023-12-02T01:30:41.086590+0000","last_undegraded":"2023-12-02T01:30:41.086590+0000","last_fullsized":"2023-12-02T01:30:41.086590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:20.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.308609+0000","last_change":"2023-12-02T01:30:40.085100+0000","last_active":"2023-12-02T01:30:41.308609+0000","last_peered":"2023-12-02T01:30:41.308609+0000","last_clean":"2023-12-02T01:30:41.308609+0000","last_became_active":"2023-12-02T01:30:40.084619+0000","last_became_peered":"2023-12-02T01:30:40.084619+0000","last_unstale":"2023-12-02T01:30:41.308609+0000","last_undegraded":"2023-12-02T01:30:41.308609+0000","last_fullsized":"2023-12-02T01:30:41.308609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:20.522410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081533+0000","last_change":"2023-12-02T01:30:41.076902+0000","last_active":"2023-12-02T01:30:41.081533+0000","last_peered":"2023-12-02T01:30:41.081533+0000","last_clean":"2023-12-02T01:30:41.081533+0000","last_became_active":"2023-12-02T01:30:41.076243+0000","last_became_peered":"2023-12-02T01:30:41.076243+0000","last_unstale":"2023-12-02T01:30:41.081533+0000","last_undegraded":"2023-12-02T01:30:41.081533+0000","last_fullsized":"2023-12-02T01:30:41.081533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:27.439097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309622+0000","last_change":"2023-12-02T01:30:40.078956+0000","last_active":"2023-12-02T01:30:41.309622+0000","last_peered":"2023-12-02T01:30:41.309622+0000","last_clean":"2023-12-02T01:30:41.309622+0000","last_became_active":"2023-12-02T01:30:40.078580+0000","last_became_peered":"2023-12-02T01:30:40.078580+0000","last_unstale":"2023-12-02T01:30:41.309622+0000","last_undegraded":"2023-12-02T01:30:41.309622+0000","last_fullsized":"2023-12-02T01:30:41.309622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:35.855377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089886+0000","last_change":"2023-12-02T01:30:41.085995+0000","last_active":"2023-12-02T01:30:41.089886+0000","last_peered":"2023-12-02T01:30:41.089886+0000","last_clean":"2023-12-02T01:30:41.089886+0000","last_became_active":"2023-12-02T01:30:41.085506+0000","last_became_peered":"2023-12-02T01:30:41.085506+0000","last_unstale":"2023-12-02T01:30:41.089886+0000","last_undegraded":"2023-12-02T01:30:41.089886+0000","last_fullsized":"2023-12-02T01:30:41.089886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:37.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306417+0000","last_change":"2023-12-02T01:30:40.080592+0000","last_active":"2023-12-02T01:30:41.306417+0000","last_peered":"2023-12-02T01:30:41.306417+0000","last_clean":"2023-12-02T01:30:41.306417+0000","last_became_active":"2023-12-02T01:30:40.080325+0000","last_became_peered":"2023-12-02T01:30:40.080325+0000","last_unstale":"2023-12-02T01:30:41.306417+0000","last_undegraded":"2023-12-02T01:30:41.306417+0000","last_fullsized":"2023-12-02T01:30:41.306417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:18.161466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082367+0000","last_change":"2023-12-02T01:30:41.081407+0000","last_active":"2023-12-02T01:30:41.082367+0000","last_peered":"2023-12-02T01:30:41.082367+0000","last_clean":"2023-12-02T01:30:41.082367+0000","last_became_active":"2023-12-02T01:30:41.081094+0000","last_became_peered":"2023-12-02T01:30:41.081094+0000","last_unstale":"2023-12-02T01:30:41.082367+0000","last_undegraded":"2023-12-02T01:30:41.082367+0000","last_fullsized":"2023-12-02T01:30:41.082367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:37:00.206137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071636+0000","last_change":"2023-12-02T01:30:40.079208+0000","last_active":"2023-12-02T01:30:41.071636+0000","last_peered":"2023-12-02T01:30:41.071636+0000","last_clean":"2023-12-02T01:30:41.071636+0000","last_became_active":"2023-12-02T01:30:40.078890+0000","last_became_peered":"2023-12-02T01:30:40.078890+0000","last_unstale":"2023-12-02T01:30:41.071636+0000","last_undegraded":"2023-12-02T01:30:41.071636+0000","last_fullsized":"2023-12-02T01:30:41.071636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:24:33.206258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081775+0000","last_change":"2023-12-02T01:30:41.079983+0000","last_active":"2023-12-02T01:30:41.081775+0000","last_peered":"2023-12-02T01:30:41.081775+0000","last_clean":"2023-12-02T01:30:41.081775+0000","last_became_active":"2023-12-02T01:30:41.079572+0000","last_became_peered":"2023-12-02T01:30:41.079572+0000","last_unstale":"2023-12-02T01:30:41.081775+0000","last_undegraded":"2023-12-02T01:30:41.081775+0000","last_fullsized":"2023-12-02T01:30:41.081775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:37.363369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306773+0000","last_change":"2023-12-02T01:30:40.077560+0000","last_active":"2023-12-02T01:30:41.306773+0000","last_peered":"2023-12-02T01:30:41.306773+0000","last_clean":"2023-12-02T01:30:41.306773+0000","last_became_active":"2023-12-02T01:30:40.077273+0000","last_became_peered":"2023-12-02T01:30:40.077273+0000","last_unstale":"2023-12-02T01:30:41.306773+0000","last_undegraded":"2023-12-02T01:30:41.306773+0000","last_fullsized":"2023-12-02T01:30:41.306773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.080472+0000","last_change":"2023-12-02T01:30:41.079140+0000","last_active":"2023-12-02T01:30:41.080472+0000","last_peered":"2023-12-02T01:30:41.080472+0000","last_clean":"2023-12-02T01:30:41.080472+0000","last_became_active":"2023-12-02T01:30:41.078814+0000","last_became_peered":"2023-12-02T01:30:41.078814+0000","last_unstale":"2023-12-02T01:30:41.080472+0000","last_undegraded":"2023-12-02T01:30:41.080472+0000","last_fullsized":"2023-12-02T01:30:41.080472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:02:49.031643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.076576+0000","last_change":"2023-12-02T01:30:40.085070+0000","last_active":"2023-12-02T01:30:41.076576+0000","last_peered":"2023-12-02T01:30:41.076576+0000","last_clean":"2023-12-02T01:30:41.076576+0000","last_became_active":"2023-12-02T01:30:40.084505+0000","last_became_peered":"2023-12-02T01:30:40.084505+0000","last_unstale":"2023-12-02T01:30:41.076576+0000","last_undegraded":"2023-12-02T01:30:41.076576+0000","last_fullsized":"2023-12-02T01:30:41.076576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:12.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.078671+0000","last_change":"2023-12-02T01:30:41.077636+0000","last_active":"2023-12-02T01:30:41.078671+0000","last_peered":"2023-12-02T01:30:41.078671+0000","last_clean":"2023-12-02T01:30:41.078671+0000","last_became_active":"2023-12-02T01:30:41.077339+0000","last_became_peered":"2023-12-02T01:30:41.077339+0000","last_unstale":"2023-12-02T01:30:41.078671+0000","last_undegraded":"2023-12-02T01:30:41.078671+0000","last_fullsized":"2023-12-02T01:30:41.078671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:39.514010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071902+0000","last_change":"2023-12-02T01:30:40.080444+0000","last_active":"2023-12-02T01:30:41.071902+0000","last_peered":"2023-12-02T01:30:41.071902+0000","last_clean":"2023-12-02T01:30:41.071902+0000","last_became_active":"2023-12-02T01:30:40.080193+0000","last_became_peered":"2023-12-02T01:30:40.080193+0000","last_unstale":"2023-12-02T01:30:41.071902+0000","last_undegraded":"2023-12-02T01:30:41.071902+0000","last_fullsized":"2023-12-02T01:30:41.071902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:36.048160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092029+0000","last_change":"2023-12-02T01:30:41.087370+0000","last_active":"2023-12-02T01:30:41.092029+0000","last_peered":"2023-12-02T01:30:41.092029+0000","last_clean":"2023-12-02T01:30:41.092029+0000","last_became_active":"2023-12-02T01:30:41.087061+0000","last_became_peered":"2023-12-02T01:30:41.087061+0000","last_unstale":"2023-12-02T01:30:41.092029+0000","last_undegraded":"2023-12-02T01:30:41.092029+0000","last_fullsized":"2023-12-02T01:30:41.092029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:21.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.070615+0000","last_change":"2023-12-02T01:30:40.085755+0000","last_active":"2023-12-02T01:30:41.070615+0000","last_peered":"2023-12-02T01:30:41.070615+0000","last_clean":"2023-12-02T01:30:41.070615+0000","last_became_active":"2023-12-02T01:30:40.085429+0000","last_became_peered":"2023-12-02T01:30:40.085429+0000","last_unstale":"2023-12-02T01:30:41.070615+0000","last_undegraded":"2023-12-02T01:30:41.070615+0000","last_fullsized":"2023-12-02T01:30:41.070615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:20.522410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082426+0000","last_change":"2023-12-02T01:30:41.080648+0000","last_active":"2023-12-02T01:30:41.082426+0000","last_peered":"2023-12-02T01:30:41.082426+0000","last_clean":"2023-12-02T01:30:41.082426+0000","last_became_active":"2023-12-02T01:30:41.080383+0000","last_became_peered":"2023-12-02T01:30:41.080383+0000","last_unstale":"2023-12-02T01:30:41.082426+0000","last_undegraded":"2023-12-02T01:30:41.082426+0000","last_fullsized":"2023-12-02T01:30:41.082426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:07:15.367128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309750+0000","last_change":"2023-12-02T01:30:40.087180+0000","last_active":"2023-12-02T01:30:41.309750+0000","last_peered":"2023-12-02T01:30:41.309750+0000","last_clean":"2023-12-02T01:30:41.309750+0000","last_became_active":"2023-12-02T01:30:40.086537+0000","last_became_peered":"2023-12-02T01:30:40.086537+0000","last_unstale":"2023-12-02T01:30:41.309750+0000","last_undegraded":"2023-12-02T01:30:41.309750+0000","last_fullsized":"2023-12-02T01:30:41.309750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:26.434940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091731+0000","last_change":"2023-12-02T01:30:41.088747+0000","last_active":"2023-12-02T01:30:41.091731+0000","last_peered":"2023-12-02T01:30:41.091731+0000","last_clean":"2023-12-02T01:30:41.091731+0000","last_became_active":"2023-12-02T01:30:41.088493+0000","last_became_peered":"2023-12-02T01:30:41.088493+0000","last_unstale":"2023-12-02T01:30:41.091731+0000","last_undegraded":"2023-12-02T01:30:41.091731+0000","last_fullsized":"2023-12-02T01:30:41.091731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:53:22.780041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.074516+0000","last_change":"2023-12-02T01:30:40.078488+0000","last_active":"2023-12-02T01:30:41.074516+0000","last_peered":"2023-12-02T01:30:41.074516+0000","last_clean":"2023-12-02T01:30:41.074516+0000","last_became_active":"2023-12-02T01:30:40.078216+0000","last_became_peered":"2023-12-02T01:30:40.078216+0000","last_unstale":"2023-12-02T01:30:41.074516+0000","last_undegraded":"2023-12-02T01:30:41.074516+0000","last_fullsized":"2023-12-02T01:30:41.074516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:35.855377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089704+0000","last_change":"2023-12-02T01:30:41.087746+0000","last_active":"2023-12-02T01:30:41.089704+0000","last_peered":"2023-12-02T01:30:41.089704+0000","last_clean":"2023-12-02T01:30:41.089704+0000","last_became_active":"2023-12-02T01:30:41.087357+0000","last_became_peered":"2023-12-02T01:30:41.087357+0000","last_unstale":"2023-12-02T01:30:41.089704+0000","last_undegraded":"2023-12-02T01:30:41.089704+0000","last_fullsized":"2023-12-02T01:30:41.089704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:57.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082396+0000","last_change":"2023-12-02T01:30:40.080863+0000","last_active":"2023-12-02T01:30:41.082396+0000","last_peered":"2023-12-02T01:30:41.082396+0000","last_clean":"2023-12-02T01:30:41.082396+0000","last_became_active":"2023-12-02T01:30:40.080606+0000","last_became_peered":"2023-12-02T01:30:40.080606+0000","last_unstale":"2023-12-02T01:30:41.082396+0000","last_undegraded":"2023-12-02T01:30:41.082396+0000","last_fullsized":"2023-12-02T01:30:41.082396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:04.553045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.084928+0000","last_change":"2023-12-02T01:30:41.082492+0000","last_active":"2023-12-02T01:30:41.084928+0000","last_peered":"2023-12-02T01:30:41.084928+0000","last_clean":"2023-12-02T01:30:41.084928+0000","last_became_active":"2023-12-02T01:30:41.081806+0000","last_became_peered":"2023-12-02T01:30:41.081806+0000","last_unstale":"2023-12-02T01:30:41.084928+0000","last_undegraded":"2023-12-02T01:30:41.084928+0000","last_fullsized":"2023-12-02T01:30:41.084928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:37.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.075880+0000","last_change":"2023-12-02T01:30:40.082618+0000","last_active":"2023-12-02T01:30:41.075880+0000","last_peered":"2023-12-02T01:30:41.075880+0000","last_clean":"2023-12-02T01:30:41.075880+0000","last_became_active":"2023-12-02T01:30:40.082269+0000","last_became_peered":"2023-12-02T01:30:40.082269+0000","last_unstale":"2023-12-02T01:30:41.075880+0000","last_undegraded":"2023-12-02T01:30:41.075880+0000","last_fullsized":"2023-12-02T01:30:41.075880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:04.553045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082226+0000","last_change":"2023-12-02T01:30:41.081659+0000","last_active":"2023-12-02T01:30:41.082226+0000","last_peered":"2023-12-02T01:30:41.082226+0000","last_clean":"2023-12-02T01:30:41.082226+0000","last_became_active":"2023-12-02T01:30:41.081345+0000","last_became_peered":"2023-12-02T01:30:41.081345+0000","last_unstale":"2023-12-02T01:30:41.082226+0000","last_undegraded":"2023-12-02T01:30:41.082226+0000","last_fullsized":"2023-12-02T01:30:41.082226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:13.705046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082360+0000","last_change":"2023-12-02T01:30:40.087224+0000","last_active":"2023-12-02T01:30:41.082360+0000","last_peered":"2023-12-02T01:30:41.082360+0000","last_clean":"2023-12-02T01:30:41.082360+0000","last_became_active":"2023-12-02T01:30:40.086403+0000","last_became_peered":"2023-12-02T01:30:40.086403+0000","last_unstale":"2023-12-02T01:30:41.082360+0000","last_undegraded":"2023-12-02T01:30:41.082360+0000","last_fullsized":"2023-12-02T01:30:41.082360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089435+0000","last_change":"2023-12-02T01:30:41.087193+0000","last_active":"2023-12-02T01:30:41.089435+0000","last_peered":"2023-12-02T01:30:41.089435+0000","last_clean":"2023-12-02T01:30:41.089435+0000","last_became_active":"2023-12-02T01:30:41.086897+0000","last_became_peered":"2023-12-02T01:30:41.086897+0000","last_unstale":"2023-12-02T01:30:41.089435+0000","last_undegraded":"2023-12-02T01:30:41.089435+0000","last_fullsized":"2023-12-02T01:30:41.089435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:36.859534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071955+0000","last_change":"2023-12-02T01:30:40.083309+0000","last_active":"2023-12-02T01:30:41.071955+0000","last_peered":"2023-12-02T01:30:41.071955+0000","last_clean":"2023-12-02T01:30:41.071955+0000","last_became_active":"2023-12-02T01:30:40.083006+0000","last_became_peered":"2023-12-02T01:30:40.083006+0000","last_unstale":"2023-12-02T01:30:41.071955+0000","last_undegraded":"2023-12-02T01:30:41.071955+0000","last_fullsized":"2023-12-02T01:30:41.071955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:12.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085289+0000","last_change":"2023-12-02T01:30:41.082696+0000","last_active":"2023-12-02T01:30:41.085289+0000","last_peered":"2023-12-02T01:30:41.085289+0000","last_clean":"2023-12-02T01:30:41.085289+0000","last_became_active":"2023-12-02T01:30:41.082408+0000","last_became_peered":"2023-12-02T01:30:41.082408+0000","last_unstale":"2023-12-02T01:30:41.085289+0000","last_undegraded":"2023-12-02T01:30:41.085289+0000","last_fullsized":"2023-12-02T01:30:41.085289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:40:17.969654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.069031+0000","last_change":"2023-12-02T01:30:40.081443+0000","last_active":"2023-12-02T01:30:41.069031+0000","last_peered":"2023-12-02T01:30:41.069031+0000","last_clean":"2023-12-02T01:30:41.069031+0000","last_became_active":"2023-12-02T01:30:40.081164+0000","last_became_peered":"2023-12-02T01:30:40.081164+0000","last_unstale":"2023-12-02T01:30:41.069031+0000","last_undegraded":"2023-12-02T01:30:41.069031+0000","last_fullsized":"2023-12-02T01:30:41.069031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.094615+0000","last_change":"2023-12-02T01:30:41.091101+0000","last_active":"2023-12-02T01:30:41.094615+0000","last_peered":"2023-12-02T01:30:41.094615+0000","last_clean":"2023-12-02T01:30:41.094615+0000","last_became_active":"2023-12-02T01:30:41.090786+0000","last_became_peered":"2023-12-02T01:30:41.090786+0000","last_unstale":"2023-12-02T01:30:41.094615+0000","last_undegraded":"2023-12-02T01:30:41.094615+0000","last_fullsized":"2023-12-02T01:30:41.094615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:04:13.587931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.076001+0000","last_change":"2023-12-02T01:30:40.082662+0000","last_active":"2023-12-02T01:30:41.076001+0000","last_peered":"2023-12-02T01:30:41.076001+0000","last_clean":"2023-12-02T01:30:41.076001+0000","last_became_active":"2023-12-02T01:30:40.082337+0000","last_became_peered":"2023-12-02T01:30:40.082337+0000","last_unstale":"2023-12-02T01:30:41.076001+0000","last_undegraded":"2023-12-02T01:30:41.076001+0000","last_fullsized":"2023-12-02T01:30:41.076001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:31:08.908395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-02T01:30:40.075935+0000","last_change":"2023-12-02T01:29:33.915833+0000","last_active":"2023-12-02T01:30:40.075935+0000","last_peered":"2023-12-02T01:30:40.075935+0000","last_clean":"2023-12-02T01:30:40.075935+0000","last_became_active":"2023-12-02T01:29:33.915012+0000","last_became_peered":"2023-12-02T01:29:33.915012+0000","last_unstale":"2023-12-02T01:30:40.075935+0000","last_undegraded":"2023-12-02T01:30:40.075935+0000","last_fullsized":"2023-12-02T01:30:40.075935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_clean_scrub_stamp":"2023-12-02T01:29:32.688531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:25:40.082821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":954368,"data_stored":730660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.378}]},{"osd":5,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.44},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.495},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.503},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.627},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":140396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52200000000000002}]},{"osd":2,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.80100000000000005}]},{"osd":5,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70899999999999996}]},{"osd":7,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.432}]},{"osd":2,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.88800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":133517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.252},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.315},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.33200000000000002}]},{"osd":4,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":954368,"data_stored":730660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.318},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.373}]},{"osd":4,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.501}]},{"osd":7,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-02T01:30:44.297 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-02T01:30:44.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.437+0000 7f93ecc4f640 1 Processor -- start 2023-12-02T01:30:44.439 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.437+0000 7f93ecc4f640 1 -- start start 2023-12-02T01:30:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93ecc4f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93e8160af0 0x7f93e80c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93ecc4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8067b30 0x7f93e80cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93ecc4f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f93e8071a40 0x7f93e8071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93ecc4f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e806c080 con 0x7f93e8160af0 2023-12-02T01:30:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93ecc4f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e80cbb50 con 0x7f93e8071a40 2023-12-02T01:30:44.440 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93ecc4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8072410 con 0x7f93e8067b30 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93e659c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93e8160af0 0x7f93e80c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93e659c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f93e8160af0 0x7f93e80c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45102/0 (socket says 172.21.15.1:45102) 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93e659c640 1 -- 172.21.15.1:0/4069818698 learned_addr learned my addr 172.21.15.1:0/4069818698 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93e6d9d640 1 --2- 172.21.15.1:0/4069818698 >> v2:172.21.15.167:3300/0 conn(0x7f93e8071a40 0x7f93e8071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.438+0000 7f93e5d9b640 1 --2- 172.21.15.1:0/4069818698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8067b30 0x7f93e80cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.439+0000 7f93e659c640 1 -- 172.21.15.1:0/4069818698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8067b30 msgr2=0x7f93e80cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.439+0000 7f93e659c640 1 --2- 172.21.15.1:0/4069818698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8067b30 0x7f93e80cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.439+0000 7f93e659c640 1 -- 172.21.15.1:0/4069818698 >> v2:172.21.15.167:3300/0 conn(0x7f93e8071a40 msgr2=0x7f93e8071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.439+0000 7f93e659c640 1 --2- 172.21.15.1:0/4069818698 >> v2:172.21.15.167:3300/0 conn(0x7f93e8071a40 0x7f93e8071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.441 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.439+0000 7f93e659c640 1 -- 172.21.15.1:0/4069818698 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80cd340 con 0x7f93e8160af0 2023-12-02T01:30:44.442 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.439+0000 7f93e659c640 1 --2- 172.21.15.1:0/4069818698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8160af0 0x7f93e80c9880 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f93e80c9770 tx=0x7f93e002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf5bfbb4c292baa server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93e559a640 1 -- 172.21.15.1:0/4069818698 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00317c0 con 0x7f93e8160af0 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93e559a640 1 -- 172.21.15.1:0/4069818698 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e0031920 con 0x7f93e8160af0 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93e559a640 1 -- 172.21.15.1:0/4069818698 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0031cb0 con 0x7f93e8160af0 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 -- 172.21.15.1:0/4069818698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8160af0 msgr2=0x7f93e80c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/4069818698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8160af0 0x7f93e80c9880 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f93e80c9770 tx=0x7f93e002b860 comp rx=0 tx=0).stop 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 -- 172.21.15.1:0/4069818698 shutdown_connections 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/4069818698 >> v2:172.21.15.167:3300/0 conn(0x7f93e8071a40 0x7f93e8071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/4069818698 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8067b30 0x7f93e80cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/4069818698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8160af0 0x7f93e80c9880 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 -- 172.21.15.1:0/4069818698 >> 172.21.15.1:0/4069818698 conn(0x7f93e80b0d20 msgr2=0x7f93e80b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 -- 172.21.15.1:0/4069818698 shutdown_connections 2023-12-02T01:30:44.443 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.440+0000 7f93ecc4f640 1 -- 172.21.15.1:0/4069818698 wait complete. 2023-12-02T01:30:44.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.441+0000 7f93ecc4f640 1 Processor -- start 2023-12-02T01:30:44.445 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93ecc4f640 1 -- start start 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93ecc4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8067b30 0x7f93e81509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93ecc4f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8071a40 0x7f93e814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93ecc4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93e8160af0 0x7f93e814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93ecc4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e814e270 con 0x7f93e8067b30 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93ecc4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e814fb20 con 0x7f93e8160af0 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93ecc4f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e814e540 con 0x7f93e8071a40 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93e659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8067b30 0x7f93e81509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93e659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8067b30 0x7f93e81509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45106/0 (socket says 172.21.15.1:45106) 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.442+0000 7f93e659c640 1 -- 172.21.15.1:0/571235132 learned_addr learned my addr 172.21.15.1:0/571235132 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e6d9d640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93e8160af0 0x7f93e814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e5d9b640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8071a40 0x7f93e814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e659c640 1 -- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8071a40 msgr2=0x7f93e814dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.446 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e659c640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8071a40 0x7f93e814dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e659c640 1 -- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93e8160af0 msgr2=0x7f93e814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e659c640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93e8160af0 0x7f93e814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e659c640 1 -- 172.21.15.1:0/571235132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00094d0 con 0x7f93e8067b30 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93e659c640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8067b30 0x7f93e81509a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000c00 tx=0x7f93e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93deffd640 1 -- 172.21.15.1:0/571235132 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0032650 con 0x7f93e8067b30 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93deffd640 1 -- 172.21.15.1:0/571235132 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e00327b0 con 0x7f93e8067b30 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e814e820 con 0x7f93e8067b30 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93deffd640 1 -- 172.21.15.1:0/571235132 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0032b60 con 0x7f93e8067b30 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.443+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e814ede0 con 0x7f93e8067b30 2023-12-02T01:30:44.447 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.444+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e8067420 con 0x7f93e8067b30 2023-12-02T01:30:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.445+0000 7f93deffd640 1 -- 172.21.15.1:0/571235132 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93e0032cc0 con 0x7f93e8067b30 2023-12-02T01:30:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.445+0000 7f93deffd640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f93c806ae70 0x7f93c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.445+0000 7f93e5d9b640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f93c806ae70 0x7f93c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.445+0000 7f93deffd640 1 -- 172.21.15.1:0/571235132 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93e00ab570 con 0x7f93e8067b30 2023-12-02T01:30:44.448 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.446+0000 7f93e5d9b640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f93c806ae70 0x7f93c806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f93e815cda0 tx=0x7f93d0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.451 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.450+0000 7f93deffd640 1 -- 172.21.15.1:0/571235132 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93e0076640 con 0x7f93e8067b30 2023-12-02T01:30:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.622+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 --> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93e80d00e0 con 0x7f93c806ae70 2023-12-02T01:30:44.631 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.629+0000 7f93deffd640 1 -- 172.21.15.1:0/571235132 <== mgr.4110 v2:172.21.15.1:6832/1281506213 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289727 (secure 0 0 0) 0x7f93e80d00e0 con 0x7f93c806ae70 2023-12-02T01:30:44.634 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:44.635 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2023-12-02T01:30:44.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.632+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f93c806ae70 msgr2=0x7f93c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.632+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f93c806ae70 0x7f93c806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f93e815cda0 tx=0x7f93d0009190 comp rx=0 tx=0).stop 2023-12-02T01:30:44.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.632+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8067b30 msgr2=0x7f93e81509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.632+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8067b30 0x7f93e81509a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000c00 tx=0x7f93e00046c0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 shutdown_connections 2023-12-02T01:30:44.637 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f93c806ae70 0x7f93c806d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93e8160af0 0x7f93e814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93e8071a40 0x7f93e814dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 --2- 172.21.15.1:0/571235132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93e8067b30 0x7f93e81509a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 >> 172.21.15.1:0/571235132 conn(0x7f93e80b0d20 msgr2=0x7f93e806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:44.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 shutdown_connections 2023-12-02T01:30:44.638 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.633+0000 7f93ecc4f640 1 -- 172.21.15.1:0/571235132 wait complete. 2023-12-02T01:30:44.645 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-12-02T01:30:42.643604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236816,"kb_used_data":3968,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737904,"statfs":{"total":773094113280,"available":772851613696,"internally_reserved":0,"allocated":4063232,"data_stored":2290242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000625"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088859+0000","last_change":"2023-12-02T01:30:41.085034+0000","last_active":"2023-12-02T01:30:41.088859+0000","last_peered":"2023-12-02T01:30:41.088859+0000","last_clean":"2023-12-02T01:30:41.088859+0000","last_became_active":"2023-12-02T01:30:41.084765+0000","last_became_peered":"2023-12-02T01:30:41.084765+0000","last_unstale":"2023-12-02T01:30:41.088859+0000","last_undegraded":"2023-12-02T01:30:41.088859+0000","last_fullsized":"2023-12-02T01:30:41.088859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:57.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082652+0000","last_change":"2023-12-02T01:30:41.077266+0000","last_active":"2023-12-02T01:30:41.082652+0000","last_peered":"2023-12-02T01:30:41.082652+0000","last_clean":"2023-12-02T01:30:41.082652+0000","last_became_active":"2023-12-02T01:30:41.076988+0000","last_became_peered":"2023-12-02T01:30:41.076988+0000","last_unstale":"2023-12-02T01:30:41.082652+0000","last_undegraded":"2023-12-02T01:30:41.082652+0000","last_fullsized":"2023-12-02T01:30:41.082652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:04:13.587931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091727+0000","last_change":"2023-12-02T01:30:41.088931+0000","last_active":"2023-12-02T01:30:41.091727+0000","last_peered":"2023-12-02T01:30:41.091727+0000","last_clean":"2023-12-02T01:30:41.091727+0000","last_became_active":"2023-12-02T01:30:41.087818+0000","last_became_peered":"2023-12-02T01:30:41.087818+0000","last_unstale":"2023-12-02T01:30:41.091727+0000","last_undegraded":"2023-12-02T01:30:41.091727+0000","last_fullsized":"2023-12-02T01:30:41.091727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:40:13.041462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091185+0000","last_change":"2023-12-02T01:30:41.086538+0000","last_active":"2023-12-02T01:30:41.091185+0000","last_peered":"2023-12-02T01:30:41.091185+0000","last_clean":"2023-12-02T01:30:41.091185+0000","last_became_active":"2023-12-02T01:30:41.086231+0000","last_became_peered":"2023-12-02T01:30:41.086231+0000","last_unstale":"2023-12-02T01:30:41.091185+0000","last_undegraded":"2023-12-02T01:30:41.091185+0000","last_fullsized":"2023-12-02T01:30:41.091185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:20.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088648+0000","last_change":"2023-12-02T01:30:41.087437+0000","last_active":"2023-12-02T01:30:41.088648+0000","last_peered":"2023-12-02T01:30:41.088648+0000","last_clean":"2023-12-02T01:30:41.088648+0000","last_became_active":"2023-12-02T01:30:41.087164+0000","last_became_peered":"2023-12-02T01:30:41.087164+0000","last_unstale":"2023-12-02T01:30:41.088648+0000","last_undegraded":"2023-12-02T01:30:41.088648+0000","last_fullsized":"2023-12-02T01:30:41.088648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:41:31.576632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.080096+0000","last_change":"2023-12-02T01:30:41.074056+0000","last_active":"2023-12-02T01:30:41.080096+0000","last_peered":"2023-12-02T01:30:41.080096+0000","last_clean":"2023-12-02T01:30:41.080096+0000","last_became_active":"2023-12-02T01:30:41.073777+0000","last_became_peered":"2023-12-02T01:30:41.073777+0000","last_unstale":"2023-12-02T01:30:41.080096+0000","last_undegraded":"2023-12-02T01:30:41.080096+0000","last_fullsized":"2023-12-02T01:30:41.080096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:21.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092043+0000","last_change":"2023-12-02T01:30:41.087765+0000","last_active":"2023-12-02T01:30:41.092043+0000","last_peered":"2023-12-02T01:30:41.092043+0000","last_clean":"2023-12-02T01:30:41.092043+0000","last_became_active":"2023-12-02T01:30:41.087495+0000","last_became_peered":"2023-12-02T01:30:41.087495+0000","last_unstale":"2023-12-02T01:30:41.092043+0000","last_undegraded":"2023-12-02T01:30:41.092043+0000","last_fullsized":"2023-12-02T01:30:41.092043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:30:46.988222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085981+0000","last_change":"2023-12-02T01:30:41.085087+0000","last_active":"2023-12-02T01:30:41.085981+0000","last_peered":"2023-12-02T01:30:41.085981+0000","last_clean":"2023-12-02T01:30:41.085981+0000","last_became_active":"2023-12-02T01:30:41.084761+0000","last_became_peered":"2023-12-02T01:30:41.084761+0000","last_unstale":"2023-12-02T01:30:41.085981+0000","last_undegraded":"2023-12-02T01:30:41.085981+0000","last_fullsized":"2023-12-02T01:30:41.085981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:27.439097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.094564+0000","last_change":"2023-12-02T01:30:41.089291+0000","last_active":"2023-12-02T01:30:41.094564+0000","last_peered":"2023-12-02T01:30:41.094564+0000","last_clean":"2023-12-02T01:30:41.094564+0000","last_became_active":"2023-12-02T01:30:41.088927+0000","last_became_peered":"2023-12-02T01:30:41.088927+0000","last_unstale":"2023-12-02T01:30:41.094564+0000","last_undegraded":"2023-12-02T01:30:41.094564+0000","last_fullsized":"2023-12-02T01:30:41.094564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:27:52.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091564+0000","last_change":"2023-12-02T01:30:41.087213+0000","last_active":"2023-12-02T01:30:41.091564+0000","last_peered":"2023-12-02T01:30:41.091564+0000","last_clean":"2023-12-02T01:30:41.091564+0000","last_became_active":"2023-12-02T01:30:41.086920+0000","last_became_peered":"2023-12-02T01:30:41.086920+0000","last_unstale":"2023-12-02T01:30:41.091564+0000","last_undegraded":"2023-12-02T01:30:41.091564+0000","last_fullsized":"2023-12-02T01:30:41.091564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:13.705046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092093+0000","last_change":"2023-12-02T01:30:41.088027+0000","last_active":"2023-12-02T01:30:41.092093+0000","last_peered":"2023-12-02T01:30:41.092093+0000","last_clean":"2023-12-02T01:30:41.092093+0000","last_became_active":"2023-12-02T01:30:41.087752+0000","last_became_peered":"2023-12-02T01:30:41.087752+0000","last_unstale":"2023-12-02T01:30:41.092093+0000","last_undegraded":"2023-12-02T01:30:41.092093+0000","last_fullsized":"2023-12-02T01:30:41.092093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:53:22.780041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.084633+0000","last_change":"2023-12-02T01:30:41.082340+0000","last_active":"2023-12-02T01:30:41.084633+0000","last_peered":"2023-12-02T01:30:41.084633+0000","last_clean":"2023-12-02T01:30:41.084633+0000","last_became_active":"2023-12-02T01:30:41.082068+0000","last_became_peered":"2023-12-02T01:30:41.082068+0000","last_unstale":"2023-12-02T01:30:41.084633+0000","last_undegraded":"2023-12-02T01:30:41.084633+0000","last_fullsized":"2023-12-02T01:30:41.084633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:03:44.736803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088957+0000","last_change":"2023-12-02T01:30:41.087667+0000","last_active":"2023-12-02T01:30:41.088957+0000","last_peered":"2023-12-02T01:30:41.088957+0000","last_clean":"2023-12-02T01:30:41.088957+0000","last_became_active":"2023-12-02T01:30:41.087390+0000","last_became_peered":"2023-12-02T01:30:41.087390+0000","last_unstale":"2023-12-02T01:30:41.088957+0000","last_undegraded":"2023-12-02T01:30:41.088957+0000","last_fullsized":"2023-12-02T01:30:41.088957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:14:54.297553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.083241+0000","last_change":"2023-12-02T01:30:41.079560+0000","last_active":"2023-12-02T01:30:41.083241+0000","last_peered":"2023-12-02T01:30:41.083241+0000","last_clean":"2023-12-02T01:30:41.083241+0000","last_became_active":"2023-12-02T01:30:41.079295+0000","last_became_peered":"2023-12-02T01:30:41.079295+0000","last_unstale":"2023-12-02T01:30:41.083241+0000","last_undegraded":"2023-12-02T01:30:41.083241+0000","last_fullsized":"2023-12-02T01:30:41.083241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:03:44.736803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.084767+0000","last_change":"2023-12-02T01:30:41.083899+0000","last_active":"2023-12-02T01:30:41.084767+0000","last_peered":"2023-12-02T01:30:41.084767+0000","last_clean":"2023-12-02T01:30:41.084767+0000","last_became_active":"2023-12-02T01:30:41.083619+0000","last_became_peered":"2023-12-02T01:30:41.083619+0000","last_unstale":"2023-12-02T01:30:41.084767+0000","last_undegraded":"2023-12-02T01:30:41.084767+0000","last_fullsized":"2023-12-02T01:30:41.084767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:59.902186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.094574+0000","last_change":"2023-12-02T01:30:41.089550+0000","last_active":"2023-12-02T01:30:41.094574+0000","last_peered":"2023-12-02T01:30:41.094574+0000","last_clean":"2023-12-02T01:30:41.094574+0000","last_became_active":"2023-12-02T01:30:41.089286+0000","last_became_peered":"2023-12-02T01:30:41.089286+0000","last_unstale":"2023-12-02T01:30:41.094574+0000","last_undegraded":"2023-12-02T01:30:41.094574+0000","last_fullsized":"2023-12-02T01:30:41.094574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:40:13.041462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092002+0000","last_change":"2023-12-02T01:30:41.087905+0000","last_active":"2023-12-02T01:30:41.092002+0000","last_peered":"2023-12-02T01:30:41.092002+0000","last_clean":"2023-12-02T01:30:41.092002+0000","last_became_active":"2023-12-02T01:30:41.086763+0000","last_became_peered":"2023-12-02T01:30:41.086763+0000","last_unstale":"2023-12-02T01:30:41.092002+0000","last_undegraded":"2023-12-02T01:30:41.092002+0000","last_fullsized":"2023-12-02T01:30:41.092002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:47:58.973857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090348+0000","last_change":"2023-12-02T01:30:41.089229+0000","last_active":"2023-12-02T01:30:41.090348+0000","last_peered":"2023-12-02T01:30:41.090348+0000","last_clean":"2023-12-02T01:30:41.090348+0000","last_became_active":"2023-12-02T01:30:41.088945+0000","last_became_peered":"2023-12-02T01:30:41.088945+0000","last_unstale":"2023-12-02T01:30:41.090348+0000","last_undegraded":"2023-12-02T01:30:41.090348+0000","last_fullsized":"2023-12-02T01:30:41.090348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:47:58.973857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090162+0000","last_change":"2023-12-02T01:30:41.088461+0000","last_active":"2023-12-02T01:30:41.090162+0000","last_peered":"2023-12-02T01:30:41.090162+0000","last_clean":"2023-12-02T01:30:41.090162+0000","last_became_active":"2023-12-02T01:30:41.088105+0000","last_became_peered":"2023-12-02T01:30:41.088105+0000","last_unstale":"2023-12-02T01:30:41.090162+0000","last_undegraded":"2023-12-02T01:30:41.090162+0000","last_fullsized":"2023-12-02T01:30:41.090162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:44.291133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088390+0000","last_change":"2023-12-02T01:30:41.083890+0000","last_active":"2023-12-02T01:30:41.088390+0000","last_peered":"2023-12-02T01:30:41.088390+0000","last_clean":"2023-12-02T01:30:41.088390+0000","last_became_active":"2023-12-02T01:30:41.083562+0000","last_became_peered":"2023-12-02T01:30:41.083562+0000","last_unstale":"2023-12-02T01:30:41.088390+0000","last_undegraded":"2023-12-02T01:30:41.088390+0000","last_fullsized":"2023-12-02T01:30:41.088390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:07:50.919716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082821+0000","last_change":"2023-12-02T01:30:41.079580+0000","last_active":"2023-12-02T01:30:41.082821+0000","last_peered":"2023-12-02T01:30:41.082821+0000","last_clean":"2023-12-02T01:30:41.082821+0000","last_became_active":"2023-12-02T01:30:41.078594+0000","last_became_peered":"2023-12-02T01:30:41.078594+0000","last_unstale":"2023-12-02T01:30:41.082821+0000","last_undegraded":"2023-12-02T01:30:41.082821+0000","last_fullsized":"2023-12-02T01:30:41.082821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:59.902186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.083713+0000","last_change":"2023-12-02T01:30:41.081041+0000","last_active":"2023-12-02T01:30:41.083713+0000","last_peered":"2023-12-02T01:30:41.083713+0000","last_clean":"2023-12-02T01:30:41.083713+0000","last_became_active":"2023-12-02T01:30:41.080614+0000","last_became_peered":"2023-12-02T01:30:41.080614+0000","last_unstale":"2023-12-02T01:30:41.083713+0000","last_undegraded":"2023-12-02T01:30:41.083713+0000","last_fullsized":"2023-12-02T01:30:41.083713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:55.896455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085891+0000","last_change":"2023-12-02T01:30:41.084317+0000","last_active":"2023-12-02T01:30:41.085891+0000","last_peered":"2023-12-02T01:30:41.085891+0000","last_clean":"2023-12-02T01:30:41.085891+0000","last_became_active":"2023-12-02T01:30:41.084028+0000","last_became_peered":"2023-12-02T01:30:41.084028+0000","last_unstale":"2023-12-02T01:30:41.085891+0000","last_undegraded":"2023-12-02T01:30:41.085891+0000","last_fullsized":"2023-12-02T01:30:41.085891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:37.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081649+0000","last_change":"2023-12-02T01:30:41.078798+0000","last_active":"2023-12-02T01:30:41.081649+0000","last_peered":"2023-12-02T01:30:41.081649+0000","last_clean":"2023-12-02T01:30:41.081649+0000","last_became_active":"2023-12-02T01:30:41.078516+0000","last_became_peered":"2023-12-02T01:30:41.078516+0000","last_unstale":"2023-12-02T01:30:41.081649+0000","last_undegraded":"2023-12-02T01:30:41.081649+0000","last_fullsized":"2023-12-02T01:30:41.081649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:36.859534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091394+0000","last_change":"2023-12-02T01:30:41.086968+0000","last_active":"2023-12-02T01:30:41.091394+0000","last_peered":"2023-12-02T01:30:41.091394+0000","last_clean":"2023-12-02T01:30:41.091394+0000","last_became_active":"2023-12-02T01:30:41.086663+0000","last_became_peered":"2023-12-02T01:30:41.086663+0000","last_unstale":"2023-12-02T01:30:41.091394+0000","last_undegraded":"2023-12-02T01:30:41.091394+0000","last_fullsized":"2023-12-02T01:30:41.091394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:59.902186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089477+0000","last_change":"2023-12-02T01:30:41.087551+0000","last_active":"2023-12-02T01:30:41.089477+0000","last_peered":"2023-12-02T01:30:41.089477+0000","last_clean":"2023-12-02T01:30:41.089477+0000","last_became_active":"2023-12-02T01:30:41.087240+0000","last_became_peered":"2023-12-02T01:30:41.087240+0000","last_unstale":"2023-12-02T01:30:41.089477+0000","last_undegraded":"2023-12-02T01:30:41.089477+0000","last_fullsized":"2023-12-02T01:30:41.089477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:46:33.187100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091206+0000","last_change":"2023-12-02T01:30:41.086453+0000","last_active":"2023-12-02T01:30:41.091206+0000","last_peered":"2023-12-02T01:30:41.091206+0000","last_clean":"2023-12-02T01:30:41.091206+0000","last_became_active":"2023-12-02T01:30:41.085961+0000","last_became_peered":"2023-12-02T01:30:41.085961+0000","last_unstale":"2023-12-02T01:30:41.091206+0000","last_undegraded":"2023-12-02T01:30:41.091206+0000","last_fullsized":"2023-12-02T01:30:41.091206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:55.896455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081431+0000","last_change":"2023-12-02T01:30:41.077362+0000","last_active":"2023-12-02T01:30:41.081431+0000","last_peered":"2023-12-02T01:30:41.081431+0000","last_clean":"2023-12-02T01:30:41.081431+0000","last_became_active":"2023-12-02T01:30:41.076687+0000","last_became_peered":"2023-12-02T01:30:41.076687+0000","last_unstale":"2023-12-02T01:30:41.081431+0000","last_undegraded":"2023-12-02T01:30:41.081431+0000","last_fullsized":"2023-12-02T01:30:41.081431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:04:13.587931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086212+0000","last_change":"2023-12-02T01:30:41.082735+0000","last_active":"2023-12-02T01:30:41.086212+0000","last_peered":"2023-12-02T01:30:41.086212+0000","last_clean":"2023-12-02T01:30:41.086212+0000","last_became_active":"2023-12-02T01:30:41.081899+0000","last_became_peered":"2023-12-02T01:30:41.081899+0000","last_unstale":"2023-12-02T01:30:41.086212+0000","last_undegraded":"2023-12-02T01:30:41.086212+0000","last_fullsized":"2023-12-02T01:30:41.086212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:31:09.912553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089218+0000","last_change":"2023-12-02T01:30:41.085798+0000","last_active":"2023-12-02T01:30:41.089218+0000","last_peered":"2023-12-02T01:30:41.089218+0000","last_clean":"2023-12-02T01:30:41.089218+0000","last_became_active":"2023-12-02T01:30:41.085541+0000","last_became_peered":"2023-12-02T01:30:41.085541+0000","last_unstale":"2023-12-02T01:30:41.089218+0000","last_undegraded":"2023-12-02T01:30:41.089218+0000","last_fullsized":"2023-12-02T01:30:41.089218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:09.500813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082702+0000","last_change":"2023-12-02T01:30:41.080872+0000","last_active":"2023-12-02T01:30:41.082702+0000","last_peered":"2023-12-02T01:30:41.082702+0000","last_clean":"2023-12-02T01:30:41.082702+0000","last_became_active":"2023-12-02T01:30:41.080576+0000","last_became_peered":"2023-12-02T01:30:41.080576+0000","last_unstale":"2023-12-02T01:30:41.082702+0000","last_undegraded":"2023-12-02T01:30:41.082702+0000","last_fullsized":"2023-12-02T01:30:41.082702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:24:34.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091989+0000","last_change":"2023-12-02T01:30:41.087086+0000","last_active":"2023-12-02T01:30:41.091989+0000","last_peered":"2023-12-02T01:30:41.091989+0000","last_clean":"2023-12-02T01:30:41.091989+0000","last_became_active":"2023-12-02T01:30:41.086604+0000","last_became_peered":"2023-12-02T01:30:41.086604+0000","last_unstale":"2023-12-02T01:30:41.091989+0000","last_undegraded":"2023-12-02T01:30:41.091989+0000","last_fullsized":"2023-12-02T01:30:41.091989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:38.017077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086827+0000","last_change":"2023-12-02T01:30:41.085015+0000","last_active":"2023-12-02T01:30:41.086827+0000","last_peered":"2023-12-02T01:30:41.086827+0000","last_clean":"2023-12-02T01:30:41.086827+0000","last_became_active":"2023-12-02T01:30:41.084684+0000","last_became_peered":"2023-12-02T01:30:41.084684+0000","last_unstale":"2023-12-02T01:30:41.086827+0000","last_undegraded":"2023-12-02T01:30:41.086827+0000","last_fullsized":"2023-12-02T01:30:41.086827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:20.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309677+0000","last_change":"2023-12-02T01:30:40.086590+0000","last_active":"2023-12-02T01:30:41.309677+0000","last_peered":"2023-12-02T01:30:41.309677+0000","last_clean":"2023-12-02T01:30:41.309677+0000","last_became_active":"2023-12-02T01:30:40.086189+0000","last_became_peered":"2023-12-02T01:30:40.086189+0000","last_unstale":"2023-12-02T01:30:41.309677+0000","last_undegraded":"2023-12-02T01:30:41.309677+0000","last_fullsized":"2023-12-02T01:30:41.309677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:19.462353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085127+0000","last_change":"2023-12-02T01:30:41.082667+0000","last_active":"2023-12-02T01:30:41.085127+0000","last_peered":"2023-12-02T01:30:41.085127+0000","last_clean":"2023-12-02T01:30:41.085127+0000","last_became_active":"2023-12-02T01:30:41.081477+0000","last_became_peered":"2023-12-02T01:30:41.081477+0000","last_unstale":"2023-12-02T01:30:41.085127+0000","last_undegraded":"2023-12-02T01:30:41.085127+0000","last_fullsized":"2023-12-02T01:30:41.085127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:27:52.113624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.305260+0000","last_change":"2023-12-02T01:30:40.083305+0000","last_active":"2023-12-02T01:30:41.305260+0000","last_peered":"2023-12-02T01:30:41.305260+0000","last_clean":"2023-12-02T01:30:41.305260+0000","last_became_active":"2023-12-02T01:30:40.083016+0000","last_became_peered":"2023-12-02T01:30:40.083016+0000","last_unstale":"2023-12-02T01:30:41.305260+0000","last_undegraded":"2023-12-02T01:30:41.305260+0000","last_fullsized":"2023-12-02T01:30:41.305260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:54.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085313+0000","last_change":"2023-12-02T01:30:41.083381+0000","last_active":"2023-12-02T01:30:41.085313+0000","last_peered":"2023-12-02T01:30:41.085313+0000","last_clean":"2023-12-02T01:30:41.085313+0000","last_became_active":"2023-12-02T01:30:41.082613+0000","last_became_peered":"2023-12-02T01:30:41.082613+0000","last_unstale":"2023-12-02T01:30:41.085313+0000","last_undegraded":"2023-12-02T01:30:41.085313+0000","last_fullsized":"2023-12-02T01:30:41.085313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T13:26:21.939690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.308301+0000","last_change":"2023-12-02T01:30:40.087586+0000","last_active":"2023-12-02T01:30:41.308301+0000","last_peered":"2023-12-02T01:30:41.308301+0000","last_clean":"2023-12-02T01:30:41.308301+0000","last_became_active":"2023-12-02T01:30:40.087341+0000","last_became_peered":"2023-12-02T01:30:40.087341+0000","last_unstale":"2023-12-02T01:30:41.308301+0000","last_undegraded":"2023-12-02T01:30:41.308301+0000","last_fullsized":"2023-12-02T01:30:41.308301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:30:45.984065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090078+0000","last_change":"2023-12-02T01:30:41.086127+0000","last_active":"2023-12-02T01:30:41.090078+0000","last_peered":"2023-12-02T01:30:41.090078+0000","last_clean":"2023-12-02T01:30:41.090078+0000","last_became_active":"2023-12-02T01:30:41.085653+0000","last_became_peered":"2023-12-02T01:30:41.085653+0000","last_unstale":"2023-12-02T01:30:41.090078+0000","last_undegraded":"2023-12-02T01:30:41.090078+0000","last_fullsized":"2023-12-02T01:30:41.090078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:57.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306417+0000","last_change":"2023-12-02T01:30:40.083526+0000","last_active":"2023-12-02T01:30:41.306417+0000","last_peered":"2023-12-02T01:30:41.306417+0000","last_clean":"2023-12-02T01:30:41.306417+0000","last_became_active":"2023-12-02T01:30:40.083098+0000","last_became_peered":"2023-12-02T01:30:40.083098+0000","last_unstale":"2023-12-02T01:30:41.306417+0000","last_undegraded":"2023-12-02T01:30:41.306417+0000","last_fullsized":"2023-12-02T01:30:41.306417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:59:41.403812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092115+0000","last_change":"2023-12-02T01:30:41.088638+0000","last_active":"2023-12-02T01:30:41.092115+0000","last_peered":"2023-12-02T01:30:41.092115+0000","last_clean":"2023-12-02T01:30:41.092115+0000","last_became_active":"2023-12-02T01:30:41.088348+0000","last_became_peered":"2023-12-02T01:30:41.088348+0000","last_unstale":"2023-12-02T01:30:41.092115+0000","last_undegraded":"2023-12-02T01:30:41.092115+0000","last_fullsized":"2023-12-02T01:30:41.092115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:05.557203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306344+0000","last_change":"2023-12-02T01:30:40.077543+0000","last_active":"2023-12-02T01:30:41.306344+0000","last_peered":"2023-12-02T01:30:41.306344+0000","last_clean":"2023-12-02T01:30:41.306344+0000","last_became_active":"2023-12-02T01:30:40.077245+0000","last_became_peered":"2023-12-02T01:30:40.077245+0000","last_unstale":"2023-12-02T01:30:41.306344+0000","last_undegraded":"2023-12-02T01:30:41.306344+0000","last_fullsized":"2023-12-02T01:30:41.306344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081610+0000","last_change":"2023-12-02T01:30:41.077337+0000","last_active":"2023-12-02T01:30:41.081610+0000","last_peered":"2023-12-02T01:30:41.081610+0000","last_clean":"2023-12-02T01:30:41.081610+0000","last_became_active":"2023-12-02T01:30:41.077061+0000","last_became_peered":"2023-12-02T01:30:41.077061+0000","last_unstale":"2023-12-02T01:30:41.081610+0000","last_undegraded":"2023-12-02T01:30:41.081610+0000","last_fullsized":"2023-12-02T01:30:41.081610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:09.500813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306446+0000","last_change":"2023-12-02T01:30:40.077645+0000","last_active":"2023-12-02T01:30:41.306446+0000","last_peered":"2023-12-02T01:30:41.306446+0000","last_clean":"2023-12-02T01:30:41.306446+0000","last_became_active":"2023-12-02T01:30:40.077367+0000","last_became_peered":"2023-12-02T01:30:40.077367+0000","last_unstale":"2023-12-02T01:30:41.306446+0000","last_undegraded":"2023-12-02T01:30:41.306446+0000","last_fullsized":"2023-12-02T01:30:41.306446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:04.553045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092025+0000","last_change":"2023-12-02T01:30:41.086414+0000","last_active":"2023-12-02T01:30:41.092025+0000","last_peered":"2023-12-02T01:30:41.092025+0000","last_clean":"2023-12-02T01:30:41.092025+0000","last_became_active":"2023-12-02T01:30:41.086141+0000","last_became_peered":"2023-12-02T01:30:41.086141+0000","last_unstale":"2023-12-02T01:30:41.092025+0000","last_undegraded":"2023-12-02T01:30:41.092025+0000","last_fullsized":"2023-12-02T01:30:41.092025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:10:33.769076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.068841+0000","last_change":"2023-12-02T01:30:40.078775+0000","last_active":"2023-12-02T01:30:41.068841+0000","last_peered":"2023-12-02T01:30:41.068841+0000","last_clean":"2023-12-02T01:30:41.068841+0000","last_became_active":"2023-12-02T01:30:40.078496+0000","last_became_peered":"2023-12-02T01:30:40.078496+0000","last_unstale":"2023-12-02T01:30:41.068841+0000","last_undegraded":"2023-12-02T01:30:41.068841+0000","last_fullsized":"2023-12-02T01:30:41.068841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:46:54.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090072+0000","last_change":"2023-12-02T01:30:41.086082+0000","last_active":"2023-12-02T01:30:41.090072+0000","last_peered":"2023-12-02T01:30:41.090072+0000","last_clean":"2023-12-02T01:30:41.090072+0000","last_became_active":"2023-12-02T01:30:41.085785+0000","last_became_peered":"2023-12-02T01:30:41.085785+0000","last_unstale":"2023-12-02T01:30:41.090072+0000","last_undegraded":"2023-12-02T01:30:41.090072+0000","last_fullsized":"2023-12-02T01:30:41.090072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:31:09.912553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071943+0000","last_change":"2023-12-02T01:30:40.080238+0000","last_active":"2023-12-02T01:30:41.071943+0000","last_peered":"2023-12-02T01:30:41.071943+0000","last_clean":"2023-12-02T01:30:41.071943+0000","last_became_active":"2023-12-02T01:30:40.079869+0000","last_became_peered":"2023-12-02T01:30:40.079869+0000","last_unstale":"2023-12-02T01:30:41.071943+0000","last_undegraded":"2023-12-02T01:30:41.071943+0000","last_fullsized":"2023-12-02T01:30:41.071943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:56.535630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081363+0000","last_change":"2023-12-02T01:30:41.078422+0000","last_active":"2023-12-02T01:30:41.081363+0000","last_peered":"2023-12-02T01:30:41.081363+0000","last_clean":"2023-12-02T01:30:41.081363+0000","last_became_active":"2023-12-02T01:30:41.078164+0000","last_became_peered":"2023-12-02T01:30:41.078164+0000","last_unstale":"2023-12-02T01:30:41.081363+0000","last_undegraded":"2023-12-02T01:30:41.081363+0000","last_fullsized":"2023-12-02T01:30:41.081363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:05.557203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.069582+0000","last_change":"2023-12-02T01:30:40.082501+0000","last_active":"2023-12-02T01:30:41.069582+0000","last_peered":"2023-12-02T01:30:41.069582+0000","last_clean":"2023-12-02T01:30:41.069582+0000","last_became_active":"2023-12-02T01:30:40.082228+0000","last_became_peered":"2023-12-02T01:30:40.082228+0000","last_unstale":"2023-12-02T01:30:41.069582+0000","last_undegraded":"2023-12-02T01:30:41.069582+0000","last_fullsized":"2023-12-02T01:30:41.069582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:37.012920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.090256+0000","last_change":"2023-12-02T01:30:41.089109+0000","last_active":"2023-12-02T01:30:41.090256+0000","last_peered":"2023-12-02T01:30:41.090256+0000","last_clean":"2023-12-02T01:30:41.090256+0000","last_became_active":"2023-12-02T01:30:41.088805+0000","last_became_peered":"2023-12-02T01:30:41.088805+0000","last_unstale":"2023-12-02T01:30:41.090256+0000","last_undegraded":"2023-12-02T01:30:41.090256+0000","last_fullsized":"2023-12-02T01:30:41.090256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:40:13.041462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.074380+0000","last_change":"2023-12-02T01:30:40.083872+0000","last_active":"2023-12-02T01:30:41.074380+0000","last_peered":"2023-12-02T01:30:41.074380+0000","last_clean":"2023-12-02T01:30:41.074380+0000","last_became_active":"2023-12-02T01:30:40.083583+0000","last_became_peered":"2023-12-02T01:30:40.083583+0000","last_unstale":"2023-12-02T01:30:41.074380+0000","last_undegraded":"2023-12-02T01:30:41.074380+0000","last_fullsized":"2023-12-02T01:30:41.074380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:58.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.088592+0000","last_change":"2023-12-02T01:30:41.086059+0000","last_active":"2023-12-02T01:30:41.088592+0000","last_peered":"2023-12-02T01:30:41.088592+0000","last_clean":"2023-12-02T01:30:41.088592+0000","last_became_active":"2023-12-02T01:30:41.085603+0000","last_became_peered":"2023-12-02T01:30:41.085603+0000","last_unstale":"2023-12-02T01:30:41.088592+0000","last_undegraded":"2023-12-02T01:30:41.088592+0000","last_fullsized":"2023-12-02T01:30:41.088592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:05.557203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309940+0000","last_change":"2023-12-02T01:30:40.084168+0000","last_active":"2023-12-02T01:30:41.309940+0000","last_peered":"2023-12-02T01:30:41.309940+0000","last_clean":"2023-12-02T01:30:41.309940+0000","last_became_active":"2023-12-02T01:30:40.083551+0000","last_became_peered":"2023-12-02T01:30:40.083551+0000","last_unstale":"2023-12-02T01:30:41.309940+0000","last_undegraded":"2023-12-02T01:30:41.309940+0000","last_fullsized":"2023-12-02T01:30:41.309940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:30:45.984065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091692+0000","last_change":"2023-12-02T01:30:41.088175+0000","last_active":"2023-12-02T01:30:41.091692+0000","last_peered":"2023-12-02T01:30:41.091692+0000","last_clean":"2023-12-02T01:30:41.091692+0000","last_became_active":"2023-12-02T01:30:41.087897+0000","last_became_peered":"2023-12-02T01:30:41.087897+0000","last_unstale":"2023-12-02T01:30:41.091692+0000","last_undegraded":"2023-12-02T01:30:41.091692+0000","last_fullsized":"2023-12-02T01:30:41.091692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:38.017077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.311325+0000","last_change":"2023-12-02T01:30:40.086406+0000","last_active":"2023-12-02T01:30:41.311325+0000","last_peered":"2023-12-02T01:30:41.311325+0000","last_clean":"2023-12-02T01:30:41.311325+0000","last_became_active":"2023-12-02T01:30:40.086165+0000","last_became_peered":"2023-12-02T01:30:40.086165+0000","last_unstale":"2023-12-02T01:30:41.311325+0000","last_undegraded":"2023-12-02T01:30:41.311325+0000","last_fullsized":"2023-12-02T01:30:41.311325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:53:21.775883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091473+0000","last_change":"2023-12-02T01:30:41.087701+0000","last_active":"2023-12-02T01:30:41.091473+0000","last_peered":"2023-12-02T01:30:41.091473+0000","last_clean":"2023-12-02T01:30:41.091473+0000","last_became_active":"2023-12-02T01:30:41.087428+0000","last_became_peered":"2023-12-02T01:30:41.087428+0000","last_unstale":"2023-12-02T01:30:41.091473+0000","last_undegraded":"2023-12-02T01:30:41.091473+0000","last_fullsized":"2023-12-02T01:30:41.091473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:24:34.210416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309691+0000","last_change":"2023-12-02T01:30:40.079481+0000","last_active":"2023-12-02T01:30:41.309691+0000","last_peered":"2023-12-02T01:30:41.309691+0000","last_clean":"2023-12-02T01:30:41.309691+0000","last_became_active":"2023-12-02T01:30:40.079002+0000","last_became_peered":"2023-12-02T01:30:40.079002+0000","last_unstale":"2023-12-02T01:30:41.309691+0000","last_undegraded":"2023-12-02T01:30:41.309691+0000","last_fullsized":"2023-12-02T01:30:41.309691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:20.522410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082804+0000","last_change":"2023-12-02T01:30:41.078044+0000","last_active":"2023-12-02T01:30:41.082804+0000","last_peered":"2023-12-02T01:30:41.082804+0000","last_clean":"2023-12-02T01:30:41.082804+0000","last_became_active":"2023-12-02T01:30:41.077738+0000","last_became_peered":"2023-12-02T01:30:41.077738+0000","last_unstale":"2023-12-02T01:30:41.082804+0000","last_undegraded":"2023-12-02T01:30:41.082804+0000","last_fullsized":"2023-12-02T01:30:41.082804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:27.439097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082292+0000","last_change":"2023-12-02T01:30:40.078514+0000","last_active":"2023-12-02T01:30:41.082292+0000","last_peered":"2023-12-02T01:30:41.082292+0000","last_clean":"2023-12-02T01:30:41.082292+0000","last_became_active":"2023-12-02T01:30:40.078206+0000","last_became_peered":"2023-12-02T01:30:40.078206+0000","last_unstale":"2023-12-02T01:30:41.082292+0000","last_undegraded":"2023-12-02T01:30:41.082292+0000","last_fullsized":"2023-12-02T01:30:41.082292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:35.855377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092007+0000","last_change":"2023-12-02T01:30:41.087982+0000","last_active":"2023-12-02T01:30:41.092007+0000","last_peered":"2023-12-02T01:30:41.092007+0000","last_clean":"2023-12-02T01:30:41.092007+0000","last_became_active":"2023-12-02T01:30:41.087685+0000","last_became_peered":"2023-12-02T01:30:41.087685+0000","last_unstale":"2023-12-02T01:30:41.092007+0000","last_undegraded":"2023-12-02T01:30:41.092007+0000","last_fullsized":"2023-12-02T01:30:41.092007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:03:44.736803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.068830+0000","last_change":"2023-12-02T01:30:40.082732+0000","last_active":"2023-12-02T01:30:41.068830+0000","last_peered":"2023-12-02T01:30:41.068830+0000","last_clean":"2023-12-02T01:30:41.068830+0000","last_became_active":"2023-12-02T01:30:40.082462+0000","last_became_peered":"2023-12-02T01:30:40.082462+0000","last_unstale":"2023-12-02T01:30:41.068830+0000","last_undegraded":"2023-12-02T01:30:41.068830+0000","last_fullsized":"2023-12-02T01:30:41.068830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:19.462353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086372+0000","last_change":"2023-12-02T01:30:41.084202+0000","last_active":"2023-12-02T01:30:41.086372+0000","last_peered":"2023-12-02T01:30:41.086372+0000","last_clean":"2023-12-02T01:30:41.086372+0000","last_became_active":"2023-12-02T01:30:41.083935+0000","last_became_peered":"2023-12-02T01:30:41.083935+0000","last_unstale":"2023-12-02T01:30:41.086372+0000","last_undegraded":"2023-12-02T01:30:41.086372+0000","last_fullsized":"2023-12-02T01:30:41.086372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:40:17.969654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309038+0000","last_change":"2023-12-02T01:30:40.086970+0000","last_active":"2023-12-02T01:30:41.309038+0000","last_peered":"2023-12-02T01:30:41.309038+0000","last_clean":"2023-12-02T01:30:41.309038+0000","last_became_active":"2023-12-02T01:30:40.086721+0000","last_became_peered":"2023-12-02T01:30:40.086721+0000","last_unstale":"2023-12-02T01:30:41.309038+0000","last_undegraded":"2023-12-02T01:30:41.309038+0000","last_fullsized":"2023-12-02T01:30:41.309038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T12:41:58.898029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.086590+0000","last_change":"2023-12-02T01:30:41.084253+0000","last_active":"2023-12-02T01:30:41.086590+0000","last_peered":"2023-12-02T01:30:41.086590+0000","last_clean":"2023-12-02T01:30:41.086590+0000","last_became_active":"2023-12-02T01:30:41.083982+0000","last_became_peered":"2023-12-02T01:30:41.083982+0000","last_unstale":"2023-12-02T01:30:41.086590+0000","last_undegraded":"2023-12-02T01:30:41.086590+0000","last_fullsized":"2023-12-02T01:30:41.086590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:56:20.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.308609+0000","last_change":"2023-12-02T01:30:40.085100+0000","last_active":"2023-12-02T01:30:41.308609+0000","last_peered":"2023-12-02T01:30:41.308609+0000","last_clean":"2023-12-02T01:30:41.308609+0000","last_became_active":"2023-12-02T01:30:40.084619+0000","last_became_peered":"2023-12-02T01:30:40.084619+0000","last_unstale":"2023-12-02T01:30:41.308609+0000","last_undegraded":"2023-12-02T01:30:41.308609+0000","last_fullsized":"2023-12-02T01:30:41.308609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:20.522410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081533+0000","last_change":"2023-12-02T01:30:41.076902+0000","last_active":"2023-12-02T01:30:41.081533+0000","last_peered":"2023-12-02T01:30:41.081533+0000","last_clean":"2023-12-02T01:30:41.081533+0000","last_became_active":"2023-12-02T01:30:41.076243+0000","last_became_peered":"2023-12-02T01:30:41.076243+0000","last_unstale":"2023-12-02T01:30:41.081533+0000","last_undegraded":"2023-12-02T01:30:41.081533+0000","last_fullsized":"2023-12-02T01:30:41.081533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:27.439097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309622+0000","last_change":"2023-12-02T01:30:40.078956+0000","last_active":"2023-12-02T01:30:41.309622+0000","last_peered":"2023-12-02T01:30:41.309622+0000","last_clean":"2023-12-02T01:30:41.309622+0000","last_became_active":"2023-12-02T01:30:40.078580+0000","last_became_peered":"2023-12-02T01:30:40.078580+0000","last_unstale":"2023-12-02T01:30:41.309622+0000","last_undegraded":"2023-12-02T01:30:41.309622+0000","last_fullsized":"2023-12-02T01:30:41.309622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:35.855377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089886+0000","last_change":"2023-12-02T01:30:41.085995+0000","last_active":"2023-12-02T01:30:41.089886+0000","last_peered":"2023-12-02T01:30:41.089886+0000","last_clean":"2023-12-02T01:30:41.089886+0000","last_became_active":"2023-12-02T01:30:41.085506+0000","last_became_peered":"2023-12-02T01:30:41.085506+0000","last_unstale":"2023-12-02T01:30:41.089886+0000","last_undegraded":"2023-12-02T01:30:41.089886+0000","last_fullsized":"2023-12-02T01:30:41.089886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:37.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306417+0000","last_change":"2023-12-02T01:30:40.080592+0000","last_active":"2023-12-02T01:30:41.306417+0000","last_peered":"2023-12-02T01:30:41.306417+0000","last_clean":"2023-12-02T01:30:41.306417+0000","last_became_active":"2023-12-02T01:30:40.080325+0000","last_became_peered":"2023-12-02T01:30:40.080325+0000","last_unstale":"2023-12-02T01:30:41.306417+0000","last_undegraded":"2023-12-02T01:30:41.306417+0000","last_fullsized":"2023-12-02T01:30:41.306417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:18.161466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082367+0000","last_change":"2023-12-02T01:30:41.081407+0000","last_active":"2023-12-02T01:30:41.082367+0000","last_peered":"2023-12-02T01:30:41.082367+0000","last_clean":"2023-12-02T01:30:41.082367+0000","last_became_active":"2023-12-02T01:30:41.081094+0000","last_became_peered":"2023-12-02T01:30:41.081094+0000","last_unstale":"2023-12-02T01:30:41.082367+0000","last_undegraded":"2023-12-02T01:30:41.082367+0000","last_fullsized":"2023-12-02T01:30:41.082367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:37:00.206137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071636+0000","last_change":"2023-12-02T01:30:40.079208+0000","last_active":"2023-12-02T01:30:41.071636+0000","last_peered":"2023-12-02T01:30:41.071636+0000","last_clean":"2023-12-02T01:30:41.071636+0000","last_became_active":"2023-12-02T01:30:40.078890+0000","last_became_peered":"2023-12-02T01:30:40.078890+0000","last_unstale":"2023-12-02T01:30:41.071636+0000","last_undegraded":"2023-12-02T01:30:41.071636+0000","last_fullsized":"2023-12-02T01:30:41.071636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:24:33.206258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.081775+0000","last_change":"2023-12-02T01:30:41.079983+0000","last_active":"2023-12-02T01:30:41.081775+0000","last_peered":"2023-12-02T01:30:41.081775+0000","last_clean":"2023-12-02T01:30:41.081775+0000","last_became_active":"2023-12-02T01:30:41.079572+0000","last_became_peered":"2023-12-02T01:30:41.079572+0000","last_unstale":"2023-12-02T01:30:41.081775+0000","last_undegraded":"2023-12-02T01:30:41.081775+0000","last_fullsized":"2023-12-02T01:30:41.081775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:58:37.363369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.306773+0000","last_change":"2023-12-02T01:30:40.077560+0000","last_active":"2023-12-02T01:30:41.306773+0000","last_peered":"2023-12-02T01:30:41.306773+0000","last_clean":"2023-12-02T01:30:41.306773+0000","last_became_active":"2023-12-02T01:30:40.077273+0000","last_became_peered":"2023-12-02T01:30:40.077273+0000","last_unstale":"2023-12-02T01:30:41.306773+0000","last_undegraded":"2023-12-02T01:30:41.306773+0000","last_fullsized":"2023-12-02T01:30:41.306773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.080472+0000","last_change":"2023-12-02T01:30:41.079140+0000","last_active":"2023-12-02T01:30:41.080472+0000","last_peered":"2023-12-02T01:30:41.080472+0000","last_clean":"2023-12-02T01:30:41.080472+0000","last_became_active":"2023-12-02T01:30:41.078814+0000","last_became_peered":"2023-12-02T01:30:41.078814+0000","last_unstale":"2023-12-02T01:30:41.080472+0000","last_undegraded":"2023-12-02T01:30:41.080472+0000","last_fullsized":"2023-12-02T01:30:41.080472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:02:49.031643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.076576+0000","last_change":"2023-12-02T01:30:40.085070+0000","last_active":"2023-12-02T01:30:41.076576+0000","last_peered":"2023-12-02T01:30:41.076576+0000","last_clean":"2023-12-02T01:30:41.076576+0000","last_became_active":"2023-12-02T01:30:40.084505+0000","last_became_peered":"2023-12-02T01:30:40.084505+0000","last_unstale":"2023-12-02T01:30:41.076576+0000","last_undegraded":"2023-12-02T01:30:41.076576+0000","last_fullsized":"2023-12-02T01:30:41.076576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:12.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.078671+0000","last_change":"2023-12-02T01:30:41.077636+0000","last_active":"2023-12-02T01:30:41.078671+0000","last_peered":"2023-12-02T01:30:41.078671+0000","last_clean":"2023-12-02T01:30:41.078671+0000","last_became_active":"2023-12-02T01:30:41.077339+0000","last_became_peered":"2023-12-02T01:30:41.077339+0000","last_unstale":"2023-12-02T01:30:41.078671+0000","last_undegraded":"2023-12-02T01:30:41.078671+0000","last_fullsized":"2023-12-02T01:30:41.078671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:39.514010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071902+0000","last_change":"2023-12-02T01:30:40.080444+0000","last_active":"2023-12-02T01:30:41.071902+0000","last_peered":"2023-12-02T01:30:41.071902+0000","last_clean":"2023-12-02T01:30:41.071902+0000","last_became_active":"2023-12-02T01:30:40.080193+0000","last_became_peered":"2023-12-02T01:30:40.080193+0000","last_unstale":"2023-12-02T01:30:41.071902+0000","last_undegraded":"2023-12-02T01:30:41.071902+0000","last_fullsized":"2023-12-02T01:30:41.071902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:36.048160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.092029+0000","last_change":"2023-12-02T01:30:41.087370+0000","last_active":"2023-12-02T01:30:41.092029+0000","last_peered":"2023-12-02T01:30:41.092029+0000","last_clean":"2023-12-02T01:30:41.092029+0000","last_became_active":"2023-12-02T01:30:41.087061+0000","last_became_peered":"2023-12-02T01:30:41.087061+0000","last_unstale":"2023-12-02T01:30:41.092029+0000","last_undegraded":"2023-12-02T01:30:41.092029+0000","last_fullsized":"2023-12-02T01:30:41.092029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:21.526568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.070615+0000","last_change":"2023-12-02T01:30:40.085755+0000","last_active":"2023-12-02T01:30:41.070615+0000","last_peered":"2023-12-02T01:30:41.070615+0000","last_clean":"2023-12-02T01:30:41.070615+0000","last_became_active":"2023-12-02T01:30:40.085429+0000","last_became_peered":"2023-12-02T01:30:40.085429+0000","last_unstale":"2023-12-02T01:30:41.070615+0000","last_undegraded":"2023-12-02T01:30:41.070615+0000","last_fullsized":"2023-12-02T01:30:41.070615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:51:20.522410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082426+0000","last_change":"2023-12-02T01:30:41.080648+0000","last_active":"2023-12-02T01:30:41.082426+0000","last_peered":"2023-12-02T01:30:41.082426+0000","last_clean":"2023-12-02T01:30:41.082426+0000","last_became_active":"2023-12-02T01:30:41.080383+0000","last_became_peered":"2023-12-02T01:30:41.080383+0000","last_unstale":"2023-12-02T01:30:41.082426+0000","last_undegraded":"2023-12-02T01:30:41.082426+0000","last_fullsized":"2023-12-02T01:30:41.082426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:07:15.367128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.309750+0000","last_change":"2023-12-02T01:30:40.087180+0000","last_active":"2023-12-02T01:30:41.309750+0000","last_peered":"2023-12-02T01:30:41.309750+0000","last_clean":"2023-12-02T01:30:41.309750+0000","last_became_active":"2023-12-02T01:30:40.086537+0000","last_became_peered":"2023-12-02T01:30:40.086537+0000","last_unstale":"2023-12-02T01:30:41.309750+0000","last_undegraded":"2023-12-02T01:30:41.309750+0000","last_fullsized":"2023-12-02T01:30:41.309750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:58:26.434940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.091731+0000","last_change":"2023-12-02T01:30:41.088747+0000","last_active":"2023-12-02T01:30:41.091731+0000","last_peered":"2023-12-02T01:30:41.091731+0000","last_clean":"2023-12-02T01:30:41.091731+0000","last_became_active":"2023-12-02T01:30:41.088493+0000","last_became_peered":"2023-12-02T01:30:41.088493+0000","last_unstale":"2023-12-02T01:30:41.091731+0000","last_undegraded":"2023-12-02T01:30:41.091731+0000","last_fullsized":"2023-12-02T01:30:41.091731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:53:22.780041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.074516+0000","last_change":"2023-12-02T01:30:40.078488+0000","last_active":"2023-12-02T01:30:41.074516+0000","last_peered":"2023-12-02T01:30:41.074516+0000","last_clean":"2023-12-02T01:30:41.074516+0000","last_became_active":"2023-12-02T01:30:40.078216+0000","last_became_peered":"2023-12-02T01:30:40.078216+0000","last_unstale":"2023-12-02T01:30:41.074516+0000","last_undegraded":"2023-12-02T01:30:41.074516+0000","last_fullsized":"2023-12-02T01:30:41.074516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:35.855377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089704+0000","last_change":"2023-12-02T01:30:41.087746+0000","last_active":"2023-12-02T01:30:41.089704+0000","last_peered":"2023-12-02T01:30:41.089704+0000","last_clean":"2023-12-02T01:30:41.089704+0000","last_became_active":"2023-12-02T01:30:41.087357+0000","last_became_peered":"2023-12-02T01:30:41.087357+0000","last_unstale":"2023-12-02T01:30:41.089704+0000","last_undegraded":"2023-12-02T01:30:41.089704+0000","last_fullsized":"2023-12-02T01:30:41.089704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:57.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082396+0000","last_change":"2023-12-02T01:30:40.080863+0000","last_active":"2023-12-02T01:30:41.082396+0000","last_peered":"2023-12-02T01:30:41.082396+0000","last_clean":"2023-12-02T01:30:41.082396+0000","last_became_active":"2023-12-02T01:30:40.080606+0000","last_became_peered":"2023-12-02T01:30:40.080606+0000","last_unstale":"2023-12-02T01:30:41.082396+0000","last_undegraded":"2023-12-02T01:30:41.082396+0000","last_fullsized":"2023-12-02T01:30:41.082396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:04.553045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.084928+0000","last_change":"2023-12-02T01:30:41.082492+0000","last_active":"2023-12-02T01:30:41.084928+0000","last_peered":"2023-12-02T01:30:41.084928+0000","last_clean":"2023-12-02T01:30:41.084928+0000","last_became_active":"2023-12-02T01:30:41.081806+0000","last_became_peered":"2023-12-02T01:30:41.081806+0000","last_unstale":"2023-12-02T01:30:41.084928+0000","last_undegraded":"2023-12-02T01:30:41.084928+0000","last_fullsized":"2023-12-02T01:30:41.084928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:23:37.052317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.075880+0000","last_change":"2023-12-02T01:30:40.082618+0000","last_active":"2023-12-02T01:30:41.075880+0000","last_peered":"2023-12-02T01:30:41.075880+0000","last_clean":"2023-12-02T01:30:41.075880+0000","last_became_active":"2023-12-02T01:30:40.082269+0000","last_became_peered":"2023-12-02T01:30:40.082269+0000","last_unstale":"2023-12-02T01:30:41.075880+0000","last_undegraded":"2023-12-02T01:30:41.075880+0000","last_fullsized":"2023-12-02T01:30:41.075880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:04.553045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082226+0000","last_change":"2023-12-02T01:30:41.081659+0000","last_active":"2023-12-02T01:30:41.082226+0000","last_peered":"2023-12-02T01:30:41.082226+0000","last_clean":"2023-12-02T01:30:41.082226+0000","last_became_active":"2023-12-02T01:30:41.081345+0000","last_became_peered":"2023-12-02T01:30:41.081345+0000","last_unstale":"2023-12-02T01:30:41.082226+0000","last_undegraded":"2023-12-02T01:30:41.082226+0000","last_fullsized":"2023-12-02T01:30:41.082226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:13.705046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.082360+0000","last_change":"2023-12-02T01:30:40.087224+0000","last_active":"2023-12-02T01:30:41.082360+0000","last_peered":"2023-12-02T01:30:41.082360+0000","last_clean":"2023-12-02T01:30:41.082360+0000","last_became_active":"2023-12-02T01:30:40.086403+0000","last_became_peered":"2023-12-02T01:30:40.086403+0000","last_unstale":"2023-12-02T01:30:41.082360+0000","last_undegraded":"2023-12-02T01:30:41.082360+0000","last_fullsized":"2023-12-02T01:30:41.082360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.089435+0000","last_change":"2023-12-02T01:30:41.087193+0000","last_active":"2023-12-02T01:30:41.089435+0000","last_peered":"2023-12-02T01:30:41.089435+0000","last_clean":"2023-12-02T01:30:41.089435+0000","last_became_active":"2023-12-02T01:30:41.086897+0000","last_became_peered":"2023-12-02T01:30:41.086897+0000","last_unstale":"2023-12-02T01:30:41.089435+0000","last_undegraded":"2023-12-02T01:30:41.089435+0000","last_fullsized":"2023-12-02T01:30:41.089435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:34:36.859534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.071955+0000","last_change":"2023-12-02T01:30:40.083309+0000","last_active":"2023-12-02T01:30:41.071955+0000","last_peered":"2023-12-02T01:30:41.071955+0000","last_clean":"2023-12-02T01:30:41.071955+0000","last_became_active":"2023-12-02T01:30:40.083006+0000","last_became_peered":"2023-12-02T01:30:40.083006+0000","last_unstale":"2023-12-02T01:30:41.071955+0000","last_undegraded":"2023-12-02T01:30:41.071955+0000","last_fullsized":"2023-12-02T01:30:41.071955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:45:12.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.085289+0000","last_change":"2023-12-02T01:30:41.082696+0000","last_active":"2023-12-02T01:30:41.085289+0000","last_peered":"2023-12-02T01:30:41.085289+0000","last_clean":"2023-12-02T01:30:41.085289+0000","last_became_active":"2023-12-02T01:30:41.082408+0000","last_became_peered":"2023-12-02T01:30:41.082408+0000","last_unstale":"2023-12-02T01:30:41.085289+0000","last_undegraded":"2023-12-02T01:30:41.085289+0000","last_fullsized":"2023-12-02T01:30:41.085289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:40:17.969654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.069031+0000","last_change":"2023-12-02T01:30:40.081443+0000","last_active":"2023-12-02T01:30:41.069031+0000","last_peered":"2023-12-02T01:30:41.069031+0000","last_clean":"2023-12-02T01:30:41.069031+0000","last_became_active":"2023-12-02T01:30:40.081164+0000","last_became_peered":"2023-12-02T01:30:40.081164+0000","last_unstale":"2023-12-02T01:30:41.069031+0000","last_undegraded":"2023-12-02T01:30:41.069031+0000","last_fullsized":"2023-12-02T01:30:41.069031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:27:08.496655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.094615+0000","last_change":"2023-12-02T01:30:41.091101+0000","last_active":"2023-12-02T01:30:41.094615+0000","last_peered":"2023-12-02T01:30:41.094615+0000","last_clean":"2023-12-02T01:30:41.094615+0000","last_became_active":"2023-12-02T01:30:41.090786+0000","last_became_peered":"2023-12-02T01:30:41.090786+0000","last_unstale":"2023-12-02T01:30:41.094615+0000","last_undegraded":"2023-12-02T01:30:41.094615+0000","last_fullsized":"2023-12-02T01:30:41.094615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:40.060478+0000","last_clean_scrub_stamp":"2023-12-02T01:30:40.060478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:04:13.587931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-02T01:30:41.076001+0000","last_change":"2023-12-02T01:30:40.082662+0000","last_active":"2023-12-02T01:30:41.076001+0000","last_peered":"2023-12-02T01:30:41.076001+0000","last_clean":"2023-12-02T01:30:41.076001+0000","last_became_active":"2023-12-02T01:30:40.082337+0000","last_became_peered":"2023-12-02T01:30:40.082337+0000","last_unstale":"2023-12-02T01:30:41.076001+0000","last_undegraded":"2023-12-02T01:30:41.076001+0000","last_fullsized":"2023-12-02T01:30:41.076001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:30:39.056321+0000","last_clean_scrub_stamp":"2023-12-02T01:30:39.056321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:31:08.908395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-02T01:30:40.075935+0000","last_change":"2023-12-02T01:29:33.915833+0000","last_active":"2023-12-02T01:30:40.075935+0000","last_peered":"2023-12-02T01:30:40.075935+0000","last_clean":"2023-12-02T01:30:40.075935+0000","last_became_active":"2023-12-02T01:29:33.915012+0000","last_became_peered":"2023-12-02T01:29:33.915012+0000","last_unstale":"2023-12-02T01:30:40.075935+0000","last_undegraded":"2023-12-02T01:30:40.075935+0000","last_fullsized":"2023-12-02T01:30:40.075935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-02T01:29:32.688531+0000","last_clean_scrub_stamp":"2023-12-02T01:29:32.688531+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:25:40.082821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":954368,"data_stored":730660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.378}]},{"osd":5,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.44},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.495},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.503},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.627},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Dec 2 01:30:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":140396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52200000000000002}]},{"osd":2,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.80100000000000005}]},{"osd":5,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70899999999999996}]},{"osd":7,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.432}]},{"osd":2,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.88800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":133517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.252},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Sat Dec 2 01:30:34 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.315},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.33200000000000002}]},{"osd":4,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Dec 2 01:30:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":954368,"data_stored":730660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.318},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.373}]},{"osd":4,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.501}]},{"osd":7,"last update":"Sat Dec 2 01:30:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-02T01:30:44.649 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-02T01:30:44.650 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-02T01:30:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.797+0000 7fd8fef41640 1 Processor -- start 2023-12-02T01:30:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.797+0000 7fd8fef41640 1 -- start start 2023-12-02T01:30:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8fef41640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815e810 0x7fd8f80ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8fef41640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd8f80cd540 0x7fd8f809a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8fef41640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f80cd170 con 0x7fd8f815ebf0 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8fef41640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f80b2260 con 0x7fd8f80cd540 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8fef41640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80b37b0 con 0x7fd8f815e810 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8fccdd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815e810 0x7fd8f80ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8fd4de640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd8f80cd540 0x7fd8f809a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8f7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd8f815ebf0 0x7fd8f8099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.1:38788/0 (socket says 172.21.15.1:38788) 2023-12-02T01:30:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.798+0000 7fd8f7fff640 1 -- 172.21.15.1:0/1731685869 learned_addr learned my addr 172.21.15.1:0/1731685869 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.799+0000 7fd8fd4de640 1 -- 172.21.15.1:0/1731685869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815e810 msgr2=0x7fd8f80ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.799+0000 7fd8fd4de640 1 --2- 172.21.15.1:0/1731685869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815e810 0x7fd8f80ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.799+0000 7fd8fd4de640 1 -- 172.21.15.1:0/1731685869 >> v1:172.21.15.167:6789/0 conn(0x7fd8f815ebf0 legacy=0x7fd8f8099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.799+0000 7fd8fd4de640 1 -- 172.21.15.1:0/1731685869 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f80cc720 con 0x7fd8f80cd540 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.799+0000 7fd8fd4de640 1 --2- 172.21.15.1:0/1731685869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f80cd540 0x7fd8f809a080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009d90 tx=0x7fd8f002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34c97c885d34528 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8f77fe640 1 -- 172.21.15.1:0/1731685869 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f002cc50 con 0x7fd8f80cd540 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8f77fe640 1 -- 172.21.15.1:0/1731685869 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f002cdb0 con 0x7fd8f80cd540 2023-12-02T01:30:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8f77fe640 1 -- 172.21.15.1:0/1731685869 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0034660 con 0x7fd8f80cd540 2023-12-02T01:30:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 -- 172.21.15.1:0/1731685869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f80cd540 msgr2=0x7fd8f809a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 --2- 172.21.15.1:0/1731685869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f80cd540 0x7fd8f809a080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009d90 tx=0x7fd8f002bea0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 -- 172.21.15.1:0/1731685869 shutdown_connections 2023-12-02T01:30:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 --2- 172.21.15.1:0/1731685869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f80cd540 0x7fd8f809a080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 --2- 172.21.15.1:0/1731685869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815e810 0x7fd8f80ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 -- 172.21.15.1:0/1731685869 >> 172.21.15.1:0/1731685869 conn(0x7fd8f80b2a70 msgr2=0x7fd8f80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 -- 172.21.15.1:0/1731685869 shutdown_connections 2023-12-02T01:30:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.800+0000 7fd8fef41640 1 -- 172.21.15.1:0/1731685869 wait complete. 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.801+0000 7fd8fef41640 1 Processor -- start 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.801+0000 7fd8fef41640 1 -- start start 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fef41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f80cd540 0x7fd8f80b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fef41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f815e810 0x7fd8f8159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fef41640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815ebf0 0x7fd8f806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fef41640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f815ab30 con 0x7fd8f80cd540 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fef41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f806c9c0 con 0x7fd8f815e810 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fef41640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80b65b0 con 0x7fd8f815ebf0 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fccdd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f80cd540 0x7fd8f80b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fccdd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f80cd540 0x7fd8f80b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45120/0 (socket says 172.21.15.1:45120) 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8fccdd640 1 -- 172.21.15.1:0/3644481297 learned_addr learned my addr 172.21.15.1:0/3644481297 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.802+0000 7fd8f7fff640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f815e810 0x7fd8f8159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.805 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fd4de640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815ebf0 0x7fd8f806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fccdd640 1 -- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815ebf0 msgr2=0x7fd8f806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fccdd640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815ebf0 0x7fd8f806ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fccdd640 1 -- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f815e810 msgr2=0x7fd8f8159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fccdd640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f815e810 0x7fd8f8159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fccdd640 1 -- 172.21.15.1:0/3644481297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0009a70 con 0x7fd8f80cd540 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fccdd640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f80cd540 0x7fd8f80b6070 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e9b0 tx=0x7fd8ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8f57fa640 1 -- 172.21.15.1:0/3644481297 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec009670 con 0x7fd8f80cd540 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8f57fa640 1 -- 172.21.15.1:0/3644481297 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00c9a0 con 0x7fd8f80cd540 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8f57fa640 1 -- 172.21.15.1:0/3644481297 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00cd50 con 0x7fd8f80cd540 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f806c090 con 0x7fd8f80cd540 2023-12-02T01:30:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.803+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f806c650 con 0x7fd8f80cd540 2023-12-02T01:30:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.804+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f8067940 con 0x7fd8f80cd540 2023-12-02T01:30:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.805+0000 7fd8f57fa640 1 -- 172.21.15.1:0/3644481297 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8ec013470 con 0x7fd8f80cd540 2023-12-02T01:30:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.805+0000 7fd8f57fa640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd8dc06ae40 0x7fd8dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.805+0000 7fd8f57fa640 1 -- 172.21.15.1:0/3644481297 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8ec0898c0 con 0x7fd8f80cd540 2023-12-02T01:30:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.805+0000 7fd8f7fff640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd8dc06ae40 0x7fd8dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.806+0000 7fd8f7fff640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd8dc06ae40 0x7fd8dc06d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8f806bfc0 tx=0x7fd8e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:44.811 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:44.809+0000 7fd8f57fa640 1 -- 172.21.15.1:0/3644481297 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8ec054910 con 0x7fd8f80cd540 2023-12-02T01:30:45.053 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.052+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd8f809ef40 con 0x7fd8f80cd540 2023-12-02T01:30:45.055 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.054+0000 7fd8f57fa640 1 -- 172.21.15.1:0/3644481297 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd8ec0170b0 con 0x7fd8f80cd540 2023-12-02T01:30:45.055 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2023-12-02T01:30:45.055 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBQiGplxfg6MRAA+vtsoFgV7M1UyKLtt5Ugrw== 2023-12-02T01:30:45.056 INFO:teuthology.orchestra.run.smithi001.stdout: caps mds = "allow" 2023-12-02T01:30:45.056 INFO:teuthology.orchestra.run.smithi001.stdout: caps mon = "allow r" 2023-12-02T01:30:45.056 INFO:teuthology.orchestra.run.smithi001.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-02T01:30:45.056 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd8dc06ae40 msgr2=0x7fd8dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd8dc06ae40 0x7fd8dc06d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8f806bfc0 tx=0x7fd8e4009040 comp rx=0 tx=0).stop 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f80cd540 msgr2=0x7fd8f80b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f80cd540 0x7fd8f80b6070 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e9b0 tx=0x7fd8ec00ee70 comp rx=0 tx=0).stop 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 shutdown_connections 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8f815ebf0 0x7fd8f806ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fd8dc06ae40 0x7fd8dc06d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8f815e810 0x7fd8f8159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 --2- 172.21.15.1:0/3644481297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f80cd540 0x7fd8f80b6070 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.058 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 >> 172.21.15.1:0/3644481297 conn(0x7fd8f80b2a70 msgr2=0x7fd8f815d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 shutdown_connections 2023-12-02T01:30:45.059 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.056+0000 7fd8fef41640 1 -- 172.21.15.1:0/3644481297 wait complete. 2023-12-02T01:30:45.069 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-02T01:30:45.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.174+0000 7fa6c6ae5640 1 Processor -- start 2023-12-02T01:30:45.175 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.174+0000 7fa6c6ae5640 1 -- start start 2023-12-02T01:30:45.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6c6ae5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 0x7fa6c0099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6c6ae5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c00b0660 con 0x7fa6c00b1de0 2023-12-02T01:30:45.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6c6ae5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c00cfca0 con 0x7fa6c00b2610 2023-12-02T01:30:45.178 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6c6ae5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c006c900 con 0x7fa6c015d900 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6c5082640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa6c00b1de0 0x7fa6c00cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35890/0 (socket says 172.21.15.1:35890) 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6c5082640 1 -- 172.21.15.1:0/1208696258 learned_addr learned my addr 172.21.15.1:0/1208696258 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6c4881640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 0x7fa6c0099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825350257 0 0) 0x7fa6c00b0660 con 0x7fa6c00b1de0 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b0003520 con 0x7fa6c00b1de0 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3504499219 0 0) 0x7fa6b0003520 con 0x7fa6c00b1de0 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 msgr2=0x7fa6c0099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 0x7fa6c0099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 >> v1:172.21.15.167:6789/0 conn(0x7fa6c00b2610 legacy=0x7fa6c00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c006cbe0 con 0x7fa6c00b1de0 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7fa6b80019f0 con 0x7fa6c00b1de0 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 >> v1:172.21.15.1:6789/0 conn(0x7fa6c00b1de0 legacy=0x7fa6c00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.179 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 0x7fa6b00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.175+0000 7fa6bf7fe640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bf7fe640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6b0004d00 0x7fa6b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c006c900 con 0x7fa6b0003ee0 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b000b9e0 con 0x7fa6b0004d00 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b000bba0 con 0x7fa6c015d900 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bffff640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6c4881640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 0x7fa6b00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6c5082640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6b0004d00 0x7fa6b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bffff640 1 -- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 msgr2=0x7fa6b00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bffff640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015d900 0x7fa6b00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.180 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bffff640 1 -- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6b0004d00 msgr2=0x7fa6b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bffff640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6b0004d00 0x7fa6b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.176+0000 7fa6bffff640 1 -- 172.21.15.1:0/1208696258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b0003520 con 0x7fa6b0003ee0 2023-12-02T01:30:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6bffff640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6b00047c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac001830 tx=0x7fa6b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535545cc395f2eb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac032600 con 0x7fa6b0003ee0 2023-12-02T01:30:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac02e050 con 0x7fa6b0003ee0 2023-12-02T01:30:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6bf7fe640 1 -- 172.21.15.1:0/1208696258 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac0329c0 con 0x7fa6b0003ee0 2023-12-02T01:30:45.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/1208696258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 msgr2=0x7fa6b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6c6ae5640 1 --2- 172.21.15.1:0/1208696258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6b00047c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac001830 tx=0x7fa6b00057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6c5082640 1 -- 172.21.15.1:0/1208696258 reap_dead start 2023-12-02T01:30:45.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/1208696258 shutdown_connections 2023-12-02T01:30:45.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/1208696258 >> 172.21.15.1:0/1208696258 conn(0x7fa6c00b2a70 msgr2=0x7fa6c00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/1208696258 shutdown_connections 2023-12-02T01:30:45.185 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.177+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/1208696258 wait complete. 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.179+0000 7fa6c6ae5640 1 Processor -- start 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.179+0000 7fa6c6ae5640 1 -- start start 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6c00c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6c00ca750 0x7fa6c00c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015bdb0 0x7fa6c015c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c015c770 con 0x7fa6b0003ee0 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00b41a0 con 0x7fa6c00ca750 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c015f980 con 0x7fa6c015bdb0 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6c00c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.186 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6c00c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45142/0 (socket says 172.21.15.1:45142) 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 -- 172.21.15.1:0/3568201089 learned_addr learned my addr 172.21.15.1:0/3568201089 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c5082640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015bdb0 0x7fa6c015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6bffff640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6c00ca750 0x7fa6c00c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 -- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015bdb0 msgr2=0x7fa6c015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015bdb0 0x7fa6c015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 -- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6c00ca750 msgr2=0x7fa6c00c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6c00ca750 0x7fa6c00c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 -- 172.21.15.1:0/3568201089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00ca330 con 0x7fa6b0003ee0 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c5082640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015bdb0 0x7fa6c015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6bffff640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6c00ca750 0x7fa6c00c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c4881640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6c00c8050 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40119d0 tx=0x7fa6b4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6bd7fa640 1 -- 172.21.15.1:0/3568201089 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400faf0 con 0x7fa6b0003ee0 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6bd7fa640 1 -- 172.21.15.1:0/3568201089 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b400fc50 con 0x7fa6b0003ee0 2023-12-02T01:30:45.187 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c00b3ec0 con 0x7fa6b0003ee0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6bd7fa640 1 -- 172.21.15.1:0/3568201089 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4014440 con 0x7fa6b0003ee0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.180+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c015f610 con 0x7fa6b0003ee0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.181+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c006f6a0 con 0x7fa6b0003ee0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.182+0000 7fa6bd7fa640 1 -- 172.21.15.1:0/3568201089 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6b40145a0 con 0x7fa6b0003ee0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.182+0000 7fa6bd7fa640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6a406ae40 0x7fa6a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.182+0000 7fa6bd7fa640 1 -- 172.21.15.1:0/3568201089 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6b4089f40 con 0x7fa6b0003ee0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.182+0000 7fa6bffff640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6a406ae40 0x7fa6a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.183+0000 7fa6bffff640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6a406ae40 0x7fa6a406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac035000 tx=0x7fa6ac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.188 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.186+0000 7fa6bd7fa640 1 -- 172.21.15.1:0/3568201089 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6b4055080 con 0x7fa6b0003ee0 2023-12-02T01:30:45.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.398+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6c0067420 con 0x7fa6b0003ee0 2023-12-02T01:30:45.400 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.399+0000 7fa6bd7fa640 1 -- 172.21.15.1:0/3568201089 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4909 (secure 0 0 0) 0x7fa6b40586a0 con 0x7fa6b0003ee0 2023-12-02T01:30:45.401 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:45.401 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/3640152227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":3640152227},{"type":"v1","addr":"172.21.15.167:6834","nonce":3640152227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/902530140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":902530140},{"type":"v1","addr":"172.21.15.167:6835","nonce":902530140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6836/3111515180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3111515180},{"type":"v1","addr":"172.21.15.1:6836","nonce":3111515180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-02T01:30:40.439691+0000","modified":"2023-12-02T01:30:42.648664+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5316":{"gid":5316,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6837/4089525820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6835","nonce":4089525820},{"type":"v1","addr":"172.21.15.1:6837","nonce":4089525820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-02T01:30:45.401 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2023-12-02T01:30:45.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6a406ae40 msgr2=0x7fa6a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.402 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6a406ae40 0x7fa6a406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac035000 tx=0x7fa6ac030000 comp rx=0 tx=0).stop 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 msgr2=0x7fa6c00c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6c00c8050 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40119d0 tx=0x7fa6b4011e90 comp rx=0 tx=0).stop 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 shutdown_connections 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6c015bdb0 0x7fa6c015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7fa6a406ae40 0x7fa6a406d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6c00ca750 0x7fa6c00c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 --2- 172.21.15.1:0/3568201089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6b0003ee0 0x7fa6c00c8050 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 >> 172.21.15.1:0/3568201089 conn(0x7fa6c00b2a70 msgr2=0x7fa6c0099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 shutdown_connections 2023-12-02T01:30:45.403 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.401+0000 7fa6c6ae5640 1 -- 172.21.15.1:0/3568201089 wait complete. 2023-12-02T01:30:45.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-02T01:30:40.439691+0000', 'modified': '2023-12-02T01:30:42.648664+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5316}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5316': {'gid': 5316, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6837/4089525820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6835', 'nonce': 4089525820}, {'type': 'v1', 'addr': '172.21.15.1:6837', 'nonce': 4089525820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-02T01:30:45.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-02T01:30:45.816 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-02T01:30:45.927 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:30:45.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.927+0000 7f10d40d0640 1 Processor -- start 2023-12-02T01:30:45.929 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.927+0000 7f10d40d0640 1 -- start start 2023-12-02T01:30:45.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:30:45.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d40d0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f10cc0b6b50 0x7f10cc0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.932 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d40d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d40d0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc0b3590 con 0x7f10cc0cc390 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d40d0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc06b310 con 0x7f10cc0b6b50 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d40d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc09a2d0 con 0x7f10cc099970 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d1e6c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f10cc0b6b50 0x7f10cc0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d1e6c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f10cc0b6b50 0x7f10cc0cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45154/0 (socket says 172.21.15.1:45154) 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d266d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f10cc0cc390 0x7f10cc0cc840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35896/0 (socket says 172.21.15.1:35896) 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d1e6c640 1 -- 172.21.15.1:0/3177993185 learned_addr learned my addr 172.21.15.1:0/3177993185 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.928+0000 7f10d166b640 1 --2- 172.21.15.1:0/3177993185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.929+0000 7f10d1e6c640 1 -- 172.21.15.1:0/3177993185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 msgr2=0x7f10cc099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.933 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.929+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/3177993185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.929+0000 7f10d1e6c640 1 -- 172.21.15.1:0/3177993185 >> v1:172.21.15.1:6789/0 conn(0x7f10cc0cc390 legacy=0x7f10cc0cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.929+0000 7f10d0e6a640 1 -- 172.21.15.1:0/3177993185 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103763427 0 0) 0x7f10cc0b3590 con 0x7f10cc0cc390 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.929+0000 7f10d1e6c640 1 -- 172.21.15.1:0/3177993185 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0b37c0 con 0x7f10cc0b6b50 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.929+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/3177993185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0cfd40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009870 tx=0x7f10c802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3797f8dad71a0b server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d0e6a640 1 -- 172.21.15.1:0/3177993185 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c802f840 con 0x7f10cc0b6b50 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d0e6a640 1 -- 172.21.15.1:0/3177993185 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c802f9a0 con 0x7f10cc0b6b50 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d0e6a640 1 -- 172.21.15.1:0/3177993185 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c802fd30 con 0x7f10cc0b6b50 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 -- 172.21.15.1:0/3177993185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 msgr2=0x7f10cc0cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 --2- 172.21.15.1:0/3177993185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0cfd40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009870 tx=0x7f10c802ba20 comp rx=0 tx=0).stop 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 -- 172.21.15.1:0/3177993185 shutdown_connections 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 --2- 172.21.15.1:0/3177993185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.934 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 --2- 172.21.15.1:0/3177993185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0cfd40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 -- 172.21.15.1:0/3177993185 >> 172.21.15.1:0/3177993185 conn(0x7f10cc0b2a70 msgr2=0x7f10cc0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 -- 172.21.15.1:0/3177993185 shutdown_connections 2023-12-02T01:30:45.935 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.930+0000 7f10d40d0640 1 -- 172.21.15.1:0/3177993185 wait complete. 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.931+0000 7f10d40d0640 1 Processor -- start 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.931+0000 7f10d40d0640 1 -- start start 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d40d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d40d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d40d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cc390 0x7f10cc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d40d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c4c30 con 0x7f10cc0b6b50 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d40d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c4f10 con 0x7f10cc0cc390 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d40d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c51f0 con 0x7f10cc099970 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d166b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.941 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d166b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45170/0 (socket says 172.21.15.1:45170) 2023-12-02T01:30:45.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.932+0000 7f10d166b640 1 -- 172.21.15.1:0/469716678 learned_addr learned my addr 172.21.15.1:0/469716678 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:45.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d266d640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cc390 0x7f10cc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d166b640 1 -- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 msgr2=0x7f10cc158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d166b640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d166b640 1 -- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cc390 msgr2=0x7f10cc0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.942 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d166b640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cc390 0x7f10cc0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d166b640 1 -- 172.21.15.1:0/469716678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80094d0 con 0x7f10cc0b6b50 2023-12-02T01:30:45.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:45.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d266d640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cc390 0x7f10cc0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:30:45.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d166b640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0c7110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00d7d0 tx=0x7f10bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10c27fc640 1 -- 172.21.15.1:0/469716678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00b6c0 con 0x7f10cc0b6b50 2023-12-02T01:30:45.943 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10c27fc640 1 -- 172.21.15.1:0/469716678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00b820 con 0x7f10cc0b6b50 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10c27fc640 1 -- 172.21.15.1:0/469716678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00bbb0 con 0x7f10cc0b6b50 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc0c54d0 con 0x7f10cc0b6b50 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.933+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc0c7650 con 0x7f10cc0b6b50 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.935+0000 7f10c27fc640 1 -- 172.21.15.1:0/469716678 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10bc00bd10 con 0x7f10cc0b6b50 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.935+0000 7f10c27fc640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f10b006ae40 0x7f10b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.935+0000 7f10c27fc640 1 -- 172.21.15.1:0/469716678 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10bc089c80 con 0x7f10cc0b6b50 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.935+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f10b006ae40 0x7f10b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.936+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f10b006ae40 0x7f10b006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10c8036000 tx=0x7f10c8039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.944 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.936+0000 7f10d6c5c740 1 Processor -- start 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.936+0000 7f10d6c5c740 1 -- start start 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x559735115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735116130 0x559735145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597350d6980 con 0x559735142c50 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559735088b90 con 0x559735116130 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559735086280 con 0x559735143030 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d1e6c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x559735115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d1e6c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x559735115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45174/0 (socket says 172.21.15.1:45174) 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d1e6c640 1 -- 172.21.15.1:0/610209462 learned_addr learned my addr 172.21.15.1:0/610209462 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d266d640 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735116130 0x559735145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.945 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d166b640 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d1e6c640 1 -- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 msgr2=0x5597351459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.937+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10d1e6c640 1 -- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735116130 msgr2=0x559735145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735116130 0x559735145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10d1e6c640 1 -- 172.21.15.1:0/610209462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559735047500 con 0x559735142c50 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10d266d640 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735116130 0x559735145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x559735115bf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009960 tx=0x7f10c8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858976b8f17f50ff server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10af7fe640 1 -- 172.21.15.1:0/610209462 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c802fe40 con 0x559735142c50 2023-12-02T01:30:45.946 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10af7fe640 1 -- 172.21.15.1:0/610209462 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c8048040 con 0x559735142c50 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.938+0000 7f10af7fe640 1 -- 172.21.15.1:0/610209462 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8037600 con 0x559735142c50 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 -- 172.21.15.1:0/610209462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 msgr2=0x559735115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x559735115bf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009960 tx=0x7f10c8030000 comp rx=0 tx=0).stop 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 -- 172.21.15.1:0/610209462 shutdown_connections 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735116130 0x559735145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/610209462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x559735115bf0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 -- 172.21.15.1:0/610209462 >> 172.21.15.1:0/610209462 conn(0x559735117e60 msgr2=0x5597351609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.947 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 -- 172.21.15.1:0/610209462 shutdown_connections 2023-12-02T01:30:45.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 -- 172.21.15.1:0/610209462 wait complete. 2023-12-02T01:30:45.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 -- start start 2023-12-02T01:30:45.948 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.939+0000 7f10d6c5c740 1 Processor -- start 2023-12-02T01:30:45.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735142c50 0x559735129930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735143030 0x55973513b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55973512a190 0x55973513bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.953 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x559735081b70 con 0x55973512a190 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55973503be00 con 0x559735143030 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55973503baa0 con 0x559735142c50 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d6c5c740 10 client.0 _ll_register_callbacks cb 0x559734d93ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.940+0000 7f10d266d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55973512a190 0x55973513bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55973512a190 0x55973513bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45178/0 (socket says 172.21.15.1:45178) 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 -- 172.21.15.1:0/1304244033 learned_addr learned my addr 172.21.15.1:0/1304244033 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735142c50 0x559735129930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d166b640 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735143030 0x55973513b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 -- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735142c50 msgr2=0x559735129930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735142c50 0x559735129930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 -- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735143030 msgr2=0x55973513b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735143030 0x55973513b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.954 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 -- 172.21.15.1:0/1304244033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc0b37c0 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d266d640 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55973512a190 0x55973513bce0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f10c4001600 tx=0x7f10c4001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c2ae53517bdd2f server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10acff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10acff9640 1 -- 172.21.15.1:0/1304244033 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4011640 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10acff9640 1 -- 172.21.15.1:0/1304244033 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c4015b00 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55973507ab50 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10acff9640 1 -- 172.21.15.1:0/1304244033 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10c4015cc0 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d6c5c740 10 client.5475 fetch_fsmap learned FSMap version 13 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.941+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x5597350801f0 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10acff9640 1 -- 172.21.15.1:0/1304244033 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55973507ab50 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10acff9640 1 -- 172.21.15.1:0/1304244033 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f10c4012070 con 0x55973512a190 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10d6c5c740 10 client.5475 fetch_fsmap finished waiting for FSMap version 13 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10d6c5c740 10 client.5475 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-02T01:30:45.955 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10d6c5c740 20 client.5475 populate_metadata read hostname 'smithi001' 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x559735145230 0x559735173190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10d6c5c740 4 client.5475 mds_command: new command op to 5316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 --> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55973507a870 con 0x559735145230 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x559735145230 0x559735173190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.942+0000 7f10acff9640 10 client.5475 ms_handle_connect on v2:172.21.15.1:6835/4089525820 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x559735145230 0x559735173190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4691afd2f4f59f server_cookie=723efb6c40def04c in_seq=0 out_seq=0 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10acff9640 1 -- 172.21.15.1:0/1304244033 <== mds.0 v2:172.21.15.1:6835/4089525820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55973507a870 con 0x559735145230 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10acff9640 10 client.5475 handle_command_reply: tid=0 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 client.5475 shutdown 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55973512a190 msgr2=0x55973513bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55973512a190 0x55973513bce0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f10c4001600 tx=0x7f10c4001ac0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 shutdown_connections 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x559735145230 0x559735173190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.956 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55973512a190 0x55973513bce0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735143030 0x55973513b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/1304244033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735142c50 0x559735129930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 >> 172.21.15.1:0/1304244033 conn(0x559735116130 msgr2=0x559735163ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.943+0000 7f10acff9640 0 client.5475 ms_handle_reset on v2:172.21.15.1:6835/4089525820 2023-12-02T01:30:45.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.944+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 shutdown_connections 2023-12-02T01:30:45.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.944+0000 7f10d6c5c740 1 -- 172.21.15.1:0/1304244033 wait complete. 2023-12-02T01:30:45.957 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.944+0000 7f10d6c5c740 20 client.5475 trim_cache size 0 max 16384 2023-12-02T01:30:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 Processor -- start 2023-12-02T01:30:45.961 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 -- start start 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55973512a190 0x5597351640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735142c50 0x5597351c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735143030 0x5597351c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x559735001270 con 0x559735143030 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559735117be0 con 0x559735142c50 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.960+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559735036e70 con 0x55973512a190 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735143030 0x5597351c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735143030 0x5597351c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45194/0 (socket says 172.21.15.1:45194) 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 -- 172.21.15.1:0/4242282332 learned_addr learned my addr 172.21.15.1:0/4242282332 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d166b640 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735142c50 0x5597351c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.963 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55973512a190 0x5597351640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 -- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55973512a190 msgr2=0x5597351640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55973512a190 0x5597351640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 -- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735142c50 msgr2=0x5597351c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735142c50 0x5597351c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 -- 172.21.15.1:0/4242282332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55973501dd00 con 0x559735143030 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10d266d640 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735143030 0x5597351c7140 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f10c4005e20 tx=0x7f10c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92cd4fa17f4dd1c server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10affff640 1 -- 172.21.15.1:0/4242282332 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4011640 con 0x559735143030 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10affff640 1 -- 172.21.15.1:0/4242282332 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400d030 con 0x559735143030 2023-12-02T01:30:45.964 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.961+0000 7f10affff640 1 -- 172.21.15.1:0/4242282332 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004b60 con 0x559735143030 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 -- 172.21.15.1:0/4242282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735143030 msgr2=0x5597351c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735143030 0x5597351c7140 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f10c4005e20 tx=0x7f10c4012000 comp rx=0 tx=0).stop 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 -- 172.21.15.1:0/4242282332 shutdown_connections 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735143030 0x5597351c7140 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559735142c50 0x5597351c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/4242282332 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55973512a190 0x5597351640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 -- 172.21.15.1:0/4242282332 >> 172.21.15.1:0/4242282332 conn(0x559735116130 msgr2=0x55973513c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.969 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 -- 172.21.15.1:0/4242282332 shutdown_connections 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.962+0000 7f10d6c5c740 1 -- 172.21.15.1:0/4242282332 wait complete. 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.963+0000 7f10d6c5c740 1 -- start start 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.963+0000 7f10d6c5c740 1 Processor -- start 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.963+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55973512a190 0x5597351cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x55973513c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d6c5c740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x55973511ab50 con 0x559735142c50 2023-12-02T01:30:45.970 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597351647d0 con 0x55973512a190 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d6c5c740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55973513c830 con 0x559735143030 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d6c5c740 10 client.0 _ll_register_callbacks cb 0x7f10c80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x55973513c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x55973513c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45210/0 (socket says 172.21.15.1:45210) 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 -- 172.21.15.1:0/171706335 learned_addr learned my addr 172.21.15.1:0/171706335 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55973512a190 0x5597351cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d266d640 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 -- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 msgr2=0x5597351c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 -- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55973512a190 msgr2=0x5597351cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55973512a190 0x5597351cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 -- 172.21.15.1:0/171706335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597350801f0 con 0x559735142c50 2023-12-02T01:30:45.971 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d166b640 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x55973513c2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00b4b0 tx=0x7f10bc05cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3566b26500cc8d server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10acff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10acff9640 1 -- 172.21.15.1:0/171706335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc056db0 con 0x559735142c50 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10acff9640 1 -- 172.21.15.1:0/171706335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10bc057e40 con 0x559735142c50 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.964+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10c8048040 con 0x559735142c50 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10acff9640 1 -- 172.21.15.1:0/171706335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10bc058000 con 0x559735142c50 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 10 client.5481 fetch_fsmap learned FSMap version 13 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x5597350434f0 con 0x559735142c50 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10acff9640 1 -- 172.21.15.1:0/171706335 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c8048040 con 0x559735142c50 2023-12-02T01:30:45.972 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10acff9640 1 -- 172.21.15.1:0/171706335 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 13) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f10bc0607c0 con 0x559735142c50 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 10 client.5481 fetch_fsmap finished waiting for FSMap version 13 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 10 client.5481 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 20 client.5481 populate_metadata read hostname 'smithi001' 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x55973512d980 0x55973512dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 4 client.5481 mds_command: new command op to 5316 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 --> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559734d826c0 con 0x55973512d980 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x55973512d980 0x55973512dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10acff9640 10 client.5481 ms_handle_connect on v2:172.21.15.1:6835/4089525820 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.965+0000 7f10d1e6c640 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x55973512d980 0x55973512dd60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6c0d34f3fe23041 server_cookie=1afde1fbb807a42f in_seq=0 out_seq=0 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10acff9640 1 -- 172.21.15.1:0/171706335 <== mds.0 v2:172.21.15.1:6835/4089525820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559734d826c0 con 0x55973512d980 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10acff9640 10 client.5481 handle_command_reply: tid=0 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 client.5481 shutdown 2023-12-02T01:30:45.973 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 msgr2=0x55973513c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x55973513c2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00b4b0 tx=0x7f10bc05cb60 comp rx=0 tx=0).stop 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 shutdown_connections 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:6835/4089525820,v1:172.21.15.1:6837/4089525820] conn(0x55973512d980 0x55973512dd60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559735143030 0x5597351c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10acff9640 0 client.5481 ms_handle_reset on v2:172.21.15.1:6835/4089525820 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559735142c50 0x55973513c2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 --2- 172.21.15.1:0/171706335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55973512a190 0x5597351cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 >> 172.21.15.1:0/171706335 conn(0x559735116130 msgr2=0x559735128e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 shutdown_connections 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 1 -- 172.21.15.1:0/171706335 wait complete. 2023-12-02T01:30:45.974 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d6c5c740 20 client.5481 trim_cache size 0 max 16384 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e", 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 5316, 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 4.6697824450000001, 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 13, 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 33, 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 33, 2023-12-02T01:30:45.975 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 11.765259524999999 2023-12-02T01:30:45.976 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-12-02T01:30:45.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f10b006ae40 msgr2=0x7f10b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.976 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d40d0640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f10b006ae40 0x7f10b006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10c8036000 tx=0x7f10c8039040 comp rx=0 tx=0).stop 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 msgr2=0x7f10cc0c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.966+0000 7f10d40d0640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0c7110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00d7d0 tx=0x7f10bc00dc90 comp rx=0 tx=0).stop 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 shutdown_connections 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f10b006ae40 0x7f10b006d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cc390 0x7f10cc0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10cc0b6b50 0x7f10cc0c7110 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 --2- 172.21.15.1:0/469716678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10cc099970 0x7f10cc158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 >> 172.21.15.1:0/469716678 conn(0x7f10cc0b2a70 msgr2=0x7f10cc06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 shutdown_connections 2023-12-02T01:30:45.977 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:45.967+0000 7f10d40d0640 1 -- 172.21.15.1:0/469716678 wait complete. 2023-12-02T01:30:45.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-02T01:30:46.059 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T01:30:46.058+0000 7f326c49a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-02T01:30:46.146 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.145+0000 7ff715896640 1 Processor -- start 2023-12-02T01:30:46.147 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.145+0000 7ff715896640 1 -- start start 2023-12-02T01:30:46.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff715896640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 0x7ff7100b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff715896640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7100b0660 con 0x7ff71015d900 2023-12-02T01:30:46.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff715896640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71006c900 con 0x7ff71009a080 2023-12-02T01:30:46.151 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff715896640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71006cbe0 con 0x7ff7100b2610 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70effd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff71015d900 0x7ff710099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:35906/0 (socket says 172.21.15.1:35906) 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70effd640 1 -- 172.21.15.1:0/2233786379 learned_addr learned my addr 172.21.15.1:0/2233786379 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214077021 0 0) 0x7ff7100b0660 con 0x7ff71015d900 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6fc003520 con 0x7ff71015d900 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70f7fe640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 0x7ff7100b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099797489 0 0) 0x7ff6fc003520 con 0x7ff71015d900 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 msgr2=0x7ff7100b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:46.152 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 0x7ff7100b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 >> v1:172.21.15.167:6789/0 conn(0x7ff71009a080 legacy=0x7ff7100b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71006cec0 con 0x7ff71015d900 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7ff700001670 con 0x7ff71015d900 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 >> v1:172.21.15.1:6789/0 conn(0x7ff71015d900 legacy=0x7ff710099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 0x7ff6fc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc003fd0 0x7ff6fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc004d00 0x7ff6fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71006cbe0 con 0x7ff6fc004d00 2023-12-02T01:30:46.153 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc00bb40 con 0x7ff6fc003fd0 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc00bd00 con 0x7ff7100b2610 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70f7fe640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc004d00 0x7ff6fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.146+0000 7ff70effd640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 0x7ff6fc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.147+0000 7ff7067fc640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc003fd0 0x7ff6fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.147+0000 7ff70f7fe640 1 -- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 msgr2=0x7ff6fc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.147+0000 7ff70f7fe640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100b2610 0x7ff6fc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.147+0000 7ff70f7fe640 1 -- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc003fd0 msgr2=0x7ff6fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:30:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.147+0000 7ff70f7fe640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc003fd0 0x7ff6fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.147+0000 7ff70f7fe640 1 -- 172.21.15.1:0/2233786379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc003520 con 0x7ff6fc004d00 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.147+0000 7ff70f7fe640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc004d00 0x7ff6fc005180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff708007330 tx=0x7ff6fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ddc395173334f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70802cca0 con 0x7ff6fc004d00 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70802ce00 con 0x7ff6fc004d00 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff70e7fc640 1 -- 172.21.15.1:0/2233786379 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708034680 con 0x7ff6fc004d00 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff715896640 1 -- 172.21.15.1:0/2233786379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc004d00 msgr2=0x7ff6fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff715896640 1 --2- 172.21.15.1:0/2233786379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc004d00 0x7ff6fc005180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff708007330 tx=0x7ff6fc0057f0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff70f7fe640 1 -- 172.21.15.1:0/2233786379 reap_dead start 2023-12-02T01:30:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff715896640 1 -- 172.21.15.1:0/2233786379 shutdown_connections 2023-12-02T01:30:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff715896640 1 -- 172.21.15.1:0/2233786379 >> 172.21.15.1:0/2233786379 conn(0x7ff7100b2a70 msgr2=0x7ff7100b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff715896640 1 -- 172.21.15.1:0/2233786379 shutdown_connections 2023-12-02T01:30:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.148+0000 7ff715896640 1 -- 172.21.15.1:0/2233786379 wait complete. 2023-12-02T01:30:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.149+0000 7ff715896640 1 Processor -- start 2023-12-02T01:30:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff715896640 1 -- start start 2023-12-02T01:30:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff715896640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc004d00 0x7ff7101f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff715896640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff71014fbd0 0x7ff71014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff715896640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100c4ab0 0x7ff7100c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff715896640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100c5480 con 0x7ff71014fbd0 2023-12-02T01:30:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff715896640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710149c50 con 0x7ff6fc004d00 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff715896640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71014cf00 con 0x7ff7100c4ab0 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.150+0000 7ff7067fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff71014fbd0 0x7ff71014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff71014fbd0 0x7ff71014ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45228/0 (socket says 172.21.15.1:45228) 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 -- 172.21.15.1:0/2856012277 learned_addr learned my addr 172.21.15.1:0/2856012277 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff70f7fe640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100c4ab0 0x7ff7100c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff70effd640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc004d00 0x7ff7101f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 -- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100c4ab0 msgr2=0x7ff7100c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100c4ab0 0x7ff7100c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 -- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc004d00 msgr2=0x7ff7101f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc004d00 0x7ff7101f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 -- 172.21.15.1:0/2856012277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71014c2f0 con 0x7ff71014fbd0 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff70effd640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc004d00 0x7ff7101f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:30:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff7067fc640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff71014fbd0 0x7ff71014ffd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800f7f0 tx=0x7ff6f800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff70cff9640 1 -- 172.21.15.1:0/2856012277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80050d0 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff70cff9640 1 -- 172.21.15.1:0/2856012277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8005230 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff70cff9640 1 -- 172.21.15.1:0/2856012277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800d730 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71014c5d0 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.151+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71014cb90 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.152+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7100b36e0 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.153+0000 7ff70cff9640 1 -- 172.21.15.1:0/2856012277 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6f800d890 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.153+0000 7ff70cff9640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff6f006ae40 0x7ff6f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.153+0000 7ff70cff9640 1 -- 172.21.15.1:0/2856012277 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6f8089450 con 0x7ff71014fbd0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.153+0000 7ff70effd640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff6f006ae40 0x7ff6f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.154+0000 7ff70effd640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff6f006ae40 0x7ff6f006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff700001eb0 tx=0x7ff700009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:30:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.157+0000 7ff70cff9640 1 -- 172.21.15.1:0/2856012277 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6f8054500 con 0x7ff71014fbd0 2023-12-02T01:30:46.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.373+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff71014cd20 con 0x7ff71014fbd0 2023-12-02T01:30:46.375 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.373+0000 7ff70cff9640 1 -- 172.21.15.1:0/2856012277 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff6f8057b20 con 0x7ff71014fbd0 2023-12-02T01:30:46.375 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-02T01:30:46.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff6f006ae40 msgr2=0x7ff6f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:46.377 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff6f006ae40 0x7ff6f006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff700001eb0 tx=0x7ff700009040 comp rx=0 tx=0).stop 2023-12-02T01:30:46.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff71014fbd0 msgr2=0x7ff71014ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:30:46.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff71014fbd0 0x7ff71014ffd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800f7f0 tx=0x7ff6f800fcb0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 shutdown_connections 2023-12-02T01:30:46.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7100c4ab0 0x7ff7100c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff71014fbd0 0x7ff71014ffd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff6f006ae40 0x7ff6f006d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.378 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 --2- 172.21.15.1:0/2856012277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6fc004d00 0x7ff7101f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:30:46.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 >> 172.21.15.1:0/2856012277 conn(0x7ff7100b2a70 msgr2=0x7ff7100b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:30:46.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 shutdown_connections 2023-12-02T01:30:46.379 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:46.375+0000 7ff715896640 1 -- 172.21.15.1:0/2856012277 wait complete. 2023-12-02T01:30:46.389 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-02T01:30:46.389 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-02T01:30:46.389 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2023-12-02T01:30:46.390 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-02T01:30:46.390 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:46.390 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-02T01:30:46.390 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-02T01:30:46.390 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-02T01:30:46.390 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-02T01:30:46.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:46.391 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2023-12-02T01:30:46.445 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-02T01:30:46.445 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-02T01:30:46.445 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2023-12-02T01:30:46.445 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-02T01:30:46.446 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42599sec preferred_lft 42599sec 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link noprefixroute 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 02:08:86:39:b3:39 brd ff:ff:ff:ff:ff:ff 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::437:4eff:fe2c:4ef6/64 scope link 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 52:2a:7b:27:c2:89 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::502a:7bff:fe27:c289/64 scope link 2023-12-02T01:30:46.447 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:46.448 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-02T01:30:46.448 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 02:08:86:39:b3:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:46.448 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::8:86ff:fe39:b339/64 scope link 2023-12-02T01:30:46.448 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2023-12-02T01:30:46.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:46.448 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-02T01:30:46.515 INFO:teuthology.orchestra.run.smithi001.stdout:1 2023-12-02T01:30:46.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:46.517 DEBUG:teuthology.orchestra.run.smithi001:> route 2023-12-02T01:30:46.572 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2023-12-02T01:30:46.572 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-02T01:30:46.572 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-02T01:30:46.573 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-02T01:30:46.573 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-02T01:30:46.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:46.573 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec bash -c ' 2023-12-02T01:30:46.573 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2023-12-02T01:30:46.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-02T01:30:46.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-02T01:30:46.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-02T01:30:46.573 DEBUG:teuthology.orchestra.run.smithi001:> ') 2023-12-02T01:30:46.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:46.680 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2023-12-02T01:30:46.695 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-02T01:30:46.695 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-02T01:30:46.695 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-02T01:30:46.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:46.695 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2023-12-02T01:30:46.766 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-02T01:30:46.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:46.766 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-02T01:30:46.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-02T01:30:46.823 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:46.878 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2023-12-02T01:30:46.950 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:47.006 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2023-12-02T01:30:47.008 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:47.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:47.009 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2023-12-02T01:30:47.062 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-02T01:30:47.062 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-02T01:30:47.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2023-12-02T01:30:47.136 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2023-12-02T01:30:47.193 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2023-12-02T01:30:47.193 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2023-12-02T01:30:47.193 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2023-12-02T01:30:47.193 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2023-12-02T01:30:47.193 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2023-12-02T01:30:47.194 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2023-12-02T01:30:47.194 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2023-12-02T01:30:47.194 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2023-12-02T01:30:47.194 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2023-12-02T01:30:47.194 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2023-12-02T01:30:47.195 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2023-12-02T01:30:47.195 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2023-12-02T01:30:47.195 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2023-12-02T01:30:47.195 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2023-12-02T01:30:47.195 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2023-12-02T01:30:47.196 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2023-12-02T01:30:47.196 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2023-12-02T01:30:47.196 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2023-12-02T01:30:47.196 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2023-12-02T01:30:47.196 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2023-12-02T01:30:47.196 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-02T01:30:47.197 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-02T01:30:47.197 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2023-12-02T01:30:47.197 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2023-12-02T01:30:47.197 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2023-12-02T01:30:47.197 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2023-12-02T01:30:47.197 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2023-12-02T01:30:47.198 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2023-12-02T01:30:47.198 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2023-12-02T01:30:47.198 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2023-12-02T01:30:47.198 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:47.198 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-02T01:30:47.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:47.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-02T01:30:47.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:47.199 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2023-12-02T01:30:47.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:2023-12-02T01:30:47.196+0000 7f1816133480 -1 init, newargv = 0x561e321c9530 newargc=15 2023-12-02T01:30:47.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[102589]: starting ceph client 2023-12-02T01:30:47.202 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[102589]: starting fuse 2023-12-02T01:30:47.217 INFO:teuthology.orchestra.run.smithi001.stdout:42 2023-12-02T01:30:47.217 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-12-02T01:30:47.218 DEBUG:teuthology.orchestra.run.smithi001:> sudo stdin-killer -- python3 -c ' 2023-12-02T01:30:47.218 DEBUG:teuthology.orchestra.run.smithi001:> import glob 2023-12-02T01:30:47.218 DEBUG:teuthology.orchestra.run.smithi001:> import re 2023-12-02T01:30:47.218 DEBUG:teuthology.orchestra.run.smithi001:> import os 2023-12-02T01:30:47.218 DEBUG:teuthology.orchestra.run.smithi001:> import subprocess 2023-12-02T01:30:47.219 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:47.219 DEBUG:teuthology.orchestra.run.smithi001:> def _find_admin_socket(client_name): 2023-12-02T01:30:47.219 DEBUG:teuthology.orchestra.run.smithi001:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-02T01:30:47.219 DEBUG:teuthology.orchestra.run.smithi001:> files = glob.glob(asok_path) 2023-12-02T01:30:47.219 DEBUG:teuthology.orchestra.run.smithi001:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-02T01:30:47.219 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:47.219 DEBUG:teuthology.orchestra.run.smithi001:> # Given a non-glob path, it better be there 2023-12-02T01:30:47.220 DEBUG:teuthology.orchestra.run.smithi001:> if "*" not in asok_path: 2023-12-02T01:30:47.220 DEBUG:teuthology.orchestra.run.smithi001:> assert(len(files) == 1) 2023-12-02T01:30:47.220 DEBUG:teuthology.orchestra.run.smithi001:> return files[0] 2023-12-02T01:30:47.220 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:47.220 DEBUG:teuthology.orchestra.run.smithi001:> for f in files: 2023-12-02T01:30:47.220 DEBUG:teuthology.orchestra.run.smithi001:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-02T01:30:47.220 DEBUG:teuthology.orchestra.run.smithi001:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> contents = proc_f.read() 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> if mountpoint in contents: 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> return f 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> print(_find_admin_socket("client.0")) 2023-12-02T01:30:47.221 DEBUG:teuthology.orchestra.run.smithi001:> ' 2023-12-02T01:30:47.342 INFO:teuthology.orchestra.run.smithi001.stdout:/var/run/ceph/ceph-client.0.102589.asok 2023-12-02T01:30:47.345 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-02T01:30:47.353 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.102589.asok 2023-12-02T01:30:47.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:47.353 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.102589.asok status 2023-12-02T01:30:47.496 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2023-12-02T01:30:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": { 2023-12-02T01:30:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_sha1": "bed7681480ccb0192b91a35e691658867e1e96b7", 2023-12-02T01:30:47.496 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev)", 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "entity_id": "0", 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": "smithi001", 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "pid": "102589", 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "root": "/" 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_count": 0, 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_pinned_count": 0, 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 5493, 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "inst": { 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": { 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "client", 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: "num": 5493 2023-12-02T01:30:47.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3840127188 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: } 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3840127188 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "inst_str": "client.5493 192.168.0.1:0/3840127188", 2023-12-02T01:30:47.498 INFO:teuthology.orchestra.run.smithi001.stdout: "addr_str": "192.168.0.1:0/3840127188", 2023-12-02T01:30:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "inode_count": 1, 2023-12-02T01:30:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_epoch": 13, 2023-12-02T01:30:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch": 33, 2023-12-02T01:30:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch_barrier": 0, 2023-12-02T01:30:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklisted": false, 2023-12-02T01:30:47.499 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs" 2023-12-02T01:30:47.499 INFO:teuthology.orchestra.run.smithi001.stdout:} 2023-12-02T01:30:47.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:47.505 DEBUG:teuthology.orchestra.run.smithi001:> stat --file-system '--printf=%T 2023-12-02T01:30:47.505 DEBUG:teuthology.orchestra.run.smithi001:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:47.521 INFO:teuthology.orchestra.run.smithi001.stdout:fuseblk 2023-12-02T01:30:47.522 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:47.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:47.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-02T01:30:47.594 DEBUG:teuthology.orchestra.run.smithi001:> mktemp -d --suffix=xfstests-dev 2023-12-02T01:30:47.649 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.q8QLSYR2gwxfstests-dev 2023-12-02T01:30:47.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:47.649 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.q8QLSYR2gwxfstests-dev) 2023-12-02T01:30:47.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:47.721 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.q8QLSYR2gwxfstests-dev) 2023-12-02T01:30:47.780 INFO:teuthology.orchestra.run.smithi001.stderr:Cloning into '/tmp/tmp.q8QLSYR2gwxfstests-dev'... 2023-12-02T01:30:49.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:49.169 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-02T01:30:49.228 DEBUG:teuthology.orchestra.run.smithi001:> mktemp -d --suffix=test 2023-12-02T01:30:49.284 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.iMk1cH1heVtest 2023-12-02T01:30:49.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:30:49.284 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-02T01:30:49.342 DEBUG:teuthology.orchestra.run.smithi001:> mktemp -d --suffix=scratch 2023-12-02T01:30:49.398 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.ujnosN3tncscratch 2023-12-02T01:30:49.399 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-02T01:30:49.399 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-12-02T01:30:50.047 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:03:27 ago on Sat 02 Dec 2023 01:27:23 AM UTC. 2023-12-02T01:30:50.145 INFO:teuthology.orchestra.run.smithi001.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-02T01:30:50.145 INFO:teuthology.orchestra.run.smithi001.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-02T01:30:50.146 INFO:teuthology.orchestra.run.smithi001.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-02T01:30:50.147 INFO:teuthology.orchestra.run.smithi001.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-02T01:30:50.148 INFO:teuthology.orchestra.run.smithi001.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-02T01:30:50.150 INFO:teuthology.orchestra.run.smithi001.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-02T01:30:50.151 INFO:teuthology.orchestra.run.smithi001.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-02T01:30:50.152 INFO:teuthology.orchestra.run.smithi001.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-02T01:30:50.154 INFO:teuthology.orchestra.run.smithi001.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2023-12-02T01:30:50.156 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-02T01:30:50.158 INFO:teuthology.orchestra.run.smithi001.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-02T01:30:50.159 INFO:teuthology.orchestra.run.smithi001.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-02T01:30:50.160 INFO:teuthology.orchestra.run.smithi001.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-02T01:30:50.161 INFO:teuthology.orchestra.run.smithi001.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-02T01:30:50.162 INFO:teuthology.orchestra.run.smithi001.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-02T01:30:50.163 INFO:teuthology.orchestra.run.smithi001.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-02T01:30:50.164 INFO:teuthology.orchestra.run.smithi001.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-02T01:30:50.165 INFO:teuthology.orchestra.run.smithi001.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-02T01:30:50.165 INFO:teuthology.orchestra.run.smithi001.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-02T01:30:50.169 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-02T01:30:50.230 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2023-12-02T01:30:50.232 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-02T01:30:50.233 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-devel x86_64 5.14.0-388.el9 appstream 21 M 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-02T01:30:50.234 INFO:teuthology.orchestra.run.smithi001.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: python-unversioned-command noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2023-12-02T01:30:50.235 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout:Install 17 Packages 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 16 Packages 2023-12-02T01:30:50.236 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:30:50.237 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 97 M 2023-12-02T01:30:50.237 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2023-12-02T01:30:50.849 INFO:teuthology.orchestra.run.smithi001.stdout:(1/33): fio-engine-http-3.35-1.el9.x86_64.rpm 123 kB/s | 17 kB 00:00 2023-12-02T01:30:50.875 INFO:teuthology.orchestra.run.smithi001.stdout:(2/33): fio-engine-libaio-3.35-1.el9.x86_64.rpm 89 kB/s | 14 kB 00:00 2023-12-02T01:30:51.033 INFO:teuthology.orchestra.run.smithi001.stdout:(3/33): fio-engine-nbd-3.35-1.el9.x86_64.rpm 73 kB/s | 13 kB 00:00 2023-12-02T01:30:51.059 INFO:teuthology.orchestra.run.smithi001.stdout:(4/33): fio-engine-rados-3.35-1.el9.x86_64.rpm 80 kB/s | 15 kB 00:00 2023-12-02T01:30:51.259 INFO:teuthology.orchestra.run.smithi001.stdout:(5/33): fio-engine-rbd-3.35-1.el9.x86_64.rpm 67 kB/s | 15 kB 00:00 2023-12-02T01:30:51.317 INFO:teuthology.orchestra.run.smithi001.stdout:(6/33): fio-engine-rdma-3.35-1.el9.x86_64.rpm 76 kB/s | 20 kB 00:00 2023-12-02T01:30:51.468 INFO:teuthology.orchestra.run.smithi001.stdout:(7/33): libcap-devel-2.48-9.el9.x86_64.rpm 158 kB/s | 33 kB 00:00 2023-12-02T01:30:51.585 INFO:teuthology.orchestra.run.smithi001.stdout:(8/33): fio-3.35-1.el9.x86_64.rpm 7.1 MB/s | 6.2 MB 00:00 2023-12-02T01:30:51.610 INFO:teuthology.orchestra.run.smithi001.stdout:(9/33): sqlite-3.34.1-6.el9.x86_64.rpm 2.5 MB/s | 747 kB 00:00 2023-12-02T01:30:51.635 INFO:teuthology.orchestra.run.smithi001.stdout:(10/33): udftools-2.2-5.el9.x86_64.rpm 861 kB/s | 144 kB 00:00 2023-12-02T01:30:51.661 INFO:teuthology.orchestra.run.smithi001.stdout:(11/33): rmt-1.6-6.el9.x86_64.rpm 606 kB/s | 45 kB 00:00 2023-12-02T01:30:51.861 INFO:teuthology.orchestra.run.smithi001.stdout:(12/33): libnbd-1.18.1-3.el9.x86_64.rpm 741 kB/s | 166 kB 00:00 2023-12-02T01:30:51.936 INFO:teuthology.orchestra.run.smithi001.stdout:(13/33): gdbm-1.19-4.el9.x86_64.rpm 481 kB/s | 132 kB 00:00 2023-12-02T01:30:52.086 INFO:teuthology.orchestra.run.smithi001.stdout:(14/33): gdbm-devel-1.19-4.el9.x86_64.rpm 260 kB/s | 59 kB 00:00 2023-12-02T01:30:52.528 INFO:teuthology.orchestra.run.smithi001.stdout:(15/33): dump-0.4-0.51.b47.el9.x86_64.rpm 148 kB/s | 88 kB 00:00 2023-12-02T01:30:52.770 INFO:teuthology.orchestra.run.smithi001.stdout:(16/33): indent-2.2.13-4.el9.x86_64.rpm 263 kB/s | 179 kB 00:00 2023-12-02T01:30:53.295 INFO:teuthology.orchestra.run.smithi001.stdout:(17/33): kernel-devel-5.14.0-388.el9.x86_64.rpm 13 MB/s | 21 MB 00:01 2023-12-02T01:30:53.412 INFO:teuthology.orchestra.run.smithi001.stdout:(18/33): cpp-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 11 MB 00:00 2023-12-02T01:30:53.613 INFO:teuthology.orchestra.run.smithi001.stdout:(19/33): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 236 kB/s | 47 kB 00:00 2023-12-02T01:30:53.938 INFO:teuthology.orchestra.run.smithi001.stdout:(20/33): libstdc++-devel-11.4.1-2.3.el9.x86_64. 6.9 MB/s | 2.2 MB 00:00 2023-12-02T01:30:54.163 INFO:teuthology.orchestra.run.smithi001.stdout:(21/33): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 15 MB/s | 13 MB 00:00 2023-12-02T01:30:54.305 INFO:teuthology.orchestra.run.smithi001.stdout:(22/33): python-unversioned-command-3.9.18-1.el 24 kB/s | 8.8 kB 00:00 2023-12-02T01:30:54.597 INFO:teuthology.orchestra.run.smithi001.stdout:(23/33): gcc-11.4.1-2.3.el9.x86_64.rpm 18 MB/s | 32 MB 00:01 2023-12-02T01:30:54.622 INFO:teuthology.orchestra.run.smithi001.stdout:(24/33): python3-devel-3.9.18-1.el9.x86_64.rpm 448 kB/s | 204 kB 00:00 2023-12-02T01:30:54.656 INFO:teuthology.orchestra.run.smithi001.stdout:(25/33): e2fsprogs-1.46.5-4.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2023-12-02T01:30:54.681 INFO:teuthology.orchestra.run.smithi001.stdout:(26/33): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 2.7 MB/s | 221 kB 00:00 2023-12-02T01:30:54.706 INFO:teuthology.orchestra.run.smithi001.stdout:(27/33): libcom_err-1.46.5-4.el9.x86_64.rpm 508 kB/s | 25 kB 00:00 2023-12-02T01:30:54.723 INFO:teuthology.orchestra.run.smithi001.stdout:(28/33): libgcc-11.4.1-2.3.el9.x86_64.rpm 1.4 MB/s | 92 kB 00:00 2023-12-02T01:30:54.749 INFO:teuthology.orchestra.run.smithi001.stdout:(29/33): libgomp-11.4.1-2.3.el9.x86_64.rpm 3.9 MB/s | 268 kB 00:00 2023-12-02T01:30:54.774 INFO:teuthology.orchestra.run.smithi001.stdout:(30/33): libss-1.46.5-4.el9.x86_64.rpm 619 kB/s | 31 kB 00:00 2023-12-02T01:30:54.799 INFO:teuthology.orchestra.run.smithi001.stdout:(31/33): libstdc++-11.4.1-2.3.el9.x86_64.rpm 9.6 MB/s | 735 kB 00:00 2023-12-02T01:30:54.824 INFO:teuthology.orchestra.run.smithi001.stdout:(32/33): python3-3.9.18-1.el9.x86_64.rpm 346 kB/s | 26 kB 00:00 2023-12-02T01:30:55.050 INFO:teuthology.orchestra.run.smithi001.stdout:(33/33): python3-libs-3.9.18-1.el9.x86_64.rpm 27 MB/s | 7.3 MB 00:00 2023-12-02T01:30:55.054 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2023-12-02T01:30:55.054 INFO:teuthology.orchestra.run.smithi001.stdout:Total 20 MB/s | 97 MB 00:04 2023-12-02T01:30:55.284 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2023-12-02T01:30:55.565 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2023-12-02T01:30:55.566 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2023-12-02T01:30:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2023-12-02T01:30:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2023-12-02T01:30:59.022 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2023-12-02T01:30:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/49 2023-12-02T01:30:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-02T01:30:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-02T01:30:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/49 2023-12-02T01:30:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/49 2023-12-02T01:30:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/49 2023-12-02T01:31:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/49 2023-12-02T01:31:01.396 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/49 2023-12-02T01:31:01.442 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/49 2023-12-02T01:31:01.473 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/49 2023-12-02T01:31:01.855 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/49 2023-12-02T01:31:02.827 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/49 2023-12-02T01:31:02.981 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-02T01:31:03.026 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-02T01:31:03.064 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 13/49 2023-12-02T01:31:03.100 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 14/49 2023-12-02T01:31:03.117 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 15/49 2023-12-02T01:31:03.143 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 16/49 2023-12-02T01:31:03.168 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 17/49 2023-12-02T01:31:03.202 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 18/49 2023-12-02T01:31:03.219 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 19/49 2023-12-02T01:31:03.382 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 20/49 2023-12-02T01:31:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fio-3.35-1.el9.x86_64 21/49 2023-12-02T01:31:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rmt-2:1.6-6.el9.x86_64 22/49 2023-12-02T01:31:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 23/49 2023-12-02T01:31:13.320 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 24/49 2023-12-02T01:31:13.556 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-devel-5.14.0-388.el9.x86_64 25/49 2023-12-02T01:31:16.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:31:16.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:31:24.530 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-devel-5.14.0-388.el9.x86_64 25/49 2023-12-02T01:31:24.606 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 26/49 2023-12-02T01:31:24.638 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-02T01:31:24.750 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-02T01:31:24.887 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 28/49 2023-12-02T01:31:25.038 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 29/49 2023-12-02T01:31:25.082 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : indent-2.2.13-4.el9.x86_64 30/49 2023-12-02T01:31:25.121 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : udftools-2.2-5.el9.x86_64 31/49 2023-12-02T01:31:25.165 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 32/49 2023-12-02T01:31:25.191 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 33/49 2023-12-02T01:31:25.232 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 34/49 2023-12-02T01:31:25.260 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 35/49 2023-12-02T01:31:25.291 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 36/49 2023-12-02T01:31:25.315 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 37/49 2023-12-02T01:31:25.341 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 38/49 2023-12-02T01:31:25.342 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-02T01:31:25.388 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-02T01:31:25.426 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 40/49 2023-12-02T01:31:25.451 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 41/49 2023-12-02T01:31:25.489 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 42/49 2023-12-02T01:31:25.519 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 43/49 2023-12-02T01:31:25.544 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 44/49 2023-12-02T01:31:25.544 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-02T01:31:25.603 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-02T01:31:25.629 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 46/49 2023-12-02T01:31:25.654 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 47/49 2023-12-02T01:31:25.878 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 48/49 2023-12-02T01:31:26.025 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-02T01:31:28.171 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-02T01:31:28.171 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fio-3.35-1.el9.x86_64 1/49 2023-12-02T01:31:28.171 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/49 2023-12-02T01:31:28.171 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 9/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-devel-5.14.0-388.el9.x86_64 12/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/49 2023-12-02T01:31:28.172 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : indent-2.2.13-4.el9.x86_64 17/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 18/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 20/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 22/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 24/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 26/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 27/49 2023-12-02T01:31:28.173 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 28/49 2023-12-02T01:31:28.175 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 29/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 30/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 31/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 32/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 33/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 34/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 35/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 36/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 37/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 38/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 39/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 40/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 41/49 2023-12-02T01:31:28.176 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libss-1.46.5-4.el9.x86_64 42/49 2023-12-02T01:31:28.177 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libss-1.46.5-3.el9.x86_64 43/49 2023-12-02T01:31:28.177 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 44/49 2023-12-02T01:31:28.177 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 45/49 2023-12-02T01:31:28.177 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-3.9.18-1.el9.x86_64 46/49 2023-12-02T01:31:28.177 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-3.9.17-2.el9.x86_64 47/49 2023-12-02T01:31:28.177 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 48/49 2023-12-02T01:31:29.159 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-02T01:31:29.159 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:31:29.159 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2023-12-02T01:31:29.159 INFO:teuthology.orchestra.run.smithi001.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: libss-1.46.5-4.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: python3-3.9.18-1.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-02T01:31:29.160 INFO:teuthology.orchestra.run.smithi001.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: indent-2.2.13-4.el9.x86_64 kernel-devel-5.14.0-388.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: udftools-2.2-5.el9.x86_64 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:31:29.161 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2023-12-02T01:31:29.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo useradd -m fsgqa 2023-12-02T01:31:29.908 INFO:teuthology.orchestra.run.smithi001.stderr:useradd: user 'fsgqa' already exists 2023-12-02T01:31:29.909 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-02T01:31:29.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo groupadd fsgqa 2023-12-02T01:31:29.982 INFO:teuthology.orchestra.run.smithi001.stderr:groupadd: group 'fsgqa' already exists 2023-12-02T01:31:29.983 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-02T01:31:29.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo useradd fsgqa2 2023-12-02T01:31:30.854 DEBUG:teuthology.orchestra.run.smithi001:> sudo useradd 123456-fsgqa 2023-12-02T01:31:31.504 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-02T01:31:31.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.619+0000 7ff8f5c3a640 1 Processor -- start 2023-12-02T01:31:31.620 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.619+0000 7ff8f5c3a640 1 -- start start 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8f5c3a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f0142d20 0x7ff8f0071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8f5c3a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8f006dc30 0x7ff8f00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8f5c3a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00b3130 con 0x7ff8f00b1df0 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8f5c3a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f0143100 con 0x7ff8f006dc30 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8f5c3a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00b2250 con 0x7ff8f0142d20 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8effff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8f006dc30 0x7ff8f00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8effff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff8f006dc30 0x7ff8f00cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37020/0 (socket says 172.21.15.1:37020) 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8effff640 1 -- 172.21.15.1:0/2232409154 learned_addr learned my addr 172.21.15.1:0/2232409154 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8ef7fe640 1 --2- 172.21.15.1:0/2232409154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f0142d20 0x7ff8f0071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8effff640 1 -- 172.21.15.1:0/2232409154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f0142d20 msgr2=0x7ff8f0071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:31:31.622 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8effff640 1 --2- 172.21.15.1:0/2232409154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f0142d20 0x7ff8f0071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8effff640 1 -- 172.21.15.1:0/2232409154 >> v1:172.21.15.167:6789/0 conn(0x7ff8f00b1df0 legacy=0x7ff8f006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:31.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8effff640 1 -- 172.21.15.1:0/2232409154 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00b2520 con 0x7ff8f006dc30 2023-12-02T01:31:31.623 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.620+0000 7ff8ef7fe640 1 --2- 172.21.15.1:0/2232409154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f0142d20 0x7ff8f0071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.621+0000 7ff8effff640 1 --2- 172.21.15.1:0/2232409154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f006dc30 0x7ff8f00cc610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009e50 tx=0x7ff8e802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456906ccced7ea68 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.621+0000 7ff8ee7fc640 1 -- 172.21.15.1:0/2232409154 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e802cb00 con 0x7ff8f006dc30 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.621+0000 7ff8ee7fc640 1 -- 172.21.15.1:0/2232409154 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e802cc60 con 0x7ff8f006dc30 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.621+0000 7ff8ee7fc640 1 -- 172.21.15.1:0/2232409154 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e80343f0 con 0x7ff8f006dc30 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/2232409154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f006dc30 msgr2=0x7ff8f00cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/2232409154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f006dc30 0x7ff8f00cc610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009e50 tx=0x7ff8e802bf60 comp rx=0 tx=0).stop 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/2232409154 shutdown_connections 2023-12-02T01:31:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/2232409154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f006dc30 0x7ff8f00cc610 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/2232409154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f0142d20 0x7ff8f0071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/2232409154 >> 172.21.15.1:0/2232409154 conn(0x7ff8f00b0af0 msgr2=0x7ff8f00b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:31:31.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/2232409154 shutdown_connections 2023-12-02T01:31:31.625 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.622+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/2232409154 wait complete. 2023-12-02T01:31:31.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.623+0000 7ff8f5c3a640 1 Processor -- start 2023-12-02T01:31:31.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.623+0000 7ff8f5c3a640 1 -- start start 2023-12-02T01:31:31.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8f5c3a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f006dc30 0x7ff8f01eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:31.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8f5c3a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f00b1df0 0x7ff8f01f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:31.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8f5c3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8f0142d20 0x7ff8f0132580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:31.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8f5c3a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f01f40d0 con 0x7ff8f00b1df0 2023-12-02T01:31:31.627 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8f5c3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f01334c0 con 0x7ff8f0142d20 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8f5c3a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f01f3da0 con 0x7ff8f006dc30 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f00b1df0 0x7ff8f01f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f00b1df0 0x7ff8f01f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37026/0 (socket says 172.21.15.1:37026) 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 -- 172.21.15.1:0/1075539356 learned_addr learned my addr 172.21.15.1:0/1075539356 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8ef7fe640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f006dc30 0x7ff8f01eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8effff640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8f0142d20 0x7ff8f0132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 -- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f006dc30 msgr2=0x7ff8f01eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f006dc30 0x7ff8f01eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 -- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8f0142d20 msgr2=0x7ff8f0132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8f0142d20 0x7ff8f0132580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8eeffd640 1 -- 172.21.15.1:0/1075539356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8009b30 con 0x7ff8f00b1df0 2023-12-02T01:31:31.628 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8ef7fe640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f006dc30 0x7ff8f01eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:31:31.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.624+0000 7ff8effff640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8f0142d20 0x7ff8f0132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-02T01:31:31.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.625+0000 7ff8eeffd640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f00b1df0 0x7ff8f01f4560 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c450 tx=0x7ff8e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:31:31.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.625+0000 7ff8d7fff640 1 -- 172.21.15.1:0/1075539356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40052d0 con 0x7ff8f00b1df0 2023-12-02T01:31:31.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.625+0000 7ff8d7fff640 1 -- 172.21.15.1:0/1075539356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4005430 con 0x7ff8f00b1df0 2023-12-02T01:31:31.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.625+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f0132f00 con 0x7ff8f00b1df0 2023-12-02T01:31:31.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.625+0000 7ff8d7fff640 1 -- 172.21.15.1:0/1075539356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4012870 con 0x7ff8f00b1df0 2023-12-02T01:31:31.629 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.625+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f01f0480 con 0x7ff8f00b1df0 2023-12-02T01:31:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.626+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f0067420 con 0x7ff8f00b1df0 2023-12-02T01:31:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.626+0000 7ff8d7fff640 1 -- 172.21.15.1:0/1075539356 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8e40129d0 con 0x7ff8f00b1df0 2023-12-02T01:31:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.627+0000 7ff8d7fff640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8dc06ae40 0x7ff8dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.627+0000 7ff8d7fff640 1 -- 172.21.15.1:0/1075539356 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8e40890d0 con 0x7ff8f00b1df0 2023-12-02T01:31:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.627+0000 7ff8ef7fe640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8dc06ae40 0x7ff8dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.627+0000 7ff8ef7fe640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8dc06ae40 0x7ff8dc06d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0006fd0 tx=0x7ff8e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:31:31.633 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.632+0000 7ff8d7fff640 1 -- 172.21.15.1:0/1075539356 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8e4054210 con 0x7ff8f00b1df0 2023-12-02T01:31:31.883 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.882+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff8f00c8ea0 con 0x7ff8f00b1df0 2023-12-02T01:31:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.882+0000 7ff8d7fff640 1 -- 172.21.15.1:0/1075539356 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1272 (secure 0 0 0) 0x7ff8e4057830 con 0x7ff8f00b1df0 2023-12-02T01:31:31.884 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:31:31.884 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"fsid":"0d7d0e9c-fabb-49fb-8393-9aa7ede12a6e","modified":"2023-12-02T01:28:47.670733Z","created":"2023-12-02T01:28:47.670733Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-02T01:31:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:dumped monmap epoch 1 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8dc06ae40 msgr2=0x7ff8dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8dc06ae40 0x7ff8dc06d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0006fd0 tx=0x7ff8e0008040 comp rx=0 tx=0).stop 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f00b1df0 msgr2=0x7ff8f01f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f00b1df0 0x7ff8f01f4560 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c450 tx=0x7ff8e400c910 comp rx=0 tx=0).stop 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 shutdown_connections 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7ff8dc06ae40 0x7ff8dc06d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8f0142d20 0x7ff8f0132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8f00b1df0 0x7ff8f01f4560 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 --2- 172.21.15.1:0/1075539356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff8f006dc30 0x7ff8f01eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 >> 172.21.15.1:0/1075539356 conn(0x7ff8f00b0af0 msgr2=0x7ff8f015c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:31:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 shutdown_connections 2023-12-02T01:31:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:31.884+0000 7ff8f5c3a640 1 -- 172.21.15.1:0/1075539356 wait complete. 2023-12-02T01:31:31.897 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-12-02T01:31:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.003+0000 7f17bff02640 1 Processor -- start 2023-12-02T01:31:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.003+0000 7f17bff02640 1 -- start start 2023-12-02T01:31:32.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bff02640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17b80b6b50 0x7f17b80cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bff02640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 0x7f17b806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bff02640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b80b3590 con 0x7f17b8099970 2023-12-02T01:31:32.007 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bff02640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b806b310 con 0x7f17b80b6b50 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bff02640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80cd3a0 con 0x7f17b806bc50 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bd49d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f17b8099970 0x7f17b8099d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41478/0 (socket says 172.21.15.1:41478) 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bd49d640 1 -- 172.21.15.1:0/515715141 learned_addr learned my addr 172.21.15.1:0/515715141 (peer_addr_for_me v1:172.21.15.1:0/0) 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361556249 0 0) 0x7f17b80b3590 con 0x7f17b8099970 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bdc9e640 1 --2- 172.21.15.1:0/515715141 >> v2:172.21.15.167:3300/0 conn(0x7f17b80b6b50 0x7f17b80cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a4003520 con 0x7f17b8099970 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17be49f640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 0x7f17b806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799422342 0 0) 0x7f17a4003520 con 0x7f17b8099970 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 msgr2=0x7f17b806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 0x7f17b806c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 >> v2:172.21.15.167:3300/0 conn(0x7f17b80b6b50 msgr2=0x7f17b80cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 --2- 172.21.15.1:0/515715141 >> v2:172.21.15.167:3300/0 conn(0x7f17b80b6b50 0x7f17b80cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80b37c0 con 0x7f17b8099970 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 99952375 0 0) 0x7f17a8001670 con 0x7f17b8099970 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 >> v1:172.21.15.1:6789/0 conn(0x7f17b8099970 legacy=0x7f17b8099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17a4003970 0x7f17a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.004+0000 7f17bcc9c640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 0x7f17a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17bcc9c640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17a4004d00 0x7f17a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b806b310 con 0x7f17a4004d00 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80cd3a0 con 0x7f17a4003970 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a400b980 con 0x7f17b806bc50 2023-12-02T01:31:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17be49f640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17a4004d00 0x7f17a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17bdc9e640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17a4003970 0x7f17a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17bd49d640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 0x7f17a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17be49f640 1 -- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 msgr2=0x7f17a40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17be49f640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17b806bc50 0x7f17a40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17be49f640 1 -- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17a4003970 msgr2=0x7f17a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17be49f640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17a4003970 0x7f17a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.005+0000 7f17be49f640 1 -- 172.21.15.1:0/515715141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4003520 con 0x7f17a4004d00 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17be49f640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17a4004d00 0x7f17a4005180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009fc0 tx=0x7f17a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87173ef8f1f3f517 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b002cc20 con 0x7f17a4004d00 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b000f040 con 0x7f17a4004d00 2023-12-02T01:31:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bcc9c640 1 -- 172.21.15.1:0/515715141 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0034440 con 0x7f17a4004d00 2023-12-02T01:31:32.013 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bff02640 1 -- 172.21.15.1:0/515715141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17a4004d00 msgr2=0x7f17a4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bff02640 1 --2- 172.21.15.1:0/515715141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17a4004d00 0x7f17a4005180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009fc0 tx=0x7f17a40057f0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17be49f640 1 -- 172.21.15.1:0/515715141 reap_dead start 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bff02640 1 -- 172.21.15.1:0/515715141 shutdown_connections 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bff02640 1 -- 172.21.15.1:0/515715141 >> 172.21.15.1:0/515715141 conn(0x7f17b80b2a70 msgr2=0x7f17b80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bff02640 1 -- 172.21.15.1:0/515715141 shutdown_connections 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.006+0000 7f17bff02640 1 -- 172.21.15.1:0/515715141 wait complete. 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 Processor -- start 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 -- start start 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17a4004d00 0x7f17b81f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b81f37b0 0x7f17b815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17b81f3c30 0x7f17b815d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b81f2d00 con 0x7f17b81f3c30 2023-12-02T01:31:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815df60 con 0x7f17b81f37b0 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17bff02640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815e240 con 0x7f17a4004d00 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17be49f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17b81f3c30 0x7f17b815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.008+0000 7f17be49f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17b81f3c30 0x7f17b815d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37050/0 (socket says 172.21.15.1:37050) 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17be49f640 1 -- 172.21.15.1:0/1642720509 learned_addr learned my addr 172.21.15.1:0/1642720509 (peer_addr_for_me v2:172.21.15.1:0/0) 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17bdc9e640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17a4004d00 0x7f17b81f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17bd49d640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b81f37b0 0x7f17b815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17be49f640 1 -- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17a4004d00 msgr2=0x7f17b81f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17be49f640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17a4004d00 0x7f17b81f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17be49f640 1 -- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b81f37b0 msgr2=0x7f17b815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17be49f640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b81f37b0 0x7f17b815d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17be49f640 1 -- 172.21.15.1:0/1642720509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b81f2fb0 con 0x7f17b81f3c30 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17bd49d640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b81f37b0 0x7f17b815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:31:32.015 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17bdc9e640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17a4004d00 0x7f17b81f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17be49f640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17b81f3c30 0x7f17b815d930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f17b0002230 tx=0x7f17b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17ae7fc640 1 -- 172.21.15.1:0/1642720509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0043070 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17ae7fc640 1 -- 172.21.15.1:0/1642720509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0034ad0 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b81f3290 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17ae7fc640 1 -- 172.21.15.1:0/1642720509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0034e80 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.009+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b80ca220 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.010+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b815e400 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.011+0000 7f17ae7fc640 1 -- 172.21.15.1:0/1642720509 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17b003e440 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.011+0000 7f17ae7fc640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f179c06ae40 0x7f179c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.011+0000 7f17ae7fc640 1 -- 172.21.15.1:0/1642720509 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17b00ab2c0 con 0x7f17b81f3c30 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.011+0000 7f17bdc9e640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f179c06ae40 0x7f179c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-02T01:31:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.011+0000 7f17bdc9e640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f179c06ae40 0x7f179c06d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009bc0 tx=0x7f17b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-02T01:31:32.017 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.015+0000 7f17ae7fc640 1 -- 172.21.15.1:0/1642720509 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17b0076380 con 0x7f17b81f3c30 2023-12-02T01:31:32.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.257+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f17b81f34b0 con 0x7f17b81f3c30 2023-12-02T01:31:32.259 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.258+0000 7f17ae7fc640 1 -- 172.21.15.1:0/1642720509 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) v1 ==== 82+0+151 (secure 0 0 0) 0x7f17b00799a0 con 0x7f17b81f3c30 2023-12-02T01:31:32.260 INFO:teuthology.orchestra.run.smithi001.stdout:[client.admin] 2023-12-02T01:31:32.260 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQBPiGplFu4DNhAAQIWhqAPScVugg8AwpI5aLQ== 2023-12-02T01:31:32.260 INFO:teuthology.orchestra.run.smithi001.stdout: caps mds = "allow *" 2023-12-02T01:31:32.260 INFO:teuthology.orchestra.run.smithi001.stdout: caps mgr = "allow *" 2023-12-02T01:31:32.260 INFO:teuthology.orchestra.run.smithi001.stdout: caps mon = "allow *" 2023-12-02T01:31:32.260 INFO:teuthology.orchestra.run.smithi001.stdout: caps osd = "allow *" 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f179c06ae40 msgr2=0x7f179c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f179c06ae40 0x7f179c06d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009bc0 tx=0x7f17b4008040 comp rx=0 tx=0).stop 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17b81f3c30 msgr2=0x7f17b815d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17b81f3c30 0x7f17b815d930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f17b0002230 tx=0x7f17b0009750 comp rx=0 tx=0).stop 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 shutdown_connections 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f17b81f3c30 0x7f17b815d930 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.1:6832/1281506213,v1:172.21.15.1:6833/1281506213] conn(0x7f179c06ae40 0x7f179c06d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17b81f37b0 0x7f17b815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 --2- 172.21.15.1:0/1642720509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17a4004d00 0x7f17b81f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 >> 172.21.15.1:0/1642720509 conn(0x7f17b80b2a70 msgr2=0x7f17b806c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 shutdown_connections 2023-12-02T01:31:32.262 INFO:teuthology.orchestra.run.smithi001.stderr:2023-12-02T01:31:32.260+0000 7f17bff02640 1 -- 172.21.15.1:0/1642720509 wait complete. 2023-12-02T01:31:32.272 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2023-12-02T01:31:32.288 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.1TUCpJLUBD 2023-12-02T01:31:32.288 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:31:32.288 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/tmp/tmp.1TUCpJLUBD 2023-12-02T01:31:32.344 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:31:32.344 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/tmp/tmp.q8QLSYR2gwxfstests-dev/local.config 2023-12-02T01:31:32.414 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.iMk1cH1heVtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.ujnosN3tncscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.1:6789 -k /tmp/tmp.1TUCpJLUBD --client_mountpoint /test" 2023-12-02T01:31:32.414 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T01:31:32.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/tmp/tmp.q8QLSYR2gwxfstests-dev/ceph.exclude 2023-12-02T01:31:32.485 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo make) 2023-12-02T01:31:32.575 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize -cfi 2023-12-02T01:31:32.933 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-02T01:31:32.933 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file './config.guess' 2023-12-02T01:31:32.937 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file './config.sub' 2023-12-02T01:31:32.940 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file './install-sh' 2023-12-02T01:31:32.944 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file './ltmain.sh' 2023-12-02T01:31:32.967 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-02T01:31:32.967 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-02T01:31:32.972 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-02T01:31:32.976 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-02T01:31:32.980 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-02T01:31:32.985 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-02T01:31:32.991 INFO:teuthology.orchestra.run.smithi001.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-02T01:31:32.993 INFO:teuthology.orchestra.run.smithi001.stdout:cp include/install-sh . 2023-12-02T01:31:32.994 INFO:teuthology.orchestra.run.smithi001.stdout:aclocal -I m4 2023-12-02T01:31:34.050 INFO:teuthology.orchestra.run.smithi001.stdout:autoheader 2023-12-02T01:31:34.349 INFO:teuthology.orchestra.run.smithi001.stdout:autoconf 2023-12-02T01:31:34.525 INFO:teuthology.orchestra.run.smithi001.stdout:./configure \ 2023-12-02T01:31:34.525 INFO:teuthology.orchestra.run.smithi001.stdout: --libexecdir=/usr/lib \ 2023-12-02T01:31:34.525 INFO:teuthology.orchestra.run.smithi001.stdout: --exec_prefix=/var/lib 2023-12-02T01:31:34.721 INFO:teuthology.orchestra.run.smithi001.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-02T01:31:34.721 INFO:teuthology.orchestra.run.smithi001.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-02T01:31:34.722 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to print strings... printf 2023-12-02T01:31:34.722 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gcc... gcc 2023-12-02T01:31:34.774 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether the C compiler works... yes 2023-12-02T01:31:34.775 INFO:teuthology.orchestra.run.smithi001.stdout:checking for C compiler default output file name... a.out 2023-12-02T01:31:34.802 INFO:teuthology.orchestra.run.smithi001.stdout:checking for suffix of executables... 2023-12-02T01:31:34.854 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether we are cross compiling... no 2023-12-02T01:31:34.871 INFO:teuthology.orchestra.run.smithi001.stdout:checking for suffix of object files... o 2023-12-02T01:31:34.886 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether we are using the GNU C compiler... yes 2023-12-02T01:31:34.902 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether gcc accepts -g... yes 2023-12-02T01:31:34.929 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-02T01:31:34.931 INFO:teuthology.orchestra.run.smithi001.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-02T01:31:34.933 INFO:teuthology.orchestra.run.smithi001.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-02T01:31:34.934 INFO:teuthology.orchestra.run.smithi001.stdout:checking for egrep... /bin/grep -E 2023-12-02T01:31:34.935 INFO:teuthology.orchestra.run.smithi001.stdout:checking for fgrep... /bin/grep -F 2023-12-02T01:31:34.938 INFO:teuthology.orchestra.run.smithi001.stdout:checking for ld used by gcc... /bin/ld 2023-12-02T01:31:34.940 INFO:teuthology.orchestra.run.smithi001.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-02T01:31:34.945 INFO:teuthology.orchestra.run.smithi001.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-02T01:31:35.866 INFO:teuthology.orchestra.run.smithi001.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-02T01:31:35.866 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether ln -s works... yes 2023-12-02T01:31:35.876 INFO:teuthology.orchestra.run.smithi001.stdout:checking the maximum length of command line arguments... 1572864 2023-12-02T01:31:35.879 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-02T01:31:35.879 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-02T01:31:35.879 INFO:teuthology.orchestra.run.smithi001.stdout:checking for /bin/ld option to reload object files... -r 2023-12-02T01:31:35.879 INFO:teuthology.orchestra.run.smithi001.stdout:checking for objdump... objdump 2023-12-02T01:31:35.879 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to recognize dependent libraries... pass_all 2023-12-02T01:31:35.880 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dlltool... no 2023-12-02T01:31:35.880 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-02T01:31:35.880 INFO:teuthology.orchestra.run.smithi001.stdout:checking for ar... ar 2023-12-02T01:31:35.929 INFO:teuthology.orchestra.run.smithi001.stdout:checking for archiver @FILE support... @ 2023-12-02T01:31:35.929 INFO:teuthology.orchestra.run.smithi001.stdout:checking for strip... strip 2023-12-02T01:31:35.929 INFO:teuthology.orchestra.run.smithi001.stdout:checking for ranlib... ranlib 2023-12-02T01:31:35.930 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gawk... gawk 2023-12-02T01:31:35.997 INFO:teuthology.orchestra.run.smithi001.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-02T01:31:35.998 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sysroot... no 2023-12-02T01:31:36.001 INFO:teuthology.orchestra.run.smithi001.stdout:checking for a working dd... /bin/dd 2023-12-02T01:31:36.004 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-02T01:31:36.017 INFO:teuthology.orchestra.run.smithi001.stdout:checking for mt... no 2023-12-02T01:31:36.019 INFO:teuthology.orchestra.run.smithi001.stdout:checking if : is a manifest tool... no 2023-12-02T01:31:36.079 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to run the C preprocessor... gcc -E 2023-12-02T01:31:36.280 INFO:teuthology.orchestra.run.smithi001.stdout:checking for ANSI C header files... yes 2023-12-02T01:31:36.301 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/types.h... yes 2023-12-02T01:31:36.329 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/stat.h... yes 2023-12-02T01:31:36.352 INFO:teuthology.orchestra.run.smithi001.stdout:checking for stdlib.h... yes 2023-12-02T01:31:36.377 INFO:teuthology.orchestra.run.smithi001.stdout:checking for string.h... yes 2023-12-02T01:31:36.411 INFO:teuthology.orchestra.run.smithi001.stdout:checking for memory.h... yes 2023-12-02T01:31:36.436 INFO:teuthology.orchestra.run.smithi001.stdout:checking for strings.h... yes 2023-12-02T01:31:36.469 INFO:teuthology.orchestra.run.smithi001.stdout:checking for inttypes.h... yes 2023-12-02T01:31:36.494 INFO:teuthology.orchestra.run.smithi001.stdout:checking for stdint.h... yes 2023-12-02T01:31:36.529 INFO:teuthology.orchestra.run.smithi001.stdout:checking for unistd.h... yes 2023-12-02T01:31:36.562 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dlfcn.h... yes 2023-12-02T01:31:36.565 INFO:teuthology.orchestra.run.smithi001.stdout:checking for objdir... .libs 2023-12-02T01:31:36.628 INFO:teuthology.orchestra.run.smithi001.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-02T01:31:36.629 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-02T01:31:36.643 INFO:teuthology.orchestra.run.smithi001.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-02T01:31:36.661 INFO:teuthology.orchestra.run.smithi001.stdout:checking if gcc static flag -static works... no 2023-12-02T01:31:36.683 INFO:teuthology.orchestra.run.smithi001.stdout:checking if gcc supports -c -o file.o... yes 2023-12-02T01:31:36.683 INFO:teuthology.orchestra.run.smithi001.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-02T01:31:36.689 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-02T01:31:36.715 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether -lc should be explicitly linked in... no 2023-12-02T01:31:36.773 INFO:teuthology.orchestra.run.smithi001.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-02T01:31:36.773 INFO:teuthology.orchestra.run.smithi001.stdout:checking how to hardcode library paths into programs... immediate 2023-12-02T01:31:36.774 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether stripping libraries is possible... yes 2023-12-02T01:31:36.775 INFO:teuthology.orchestra.run.smithi001.stdout:checking if libtool supports shared libraries... yes 2023-12-02T01:31:36.775 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether to build shared libraries... yes 2023-12-02T01:31:36.775 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether to build static libraries... yes 2023-12-02T01:31:36.781 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gcc... (cached) gcc 2023-12-02T01:31:36.797 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-02T01:31:36.797 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-02T01:31:36.797 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-02T01:31:36.797 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gmake... /usr/bin/gmake 2023-12-02T01:31:36.797 INFO:teuthology.orchestra.run.smithi001.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-12-02T01:31:36.798 INFO:teuthology.orchestra.run.smithi001.stdout:checking for tar... /bin/tar 2023-12-02T01:31:36.798 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gzip... /bin/gzip 2023-12-02T01:31:36.807 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether gcc -MM is supported... yes 2023-12-02T01:31:36.807 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sort... /bin/sort 2023-12-02T01:31:36.807 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether ln -s works... yes 2023-12-02T01:31:36.807 INFO:teuthology.orchestra.run.smithi001.stdout:checking for rpm... /bin/rpm 2023-12-02T01:31:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:checking for rpmbuild... no 2023-12-02T01:31:36.835 INFO:teuthology.orchestra.run.smithi001.stdout:checking assert.h usability... yes 2023-12-02T01:31:36.843 INFO:teuthology.orchestra.run.smithi001.stdout:checking assert.h presence... yes 2023-12-02T01:31:36.843 INFO:teuthology.orchestra.run.smithi001.stdout:checking for assert.h... yes 2023-12-02T01:31:36.870 INFO:teuthology.orchestra.run.smithi001.stdout:checking bstring.h usability... no 2023-12-02T01:31:36.881 INFO:teuthology.orchestra.run.smithi001.stdout:checking bstring.h presence... no 2023-12-02T01:31:36.881 INFO:teuthology.orchestra.run.smithi001.stdout:checking for bstring.h... no 2023-12-02T01:31:36.909 INFO:teuthology.orchestra.run.smithi001.stdout:checking libgen.h usability... yes 2023-12-02T01:31:36.917 INFO:teuthology.orchestra.run.smithi001.stdout:checking libgen.h presence... yes 2023-12-02T01:31:36.917 INFO:teuthology.orchestra.run.smithi001.stdout:checking for libgen.h... yes 2023-12-02T01:31:36.952 INFO:teuthology.orchestra.run.smithi001.stdout:checking dirent.h usability... yes 2023-12-02T01:31:36.961 INFO:teuthology.orchestra.run.smithi001.stdout:checking dirent.h presence... yes 2023-12-02T01:31:36.961 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dirent.h... yes 2023-12-02T01:31:37.017 INFO:teuthology.orchestra.run.smithi001.stdout:checking errno.h usability... yes 2023-12-02T01:31:37.026 INFO:teuthology.orchestra.run.smithi001.stdout:checking errno.h presence... yes 2023-12-02T01:31:37.026 INFO:teuthology.orchestra.run.smithi001.stdout:checking for errno.h... yes 2023-12-02T01:31:37.060 INFO:teuthology.orchestra.run.smithi001.stdout:checking malloc.h usability... yes 2023-12-02T01:31:37.069 INFO:teuthology.orchestra.run.smithi001.stdout:checking malloc.h presence... yes 2023-12-02T01:31:37.070 INFO:teuthology.orchestra.run.smithi001.stdout:checking for malloc.h... yes 2023-12-02T01:31:37.098 INFO:teuthology.orchestra.run.smithi001.stdout:checking uuid.h usability... no 2023-12-02T01:31:37.109 INFO:teuthology.orchestra.run.smithi001.stdout:checking uuid.h presence... no 2023-12-02T01:31:37.109 INFO:teuthology.orchestra.run.smithi001.stdout:checking for uuid.h... no 2023-12-02T01:31:37.145 INFO:teuthology.orchestra.run.smithi001.stdout:checking uuid/uuid.h usability... yes 2023-12-02T01:31:37.156 INFO:teuthology.orchestra.run.smithi001.stdout:checking uuid/uuid.h presence... yes 2023-12-02T01:31:37.156 INFO:teuthology.orchestra.run.smithi001.stdout:checking for uuid/uuid.h... yes 2023-12-02T01:31:37.183 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/uuid.h usability... no 2023-12-02T01:31:37.193 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/uuid.h presence... no 2023-12-02T01:31:37.194 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/uuid.h... no 2023-12-02T01:31:37.220 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/file.h usability... yes 2023-12-02T01:31:37.229 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/file.h presence... yes 2023-12-02T01:31:37.229 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/file.h... yes 2023-12-02T01:31:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/fcntl.h usability... yes 2023-12-02T01:31:37.273 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/fcntl.h presence... yes 2023-12-02T01:31:37.273 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/fcntl.h... yes 2023-12-02T01:31:37.300 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/syssgi.h usability... no 2023-12-02T01:31:37.311 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/syssgi.h presence... no 2023-12-02T01:31:37.311 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/syssgi.h... no 2023-12-02T01:31:37.349 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/param.h usability... yes 2023-12-02T01:31:37.361 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/param.h presence... yes 2023-12-02T01:31:37.361 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/param.h... yes 2023-12-02T01:31:37.366 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/stat.h... (cached) yes 2023-12-02T01:31:37.394 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/statvfs.h usability... yes 2023-12-02T01:31:37.403 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/statvfs.h presence... yes 2023-12-02T01:31:37.403 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/statvfs.h... yes 2023-12-02T01:31:37.430 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/time.h usability... yes 2023-12-02T01:31:37.439 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/time.h presence... yes 2023-12-02T01:31:37.439 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/time.h... yes 2023-12-02T01:31:37.479 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/ioctl.h usability... yes 2023-12-02T01:31:37.488 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/ioctl.h presence... yes 2023-12-02T01:31:37.488 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/ioctl.h... yes 2023-12-02T01:31:37.521 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/wait.h usability... yes 2023-12-02T01:31:37.532 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/wait.h presence... yes 2023-12-02T01:31:37.532 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/wait.h... yes 2023-12-02T01:31:37.536 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/types.h... (cached) yes 2023-12-02T01:31:37.541 INFO:teuthology.orchestra.run.smithi001.stdout:checking for strings.h... (cached) yes 2023-12-02T01:31:37.569 INFO:teuthology.orchestra.run.smithi001.stdout:checking err.h usability... yes 2023-12-02T01:31:37.577 INFO:teuthology.orchestra.run.smithi001.stdout:checking err.h presence... yes 2023-12-02T01:31:37.577 INFO:teuthology.orchestra.run.smithi001.stdout:checking for err.h... yes 2023-12-02T01:31:37.606 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/falloc.h usability... yes 2023-12-02T01:31:37.613 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/falloc.h presence... yes 2023-12-02T01:31:37.613 INFO:teuthology.orchestra.run.smithi001.stdout:checking for linux/falloc.h... yes 2023-12-02T01:31:37.642 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-02T01:31:37.652 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-02T01:31:37.653 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-02T01:31:37.676 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-02T01:31:37.687 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-02T01:31:37.688 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-02T01:31:37.711 INFO:teuthology.orchestra.run.smithi001.stdout:checking xfs/platform_defs.h usability... no 2023-12-02T01:31:37.722 INFO:teuthology.orchestra.run.smithi001.stdout:checking xfs/platform_defs.h presence... no 2023-12-02T01:31:37.722 INFO:teuthology.orchestra.run.smithi001.stdout:checking for xfs/platform_defs.h... no 2023-12-02T01:31:37.746 INFO:teuthology.orchestra.run.smithi001.stdout:checking btrfs/ioctl.h usability... no 2023-12-02T01:31:37.757 INFO:teuthology.orchestra.run.smithi001.stdout:checking btrfs/ioctl.h presence... no 2023-12-02T01:31:37.757 INFO:teuthology.orchestra.run.smithi001.stdout:checking for btrfs/ioctl.h... no 2023-12-02T01:31:37.781 INFO:teuthology.orchestra.run.smithi001.stdout:checking cifs/ioctl.h usability... no 2023-12-02T01:31:37.792 INFO:teuthology.orchestra.run.smithi001.stdout:checking cifs/ioctl.h presence... no 2023-12-02T01:31:37.792 INFO:teuthology.orchestra.run.smithi001.stdout:checking for cifs/ioctl.h... no 2023-12-02T01:31:37.819 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/mman.h usability... yes 2023-12-02T01:31:37.828 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/mman.h presence... yes 2023-12-02T01:31:37.828 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/mman.h... yes 2023-12-02T01:31:37.842 INFO:teuthology.orchestra.run.smithi001.stdout:checking for xfs/xfs_log_format.h... no 2023-12-02T01:31:37.878 INFO:teuthology.orchestra.run.smithi001.stdout:checking for uuid_compare... no 2023-12-02T01:31:37.908 INFO:teuthology.orchestra.run.smithi001.stdout:checking for uuid_compare in -luuid... yes 2023-12-02T01:31:37.983 INFO:teuthology.orchestra.run.smithi001.stdout:checking for xfs/xfs.h... yes 2023-12-02T01:31:37.996 INFO:teuthology.orchestra.run.smithi001.stdout:checking for xfs/libxfs.h... no 2023-12-02T01:31:38.011 INFO:teuthology.orchestra.run.smithi001.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-02T01:31:38.041 INFO:teuthology.orchestra.run.smithi001.stdout:checking for xfs/xqm.h... yes 2023-12-02T01:31:38.090 INFO:teuthology.orchestra.run.smithi001.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-02T01:31:38.114 INFO:teuthology.orchestra.run.smithi001.stdout:checking xfs/handle.h usability... yes 2023-12-02T01:31:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:checking xfs/handle.h presence... yes 2023-12-02T01:31:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:checking for xfs/handle.h... yes 2023-12-02T01:31:38.161 INFO:teuthology.orchestra.run.smithi001.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-02T01:31:38.185 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/acl.h usability... yes 2023-12-02T01:31:38.194 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/acl.h presence... yes 2023-12-02T01:31:38.194 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/acl.h... yes 2023-12-02T01:31:38.218 INFO:teuthology.orchestra.run.smithi001.stdout:checking acl/libacl.h usability... yes 2023-12-02T01:31:38.228 INFO:teuthology.orchestra.run.smithi001.stdout:checking acl/libacl.h presence... yes 2023-12-02T01:31:38.228 INFO:teuthology.orchestra.run.smithi001.stdout:checking for acl/libacl.h... yes 2023-12-02T01:31:38.261 INFO:teuthology.orchestra.run.smithi001.stdout:checking for acl_init in -lacl... yes 2023-12-02T01:31:38.283 INFO:teuthology.orchestra.run.smithi001.stdout:checking gdbm-ndbm.h usability... no 2023-12-02T01:31:38.294 INFO:teuthology.orchestra.run.smithi001.stdout:checking gdbm-ndbm.h presence... no 2023-12-02T01:31:38.294 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gdbm-ndbm.h... no 2023-12-02T01:31:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:checking gdbm/ndbm.h usability... yes 2023-12-02T01:31:38.327 INFO:teuthology.orchestra.run.smithi001.stdout:checking gdbm/ndbm.h presence... yes 2023-12-02T01:31:38.327 INFO:teuthology.orchestra.run.smithi001.stdout:checking for gdbm/ndbm.h... yes 2023-12-02T01:31:38.363 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_open in -lgdbm... no 2023-12-02T01:31:38.397 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_fetch in -lgdbm... no 2023-12-02T01:31:38.432 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_store in -lgdbm... no 2023-12-02T01:31:38.467 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_close in -lgdbm... no 2023-12-02T01:31:38.511 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-12-02T01:31:38.543 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-12-02T01:31:38.576 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-12-02T01:31:38.609 INFO:teuthology.orchestra.run.smithi001.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-12-02T01:31:38.633 INFO:teuthology.orchestra.run.smithi001.stdout:checking libaio.h usability... yes 2023-12-02T01:31:38.644 INFO:teuthology.orchestra.run.smithi001.stdout:checking libaio.h presence... yes 2023-12-02T01:31:38.644 INFO:teuthology.orchestra.run.smithi001.stdout:checking for libaio.h... yes 2023-12-02T01:31:38.667 INFO:teuthology.orchestra.run.smithi001.stdout:checking liburing.h usability... no 2023-12-02T01:31:38.679 INFO:teuthology.orchestra.run.smithi001.stdout:checking liburing.h presence... no 2023-12-02T01:31:38.679 INFO:teuthology.orchestra.run.smithi001.stdout:checking for liburing.h... no 2023-12-02T01:31:38.702 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/capability.h usability... yes 2023-12-02T01:31:38.713 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/capability.h presence... yes 2023-12-02T01:31:38.713 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/capability.h... yes 2023-12-02T01:31:38.737 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/fiemap.h usability... yes 2023-12-02T01:31:38.745 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/fiemap.h presence... yes 2023-12-02T01:31:38.745 INFO:teuthology.orchestra.run.smithi001.stdout:checking for linux/fiemap.h... yes 2023-12-02T01:31:38.779 INFO:teuthology.orchestra.run.smithi001.stdout:checking for fallocate... yes 2023-12-02T01:31:38.814 INFO:teuthology.orchestra.run.smithi001.stdout:checking for open_by_handle_at... yes 2023-12-02T01:31:38.843 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/prctl.h usability... yes 2023-12-02T01:31:38.852 INFO:teuthology.orchestra.run.smithi001.stdout:checking sys/prctl.h presence... yes 2023-12-02T01:31:38.852 INFO:teuthology.orchestra.run.smithi001.stdout:checking for sys/prctl.h... yes 2023-12-02T01:31:38.876 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/fs.h usability... yes 2023-12-02T01:31:38.885 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/fs.h presence... yes 2023-12-02T01:31:38.885 INFO:teuthology.orchestra.run.smithi001.stdout:checking for linux/fs.h... yes 2023-12-02T01:31:38.907 INFO:teuthology.orchestra.run.smithi001.stdout:checking btrfsutil.h usability... no 2023-12-02T01:31:38.918 INFO:teuthology.orchestra.run.smithi001.stdout:checking btrfsutil.h presence... no 2023-12-02T01:31:38.918 INFO:teuthology.orchestra.run.smithi001.stdout:checking for btrfsutil.h... no 2023-12-02T01:31:38.963 INFO:teuthology.orchestra.run.smithi001.stdout:checking for copy_file_range... yes 2023-12-02T01:31:39.000 INFO:teuthology.orchestra.run.smithi001.stdout:checking for SEEK_DATA... yes 2023-12-02T01:31:39.050 INFO:teuthology.orchestra.run.smithi001.stdout:checking for BMV_OF_SHARED... yes 2023-12-02T01:31:39.088 INFO:teuthology.orchestra.run.smithi001.stdout:checking for nftw... yes 2023-12-02T01:31:39.124 INFO:teuthology.orchestra.run.smithi001.stdout:checking for RLIMIT_NOFILE... yes 2023-12-02T01:31:39.142 INFO:teuthology.orchestra.run.smithi001.stdout:checking for FIEXCHANGE_RANGE... no 2023-12-02T01:31:39.176 INFO:teuthology.orchestra.run.smithi001.stdout:checking for renameat2... yes 2023-12-02T01:31:39.210 INFO:teuthology.orchestra.run.smithi001.stdout:checking for reallocarray... yes 2023-12-02T01:31:39.241 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct mount_attr... yes 2023-12-02T01:31:39.274 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-02T01:31:39.306 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-02T01:31:39.339 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-02T01:31:39.371 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-02T01:31:39.404 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-02T01:31:39.437 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-02T01:31:39.469 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-02T01:31:39.497 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/btrfs.h usability... yes 2023-12-02T01:31:39.505 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/btrfs.h presence... yes 2023-12-02T01:31:39.505 INFO:teuthology.orchestra.run.smithi001.stdout:checking for linux/btrfs.h... yes 2023-12-02T01:31:39.535 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-02T01:31:39.544 INFO:teuthology.orchestra.run.smithi001.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-02T01:31:39.544 INFO:teuthology.orchestra.run.smithi001.stdout:checking for linux/btrfs_tree.h... yes 2023-12-02T01:31:39.565 INFO:teuthology.orchestra.run.smithi001.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-02T01:31:39.581 INFO:teuthology.orchestra.run.smithi001.stdout:configure: creating ./config.status 2023-12-02T01:31:39.885 INFO:teuthology.orchestra.run.smithi001.stdout:config.status: creating include/builddefs 2023-12-02T01:31:39.896 INFO:teuthology.orchestra.run.smithi001.stdout:config.status: creating include/config.h 2023-12-02T01:31:39.904 INFO:teuthology.orchestra.run.smithi001.stdout:config.status: executing libtool commands 2023-12-02T01:31:39.942 INFO:teuthology.orchestra.run.smithi001.stdout:Building include 2023-12-02T01:31:39.945 INFO:teuthology.orchestra.run.smithi001.stdout:Building lib 2023-12-02T01:31:39.948 INFO:teuthology.orchestra.run.smithi001.stdout: [LTDEP] 2023-12-02T01:31:40.097 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dataascii.lo 2023-12-02T01:31:40.205 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] databin.lo 2023-12-02T01:31:40.343 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] datapid.lo 2023-12-02T01:31:40.439 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] file_lock.lo 2023-12-02T01:31:40.578 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] forker.lo 2023-12-02T01:31:40.703 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] pattern.lo 2023-12-02T01:31:40.815 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] open_flags.lo 2023-12-02T01:31:40.946 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] random_range.lo 2023-12-02T01:31:41.159 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] string_to_tokens.lo 2023-12-02T01:31:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] str_to_bytes.lo 2023-12-02T01:31:41.378 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] tlibio.lo 2023-12-02T01:31:41.606 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] write_log.lo 2023-12-02T01:31:41.831 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] random.lo 2023-12-02T01:31:41.929 INFO:teuthology.orchestra.run.smithi001.stdout: [LD] 2023-12-02T01:31:42.008 INFO:teuthology.orchestra.run.smithi001.stdout:Building ltp 2023-12-02T01:31:42.011 INFO:teuthology.orchestra.run.smithi001.stdout: [DEP] 2023-12-02T01:31:42.148 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] doio 2023-12-02T01:31:42.780 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fsstress 2023-12-02T01:31:44.153 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fsx 2023-12-02T01:31:44.843 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] growfiles 2023-12-02T01:31:45.311 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] iogen 2023-12-02T01:31:45.658 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-stress 2023-12-02T01:31:46.056 INFO:teuthology.orchestra.run.smithi001.stdout:Building src 2023-12-02T01:31:46.062 INFO:teuthology.orchestra.run.smithi001.stdout: [DEP] 2023-12-02T01:31:46.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:31:46.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:31:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: [DEP] 2023-12-02T01:31:47.828 INFO:teuthology.orchestra.run.smithi001.stdout: [DEP] 2023-12-02T01:31:47.835 INFO:teuthology.orchestra.run.smithi001.stdout: [DEP] 2023-12-02T01:31:48.049 INFO:teuthology.orchestra.run.smithi001.stdout: [DEP] 2023-12-02T01:31:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dirstress 2023-12-02T01:31:48.282 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fill 2023-12-02T01:31:48.417 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fill2 2023-12-02T01:31:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] getpagesize 2023-12-02T01:31:48.738 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] holes 2023-12-02T01:31:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] lstat64 2023-12-02T01:31:49.074 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] nametest 2023-12-02T01:31:49.289 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] permname 2023-12-02T01:31:49.465 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] randholes 2023-12-02T01:31:49.687 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] runas 2023-12-02T01:31:49.841 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] truncfile 2023-12-02T01:31:49.999 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] usemem 2023-12-02T01:31:50.129 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] mmapcat 2023-12-02T01:31:50.257 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] append_reader 2023-12-02T01:31:50.388 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] append_writer 2023-12-02T01:31:50.519 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dirperf 2023-12-02T01:31:50.723 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] metaperf 2023-12-02T01:31:50.971 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] devzero 2023-12-02T01:31:51.124 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] feature 2023-12-02T01:31:51.316 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] alloc 2023-12-02T01:31:51.501 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fault 2023-12-02T01:31:51.644 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fstest 2023-12-02T01:31:51.859 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_access_root 2023-12-02T01:31:51.993 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] godown 2023-12-02T01:31:52.142 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] resvtest 2023-12-02T01:31:52.305 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] writemod 2023-12-02T01:31:52.431 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] writev_on_pagefault 2023-12-02T01:31:52.569 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] makeextents 2023-12-02T01:31:52.726 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] itrash 2023-12-02T01:31:52.858 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] rename 2023-12-02T01:31:52.978 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] multi_open_unlink 2023-12-02T01:31:53.124 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] unwritten_sync 2023-12-02T01:31:53.283 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] genhashnames 2023-12-02T01:31:53.452 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_holes 2023-12-02T01:31:53.581 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_writev 2023-12-02T01:31:53.709 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_truncate_cmtime 2023-12-02T01:31:53.847 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dirhash_collide 2023-12-02T01:31:54.008 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_rename_overwrite 2023-12-02T01:31:54.130 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] holetest 2023-12-02T01:31:54.333 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_truncate_self 2023-12-02T01:31:54.456 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] af_unix 2023-12-02T01:31:54.588 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_stale_pmd 2023-12-02T01:31:54.720 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_cow_race 2023-12-02T01:31:54.866 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_fallocate 2023-12-02T01:31:54.997 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fsync-err 2023-12-02T01:31:55.160 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_write_ro 2023-12-02T01:31:55.292 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-02T01:31:55.431 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-02T01:31:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_ofd_locks 2023-12-02T01:31:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_collision 2023-12-02T01:31:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] mmap-write-concurrent 2023-12-02T01:31:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_get_file_time 2023-12-02T01:31:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_create_short_dirs 2023-12-02T01:31:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_create_long_dirs 2023-12-02T01:31:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_enospc 2023-12-02T01:31:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_writev_overlap 2023-12-02T01:31:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] checkpoint_journal 2023-12-02T01:31:56.935 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] mmap-rw-fault 2023-12-02T01:31:57.097 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] allocstale 2023-12-02T01:31:57.249 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_cow_memory_failure 2023-12-02T01:31:57.399 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fake-dump-rootino 2023-12-02T01:31:57.530 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dio-buf-fault 2023-12-02T01:31:57.664 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] rewinddir-test 2023-12-02T01:31:57.818 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] xfsctl 2023-12-02T01:31:57.984 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] bstat 2023-12-02T01:31:58.169 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mtab 2023-12-02T01:31:58.334 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] getdevicesize 2023-12-02T01:31:58.460 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] preallo_rw_pattern_reader 2023-12-02T01:31:58.597 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] preallo_rw_pattern_writer 2023-12-02T01:31:58.737 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] ftrunc 2023-12-02T01:31:58.865 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] trunc 2023-12-02T01:31:59.008 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fs_perms 2023-12-02T01:31:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] testx 2023-12-02T01:31:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] looptest 2023-12-02T01:31:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] locktest 2023-12-02T01:31:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] unwritten_mmap 2023-12-02T01:31:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] bulkstat_unlink_test 2023-12-02T01:32:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] deduperace 2023-12-02T01:32:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] bulkstat_unlink_test_modified 2023-12-02T01:32:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_dir_offset 2023-12-02T01:32:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_futimens 2023-12-02T01:32:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_immutable 2023-12-02T01:32:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] stale_handle 2023-12-02T01:32:01.370 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] pwrite_mmap_blocked 2023-12-02T01:32:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_dir_offset2 2023-12-02T01:32:01.674 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] seek_sanity_test 2023-12-02T01:32:02.093 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] seek_copy_test 2023-12-02T01:32:02.249 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_readdir_1 2023-12-02T01:32:02.378 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_readdir_2 2023-12-02T01:32:02.510 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fsync-tester 2023-12-02T01:32:02.737 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] nsexec 2023-12-02T01:32:02.893 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] cloner 2023-12-02T01:32:03.051 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] renameat2 2023-12-02T01:32:03.197 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_getcwd 2023-12-02T01:32:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] e4compact 2023-12-02T01:32:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] test-nextquota 2023-12-02T01:32:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] punch-alternating 2023-12-02T01:32:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-02T01:32:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] listxattr 2023-12-02T01:32:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dio-interleaved 2023-12-02T01:32:04.235 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_dir_type 2023-12-02T01:32:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dio-invalidate-cache 2023-12-02T01:32:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] stat_test 2023-12-02T01:32:04.820 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_encrypted_d_revalidate 2023-12-02T01:32:04.965 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] attr_replace_test 2023-12-02T01:32:05.107 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] swapon 2023-12-02T01:32:05.253 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] mkswap 2023-12-02T01:32:05.385 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_attr_corruption 2023-12-02T01:32:05.517 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_open_tmpfiles 2023-12-02T01:32:05.674 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fscrypt-crypt-util 2023-12-02T01:32:06.301 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] bulkstat_null_ocount 2023-12-02T01:32:06.440 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] splice-test 2023-12-02T01:32:06.602 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] chprojid_fail 2023-12-02T01:32:06.743 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] detached_mounts_propagation 2023-12-02T01:32:06.906 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] ext4_resize 2023-12-02T01:32:07.037 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_readdir_3 2023-12-02T01:32:07.210 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] splice2pipe 2023-12-02T01:32:07.352 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] uuid_ioctl 2023-12-02T01:32:07.489 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fiemap-tester 2023-12-02T01:32:07.728 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_stripealign 2023-12-02T01:32:07.863 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] open_by_handle 2023-12-02T01:32:08.089 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] dbtest 2023-12-02T01:32:08.312 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] t_mmap_dio 2023-12-02T01:32:08.453 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] xfsfind 2023-12-02T01:32:08.626 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] fssum 2023-12-02T01:32:09.038 INFO:teuthology.orchestra.run.smithi001.stdout:Building log-writes 2023-12-02T01:32:09.043 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] replay-log 2023-12-02T01:32:09.334 INFO:teuthology.orchestra.run.smithi001.stdout:Building perf 2023-12-02T01:32:09.337 INFO:teuthology.orchestra.run.smithi001.stdout:Building aio-dio-regress 2023-12-02T01:32:09.343 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aiocp 2023-12-02T01:32:09.548 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-02T01:32:09.696 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-append-write-read-race 2023-12-02T01:32:09.850 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-cow-race 2023-12-02T01:32:09.983 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-cycle-write 2023-12-02T01:32:10.146 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-eof-race 2023-12-02T01:32:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-extend-stat 2023-12-02T01:32:10.452 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-fcntl-race 2023-12-02T01:32:10.596 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-hole-filling-race 2023-12-02T01:32:10.726 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-invalidate-failure 2023-12-02T01:32:10.866 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-invalidate-readahead 2023-12-02T01:32:11.011 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aiodio_sparse2 2023-12-02T01:32:11.207 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-subblock-eof-read 2023-12-02T01:32:11.331 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-dio-write-verify 2023-12-02T01:32:11.504 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-02T01:32:11.620 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-02T01:32:11.734 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] aio-last-ref-held-by-io 2023-12-02T01:32:11.887 INFO:teuthology.orchestra.run.smithi001.stdout:Building vfs 2023-12-02T01:32:11.893 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] vfstest 2023-12-02T01:32:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: [CC] mount-idmapped 2023-12-02T01:32:15.689 INFO:teuthology.orchestra.run.smithi001.stdout:Building m4 2023-12-02T01:32:15.693 INFO:teuthology.orchestra.run.smithi001.stdout:Building common 2023-12-02T01:32:15.696 INFO:teuthology.orchestra.run.smithi001.stdout:Building tests 2023-12-02T01:32:15.702 INFO:teuthology.orchestra.run.smithi001.stdout:Building btrfs 2023-12-02T01:32:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/btrfs/group.list 2023-12-02T01:32:15.767 INFO:teuthology.orchestra.run.smithi001.stdout:Building ceph 2023-12-02T01:32:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ceph/group.list 2023-12-02T01:32:15.787 INFO:teuthology.orchestra.run.smithi001.stdout:Building cifs 2023-12-02T01:32:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/cifs/group.list 2023-12-02T01:32:15.804 INFO:teuthology.orchestra.run.smithi001.stdout:Building ext4 2023-12-02T01:32:15.810 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ext4/group.list 2023-12-02T01:32:15.848 INFO:teuthology.orchestra.run.smithi001.stdout:Building f2fs 2023-12-02T01:32:15.853 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/f2fs/group.list 2023-12-02T01:32:15.870 INFO:teuthology.orchestra.run.smithi001.stdout:Building generic 2023-12-02T01:32:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/generic/group.list 2023-12-02T01:32:15.976 INFO:teuthology.orchestra.run.smithi001.stdout:Building nfs 2023-12-02T01:32:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/nfs/group.list 2023-12-02T01:32:15.995 INFO:teuthology.orchestra.run.smithi001.stdout:Building ocfs2 2023-12-02T01:32:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ocfs2/group.list 2023-12-02T01:32:16.013 INFO:teuthology.orchestra.run.smithi001.stdout:Building overlay 2023-12-02T01:32:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/overlay/group.list 2023-12-02T01:32:16.059 INFO:teuthology.orchestra.run.smithi001.stdout:Building perf 2023-12-02T01:32:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/perf/group.list 2023-12-02T01:32:16.076 INFO:teuthology.orchestra.run.smithi001.stdout:Building selftest 2023-12-02T01:32:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/selftest/group.list 2023-12-02T01:32:16.094 INFO:teuthology.orchestra.run.smithi001.stdout:Building shared 2023-12-02T01:32:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/shared/group.list 2023-12-02T01:32:16.116 INFO:teuthology.orchestra.run.smithi001.stdout:Building tmpfs 2023-12-02T01:32:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/tmpfs/group.list 2023-12-02T01:32:16.135 INFO:teuthology.orchestra.run.smithi001.stdout:Building udf 2023-12-02T01:32:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/udf/group.list 2023-12-02T01:32:16.151 INFO:teuthology.orchestra.run.smithi001.stdout:Building xfs 2023-12-02T01:32:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/xfs/group.list 2023-12-02T01:32:16.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:32:16.218 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:32:16.258 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo make install) 2023-12-02T01:32:16.355 INFO:teuthology.orchestra.run.smithi001.stdout:Building include 2023-12-02T01:32:16.358 INFO:teuthology.orchestra.run.smithi001.stdout:Building lib 2023-12-02T01:32:16.363 INFO:teuthology.orchestra.run.smithi001.stdout:Building ltp 2023-12-02T01:32:16.367 INFO:teuthology.orchestra.run.smithi001.stdout:Building src 2023-12-02T01:32:16.400 INFO:teuthology.orchestra.run.smithi001.stdout:Building log-writes 2023-12-02T01:32:16.404 INFO:teuthology.orchestra.run.smithi001.stdout:Building perf 2023-12-02T01:32:16.407 INFO:teuthology.orchestra.run.smithi001.stdout:Building aio-dio-regress 2023-12-02T01:32:16.411 INFO:teuthology.orchestra.run.smithi001.stdout:Building vfs 2023-12-02T01:32:16.415 INFO:teuthology.orchestra.run.smithi001.stdout:Building m4 2023-12-02T01:32:16.419 INFO:teuthology.orchestra.run.smithi001.stdout:Building common 2023-12-02T01:32:16.422 INFO:teuthology.orchestra.run.smithi001.stdout:Building tests 2023-12-02T01:32:16.427 INFO:teuthology.orchestra.run.smithi001.stdout:Building btrfs 2023-12-02T01:32:16.433 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/btrfs/group.list 2023-12-02T01:32:16.492 INFO:teuthology.orchestra.run.smithi001.stdout:Building ceph 2023-12-02T01:32:16.497 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ceph/group.list 2023-12-02T01:32:16.512 INFO:teuthology.orchestra.run.smithi001.stdout:Building cifs 2023-12-02T01:32:16.517 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/cifs/group.list 2023-12-02T01:32:16.529 INFO:teuthology.orchestra.run.smithi001.stdout:Building ext4 2023-12-02T01:32:16.535 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ext4/group.list 2023-12-02T01:32:16.572 INFO:teuthology.orchestra.run.smithi001.stdout:Building f2fs 2023-12-02T01:32:16.577 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/f2fs/group.list 2023-12-02T01:32:16.595 INFO:teuthology.orchestra.run.smithi001.stdout:Building generic 2023-12-02T01:32:16.601 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/generic/group.list 2023-12-02T01:32:16.698 INFO:teuthology.orchestra.run.smithi001.stdout:Building nfs 2023-12-02T01:32:16.703 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/nfs/group.list 2023-12-02T01:32:16.718 INFO:teuthology.orchestra.run.smithi001.stdout:Building ocfs2 2023-12-02T01:32:16.722 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ocfs2/group.list 2023-12-02T01:32:16.735 INFO:teuthology.orchestra.run.smithi001.stdout:Building overlay 2023-12-02T01:32:16.740 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/overlay/group.list 2023-12-02T01:32:16.781 INFO:teuthology.orchestra.run.smithi001.stdout:Building perf 2023-12-02T01:32:16.787 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/perf/group.list 2023-12-02T01:32:16.798 INFO:teuthology.orchestra.run.smithi001.stdout:Building selftest 2023-12-02T01:32:16.803 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/selftest/group.list 2023-12-02T01:32:16.815 INFO:teuthology.orchestra.run.smithi001.stdout:Building shared 2023-12-02T01:32:16.820 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/shared/group.list 2023-12-02T01:32:16.838 INFO:teuthology.orchestra.run.smithi001.stdout:Building tmpfs 2023-12-02T01:32:16.843 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/tmpfs/group.list 2023-12-02T01:32:16.856 INFO:teuthology.orchestra.run.smithi001.stdout:Building udf 2023-12-02T01:32:16.862 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/udf/group.list 2023-12-02T01:32:16.873 INFO:teuthology.orchestra.run.smithi001.stdout:Building xfs 2023-12-02T01:32:16.879 INFO:teuthology.orchestra.run.smithi001.stdout: [GROUP] /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/xfs/group.list 2023-12-02T01:32:16.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-02T01:32:16.979 INFO:teuthology.orchestra.run.smithi001.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-02T01:32:16.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-02T01:32:16.981 INFO:teuthology.orchestra.run.smithi001.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-02T01:32:16.981 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-02T01:32:16.983 INFO:teuthology.orchestra.run.smithi001.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-02T01:32:16.992 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-02T01:32:17.061 INFO:teuthology.orchestra.run.smithi001.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-02T01:32:17.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-02T01:32:17.087 INFO:teuthology.orchestra.run.smithi001.stdout:Building log-writes 2023-12-02T01:32:17.091 INFO:teuthology.orchestra.run.smithi001.stdout:Building perf 2023-12-02T01:32:17.094 INFO:teuthology.orchestra.run.smithi001.stdout:Building aio-dio-regress 2023-12-02T01:32:17.098 INFO:teuthology.orchestra.run.smithi001.stdout:Building vfs 2023-12-02T01:32:17.101 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake -C log-writes install 2023-12-02T01:32:17.103 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-02T01:32:17.111 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-02T01:32:17.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake -C perf install 2023-12-02T01:32:17.121 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-02T01:32:17.130 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-02T01:32:17.151 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-02T01:32:17.153 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-02T01:32:17.161 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-02T01:32:17.210 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake -C vfs install 2023-12-02T01:32:17.212 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-02T01:32:17.220 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-02T01:32:17.232 INFO:teuthology.orchestra.run.smithi001.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-02T01:32:17.240 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-12-02T01:32:18.371 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-02T01:32:18.465 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-02T01:32:18.490 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-02T01:32:18.492 INFO:teuthology.orchestra.run.smithi001.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-02T01:32:18.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-02T01:32:18.493 INFO:teuthology.orchestra.run.smithi001.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-02T01:32:18.501 INFO:teuthology.orchestra.run.smithi001.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-02T01:32:18.625 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-02T01:32:18.627 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/btrfs/ install 2023-12-02T01:32:18.630 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-02T01:32:18.638 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-12-02T01:32:19.399 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-02T01:32:19.408 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-12-02T01:32:20.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ceph/ install 2023-12-02T01:32:20.175 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-02T01:32:20.183 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-02T01:32:20.202 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-02T01:32:20.211 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-02T01:32:20.229 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/cifs/ install 2023-12-02T01:32:20.230 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-02T01:32:20.239 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-02T01:32:20.249 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-02T01:32:20.256 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-02T01:32:20.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ext4/ install 2023-12-02T01:32:20.267 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-02T01:32:20.275 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-02T01:32:20.450 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-02T01:32:20.459 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-02T01:32:20.642 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/f2fs/ install 2023-12-02T01:32:20.644 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-02T01:32:20.653 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-02T01:32:20.664 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-02T01:32:20.672 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-02T01:32:20.683 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/generic/ install 2023-12-02T01:32:20.689 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-02T01:32:20.698 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-12-02T01:32:22.542 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-02T01:32:22.551 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-12-02T01:32:24.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/nfs/ install 2023-12-02T01:32:24.412 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-02T01:32:24.421 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-02T01:32:24.430 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-02T01:32:24.438 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-02T01:32:24.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/ocfs2/ install 2023-12-02T01:32:24.448 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-02T01:32:24.457 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-02T01:32:24.465 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-02T01:32:24.474 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-02T01:32:24.482 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/overlay/ install 2023-12-02T01:32:24.485 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-02T01:32:24.493 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-02T01:32:24.754 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-02T01:32:24.760 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-02T01:32:25.019 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/perf/ install 2023-12-02T01:32:25.021 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-02T01:32:25.029 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-02T01:32:25.038 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-02T01:32:25.047 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-02T01:32:25.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/selftest/ install 2023-12-02T01:32:25.057 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-02T01:32:25.065 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-02T01:32:25.087 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-02T01:32:25.096 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-02T01:32:25.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/shared/ install 2023-12-02T01:32:25.118 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-02T01:32:25.127 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-02T01:32:25.140 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-02T01:32:25.149 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-02T01:32:25.163 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/tmpfs/ install 2023-12-02T01:32:25.164 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-02T01:32:25.172 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-02T01:32:25.181 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-02T01:32:25.189 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-02T01:32:25.198 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/udf/ install 2023-12-02T01:32:25.200 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-02T01:32:25.208 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-02T01:32:25.217 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-02T01:32:25.226 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-02T01:32:25.234 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.q8QLSYR2gwxfstests-dev/tests/xfs/ install 2023-12-02T01:32:25.240 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-02T01:32:25.248 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-02T01:32:26.991 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-02T01:32:27.000 INFO:teuthology.orchestra.run.smithi001.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-02T01:32:28.762 INFO:teuthology.orchestra.run.smithi001.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-02T01:32:28.771 INFO:teuthology.orchestra.run.smithi001.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-02T01:32:28.779 INFO:teuthology.orchestra.run.smithi001.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-02T01:32:28.788 INFO:teuthology.orchestra.run.smithi001.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-02T01:32:28.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T01:32:28.798 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec ls tests/generic) 2023-12-02T01:32:28.856 INFO:teuthology.orchestra.run.smithi001.stdout:001 2023-12-02T01:32:28.856 INFO:teuthology.orchestra.run.smithi001.stdout:001.out 2023-12-02T01:32:28.856 INFO:teuthology.orchestra.run.smithi001.stdout:002 2023-12-02T01:32:28.856 INFO:teuthology.orchestra.run.smithi001.stdout:002.out 2023-12-02T01:32:28.856 INFO:teuthology.orchestra.run.smithi001.stdout:003 2023-12-02T01:32:28.856 INFO:teuthology.orchestra.run.smithi001.stdout:003.out 2023-12-02T01:32:28.856 INFO:teuthology.orchestra.run.smithi001.stdout:004 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:004.out 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:005 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:005.out 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:006 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:006.out 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:007 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:007.out 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:008 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:008.out 2023-12-02T01:32:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:009 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:009.out 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:010 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:010.out 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:011 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:011.out 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:012 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:012.out 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:013 2023-12-02T01:32:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:013.out 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:014 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:014.out 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:015 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:015.out 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:016 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:016.out 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:017 2023-12-02T01:32:28.859 INFO:teuthology.orchestra.run.smithi001.stdout:017.out 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:018 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:018.out 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:019 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:019.out 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:020 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:020.out 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:021 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:021.out 2023-12-02T01:32:28.860 INFO:teuthology.orchestra.run.smithi001.stdout:022 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:022.out 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:023 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:023.out 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:024 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:024.out 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:025 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:025.out 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:026 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:026.out 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:027 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:027.out 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:028 2023-12-02T01:32:28.861 INFO:teuthology.orchestra.run.smithi001.stdout:028.out 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:029 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:029.out 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:030 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:030.out 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:031 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:031.out 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:032 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:032.out 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:033 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:033.out 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:034 2023-12-02T01:32:28.862 INFO:teuthology.orchestra.run.smithi001.stdout:034.out 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:035 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:035.cfg 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:035.out.default 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:035.out.nfs 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:036 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:036.out 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:037 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:037.out 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:038 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:038.out 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:039 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:039.out 2023-12-02T01:32:28.863 INFO:teuthology.orchestra.run.smithi001.stdout:040 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:040.out 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:041 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:041.out 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:042 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:042.out 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:043 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:043.out 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:044 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:044.out 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:045 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:045.out 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:046 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:046.out 2023-12-02T01:32:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:047 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:047.out 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:048 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:048.out 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:049 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:049.out 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:050 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:050.cfg 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:050.out.default 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:050.out.nojournal 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:050.out.xfsquota 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:051 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:051.out 2023-12-02T01:32:28.865 INFO:teuthology.orchestra.run.smithi001.stdout:052 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:052.out 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:053 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:053.out 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:054 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:054.out 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:055 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:055.out 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:056 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:056.out 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:057 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:057.out 2023-12-02T01:32:28.866 INFO:teuthology.orchestra.run.smithi001.stdout:058 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:058.out 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:059 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:059.out 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:060 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:060.out 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:061 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:061.out 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:062 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:062.out 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:063 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:063.out 2023-12-02T01:32:28.867 INFO:teuthology.orchestra.run.smithi001.stdout:064 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:064.out 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:065 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:065.out 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:066 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:066.out 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:067 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:067.out 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:068 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:068.out 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:069 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:069.out 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:070 2023-12-02T01:32:28.868 INFO:teuthology.orchestra.run.smithi001.stdout:070.out 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:071 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:071.out 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:072 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:072.out 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:073 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:073.out 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:074 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:074.out 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:075 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:075.out 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:076 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:076.out 2023-12-02T01:32:28.869 INFO:teuthology.orchestra.run.smithi001.stdout:077 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:077.out 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:078 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:078.out 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:079 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:079.out 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:080 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:080.out 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:081 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:081.out 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:082 2023-12-02T01:32:28.870 INFO:teuthology.orchestra.run.smithi001.stdout:082.out 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:083 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:083.out 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:084 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:084.out 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:085 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:085.out 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:086 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:086.out 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:087 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:087.out 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:088 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:088.out 2023-12-02T01:32:28.871 INFO:teuthology.orchestra.run.smithi001.stdout:089 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:089.out 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:090 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:090.out 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:091 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:091.out 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:092 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:092.out 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:093 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:093.out 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:094 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:094.out 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:095 2023-12-02T01:32:28.872 INFO:teuthology.orchestra.run.smithi001.stdout:095.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:096 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:096.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:097 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:097.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:098 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:098.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:099 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:099.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:100 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:100.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:101 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:101.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:102 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:102.out 2023-12-02T01:32:28.873 INFO:teuthology.orchestra.run.smithi001.stdout:103 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:103.out 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:104 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:104.out 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:105 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:105.out 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:106 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:106.out 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:107 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:107.out 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:108 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:108.out 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:109 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:109.out 2023-12-02T01:32:28.874 INFO:teuthology.orchestra.run.smithi001.stdout:110 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:110.out 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:111 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:111.out 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:112 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:112.out 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:113 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:113.out 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:114 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:114.out 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:115 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:115.out 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:116 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:116.out 2023-12-02T01:32:28.875 INFO:teuthology.orchestra.run.smithi001.stdout:117 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:117.out 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:118 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:118.out 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:119 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:119.out 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:120 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:120.out 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:121 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:121.out 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:122 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:122.out 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:123 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:123.out 2023-12-02T01:32:28.876 INFO:teuthology.orchestra.run.smithi001.stdout:124 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:124.out 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:125 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:125.out 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:126 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:126.out 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:127 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:127.out 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:128 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:128.out 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:129 2023-12-02T01:32:28.877 INFO:teuthology.orchestra.run.smithi001.stdout:129.out 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:130 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:130.out 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:131 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:131.out 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:132 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:132.out 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:133 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:133.out 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:134 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:134.out 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:135 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:135.out 2023-12-02T01:32:28.878 INFO:teuthology.orchestra.run.smithi001.stdout:136 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:136.out 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:137 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:137.out 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:138 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:138.out 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:139 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:139.out 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:140 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:140.out 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:141 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:141.out 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:142 2023-12-02T01:32:28.879 INFO:teuthology.orchestra.run.smithi001.stdout:142.out 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:143 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:143.out 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:144 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:144.out 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:145 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:145.out 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:146 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:146.out 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:147 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:147.out 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:148 2023-12-02T01:32:28.880 INFO:teuthology.orchestra.run.smithi001.stdout:148.out 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:149 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:149.out 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:150 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:150.out 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:151 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:151.out 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:152 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:152.out 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:153 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:153.out 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:154 2023-12-02T01:32:28.881 INFO:teuthology.orchestra.run.smithi001.stdout:154.out 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:155 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:155.out 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:156 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:156.out 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:157 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:157.out 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:158 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:158.out 2023-12-02T01:32:28.882 INFO:teuthology.orchestra.run.smithi001.stdout:159 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:159.out 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:160 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:160.out 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:161 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:161.out 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:162 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:162.out 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:163 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:163.out 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:164 2023-12-02T01:32:28.883 INFO:teuthology.orchestra.run.smithi001.stdout:164.out 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:165 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:165.out 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:166 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:166.out 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:167 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:167.out 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:168 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:168.out 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:169 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:169.out 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:170 2023-12-02T01:32:28.884 INFO:teuthology.orchestra.run.smithi001.stdout:170.out 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:171 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:171.out 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:172 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:172.out 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:173 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:173.out 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:174 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:174.out 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:175 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:175.out 2023-12-02T01:32:28.885 INFO:teuthology.orchestra.run.smithi001.stdout:176 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:176.out 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:177 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:177.out 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:178 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:178.out 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:179 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:179.out 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:180 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:180.out 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:181 2023-12-02T01:32:28.886 INFO:teuthology.orchestra.run.smithi001.stdout:181.out 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:182 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:182.out 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:183 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:183.out 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:184 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:184.out 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:185 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:185.out 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:186 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:186.out 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:187 2023-12-02T01:32:28.887 INFO:teuthology.orchestra.run.smithi001.stdout:187.out 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:188 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:188.out 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:189 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:189.out 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:190 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:190.out 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:191 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:191.out 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:192 2023-12-02T01:32:28.888 INFO:teuthology.orchestra.run.smithi001.stdout:192.out 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:193 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:193.out 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:194 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:194.out 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:195 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:195.out 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:196 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:196.out 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:197 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:197.out 2023-12-02T01:32:28.889 INFO:teuthology.orchestra.run.smithi001.stdout:198 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:198.out 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:199 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:199.out 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:200 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:200.out 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:201 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:201.out 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:202 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:202.out 2023-12-02T01:32:28.890 INFO:teuthology.orchestra.run.smithi001.stdout:203 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:203.out 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:204 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:204.out 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:205 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:205.out 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:206 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:206.out 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:207 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:207.out 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:208 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:208.out 2023-12-02T01:32:28.891 INFO:teuthology.orchestra.run.smithi001.stdout:209 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:209.out 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:210 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:210.out 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:211 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:211.out 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:212 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:212.out 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:213 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:213.out 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:214 2023-12-02T01:32:28.892 INFO:teuthology.orchestra.run.smithi001.stdout:214.out 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:215 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:215.out 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:216 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:216.out 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:217 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:217.out 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:218 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:218.out 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:219 2023-12-02T01:32:28.893 INFO:teuthology.orchestra.run.smithi001.stdout:219.out 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:220 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:220.out 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:221 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:221.out 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:222 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:222.out 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:223 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:223.out 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:224 2023-12-02T01:32:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:224.out 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:225 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:225.out 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:226 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:226.out 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:227 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:227.out 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:228 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:228.out 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:229 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:229.out 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:230 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:230.out 2023-12-02T01:32:28.895 INFO:teuthology.orchestra.run.smithi001.stdout:231 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:231.out 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:232 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:232.out 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:233 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:233.out 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:234 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:234.out 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:235 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:235.out 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:236 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:236.out 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:237 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:237.out 2023-12-02T01:32:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:238 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:238.out 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:239 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:239.out 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:240 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:240.out 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:241 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:241.out 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:242 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:242.out 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:243 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:243.out 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:244 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:244.out 2023-12-02T01:32:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:245 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:245.out 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:246 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:246.out 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:247 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:247.out 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:248 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:248.out 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:249 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:249.out 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:250 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:250.out 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:251 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:251.out 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:252 2023-12-02T01:32:28.898 INFO:teuthology.orchestra.run.smithi001.stdout:252.out 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:253 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:253.out 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:254 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:254.out 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:255 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:255.out 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:256 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:256.out 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:257 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:257.out 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:258 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:258.out 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:259 2023-12-02T01:32:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:259.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:260 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:260.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:261 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:261.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:262 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:262.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:263 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:263.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:264 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:264.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:265 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:265.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:266 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:266.out 2023-12-02T01:32:28.900 INFO:teuthology.orchestra.run.smithi001.stdout:267 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:267.out 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:268 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:268.out 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:269 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:269.out 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:270 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:270.out 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:271 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:271.out 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:272 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:272.out 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:273 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:273.out 2023-12-02T01:32:28.901 INFO:teuthology.orchestra.run.smithi001.stdout:274 2023-12-02T01:32:28.902 INFO:teuthology.orchestra.run.smithi001.stdout:274.out 2023-12-02T01:32:28.902 INFO:teuthology.orchestra.run.smithi001.stdout:275 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:275.out 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:276 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:276.out 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:277 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:277.out 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:278 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:278.out 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:279 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:279.out 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:280 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:280.out 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:281 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:281.out 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:282 2023-12-02T01:32:28.903 INFO:teuthology.orchestra.run.smithi001.stdout:282.out 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:283 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:283.out 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:284 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:284.out 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:285 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:285.out 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:286 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:286.out 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:287 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:287.out 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:288 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:288.out 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:289 2023-12-02T01:32:28.904 INFO:teuthology.orchestra.run.smithi001.stdout:289.out 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:290 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:290.out 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:291 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:291.out 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:292 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:292.out 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:293 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:293.out 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:294 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:294.out 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:295 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:295.out 2023-12-02T01:32:28.905 INFO:teuthology.orchestra.run.smithi001.stdout:296 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:296.out 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:297 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:297.out 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:298 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:298.out 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:299 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:299.out 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:300 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:300.out 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:301 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:301.out 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:302 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:302.out 2023-12-02T01:32:28.906 INFO:teuthology.orchestra.run.smithi001.stdout:303 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:303.out 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:304 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:304.out 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:305 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:305.out 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:306 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:306.out 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:307 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:307.out 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:308 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:308.out 2023-12-02T01:32:28.907 INFO:teuthology.orchestra.run.smithi001.stdout:309 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:309.out 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:310 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:310.out 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:311 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:311.out 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:312 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:312.out 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:313 2023-12-02T01:32:28.908 INFO:teuthology.orchestra.run.smithi001.stdout:313.out 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:314 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:314.out 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:315 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:315.out 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:316 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:316.out 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:317 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:317.out 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:318 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:318.out 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:319 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:319.out 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:320 2023-12-02T01:32:28.909 INFO:teuthology.orchestra.run.smithi001.stdout:320.out 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:321 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:321.out 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:322 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:322.out 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:323 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:323.out 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:324 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:324.out 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:325 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:325.out 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:326 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:326.out 2023-12-02T01:32:28.910 INFO:teuthology.orchestra.run.smithi001.stdout:327 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:327.out 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:328 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:328.out 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:329 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:329.out 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:330 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:330.out 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:331 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:331.out 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:332 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:332.out 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:333 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:333.out 2023-12-02T01:32:28.911 INFO:teuthology.orchestra.run.smithi001.stdout:334 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:334.out 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:335 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:335.out 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:336 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:336.out 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:337 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:337.out 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:338 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:338.out 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:339 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:339.out 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:340 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:340.out 2023-12-02T01:32:28.912 INFO:teuthology.orchestra.run.smithi001.stdout:341 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:341.out 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:342 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:342.out 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:343 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:343.out 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:344 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:344.out 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:345 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:345.out 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:346 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:346.out 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:347 2023-12-02T01:32:28.913 INFO:teuthology.orchestra.run.smithi001.stdout:347.out 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:348 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:348.out 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:349 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:349.out 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:350 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:350.out 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:351 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:351.out 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:352 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:352.out 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:353 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:353.out 2023-12-02T01:32:28.914 INFO:teuthology.orchestra.run.smithi001.stdout:354 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:354.out 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:355 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:355.out 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:356 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:356.out 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:357 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:357.out 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:358 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:358.out 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:359 2023-12-02T01:32:28.915 INFO:teuthology.orchestra.run.smithi001.stdout:359.out 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:360 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:360.out 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:361 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:361.out 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:362 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:362.out 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:363 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:363.out 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:364 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:364.out 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:365 2023-12-02T01:32:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:365.out 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:366 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:366.out 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:367 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:367.out 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:368 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:368.out 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:369 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:369.out 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:370 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:370.out 2023-12-02T01:32:28.917 INFO:teuthology.orchestra.run.smithi001.stdout:371 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:371.out 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:372 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:372.out 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:373 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:373.out 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:374 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:374.out 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:375 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:375.out 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:376 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:376.out 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:377 2023-12-02T01:32:28.918 INFO:teuthology.orchestra.run.smithi001.stdout:377.out 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:378 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:378.out 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:379 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:379.out 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:380 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:380.out 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:381 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:381.out 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:382 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:382.out 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:383 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:383.out 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:384 2023-12-02T01:32:28.919 INFO:teuthology.orchestra.run.smithi001.stdout:384.out 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:385 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:385.out 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:386 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:386.out 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:387 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:387.out 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:388 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:388.out 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:389 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:389.out 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:390 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:390.out 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:391 2023-12-02T01:32:28.920 INFO:teuthology.orchestra.run.smithi001.stdout:391.out 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:392 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:392.out 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:393 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:393.out 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:394 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:394.out 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:395 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:395.out 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:396 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:396.out 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:397 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:397.out 2023-12-02T01:32:28.921 INFO:teuthology.orchestra.run.smithi001.stdout:398 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:398.out 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:399 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:399.out 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:400 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:400.out 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:401 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:401.out 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:402 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:402.out 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:403 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:403.out 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:404 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:404.out 2023-12-02T01:32:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:405 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:405.out 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:406 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:406.out 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:407 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:407.out 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:408 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:408.out 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:409 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:409.out 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:410 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:410.out 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:411 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:411.out 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:412 2023-12-02T01:32:28.923 INFO:teuthology.orchestra.run.smithi001.stdout:412.out 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:413 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:413.out 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:414 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:414.out 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:415 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:415.out 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:416 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:416.out 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:417 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:417.out 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:418 2023-12-02T01:32:28.924 INFO:teuthology.orchestra.run.smithi001.stdout:418.out 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:419 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:419.out 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:420 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:420.out 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:421 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:421.out 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:422 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:422.out 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:423 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:423.out 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:424 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:424.out 2023-12-02T01:32:28.925 INFO:teuthology.orchestra.run.smithi001.stdout:425 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:425.out 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:426 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:426.out 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:427 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:427.out 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:428 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:428.out 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:429 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:429.out 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:430 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:430.out 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:431 2023-12-02T01:32:28.926 INFO:teuthology.orchestra.run.smithi001.stdout:431.out 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:432 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:432.out 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:433 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:433.out 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:434 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:434.out 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:435 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:435.out 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:436 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:436.out 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:437 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:437.out 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:438 2023-12-02T01:32:28.927 INFO:teuthology.orchestra.run.smithi001.stdout:438.out 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:439 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:439.out 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:440 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:440.out 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:441 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:441.out 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:442 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:442.out 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:443 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:443.out 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:444 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:444.out 2023-12-02T01:32:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:445 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:445.out 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:446 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:446.out 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:447 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:447.out 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:448 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:448.out 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:449 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:449.out 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:450 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:450.out 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:451 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:451.out 2023-12-02T01:32:28.929 INFO:teuthology.orchestra.run.smithi001.stdout:452 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:452.out 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:453 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:453.out 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:454 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:454.out 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:455 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:455.out 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:456 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:456.out 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:457 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:457.out 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:458 2023-12-02T01:32:28.930 INFO:teuthology.orchestra.run.smithi001.stdout:458.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:459 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:459.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:460 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:460.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:461 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:461.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:462 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:462.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:463 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:463.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:464 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:464.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:465 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:465.out 2023-12-02T01:32:28.931 INFO:teuthology.orchestra.run.smithi001.stdout:466 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:466.out 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:467 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:467.out 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:468 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:468.out 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:469 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:469.out 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:470 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:470.out 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:471 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:471.out 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:472 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:472.out 2023-12-02T01:32:28.932 INFO:teuthology.orchestra.run.smithi001.stdout:473 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:473.out 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:474 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:474.out 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:475 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:475.out 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:476 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:476.out 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:477 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:477.out 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:478 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:478.out 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:479 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:479.out 2023-12-02T01:32:28.933 INFO:teuthology.orchestra.run.smithi001.stdout:480 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:480.out 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:481 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:481.out 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:482 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:482.out 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:483 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:483.out 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:484 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:484.out 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:485 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:485.out 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:486 2023-12-02T01:32:28.934 INFO:teuthology.orchestra.run.smithi001.stdout:486.out 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:487 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:487.out 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:488 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:488.out 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:489 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:489.out 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:490 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:490.out 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:491 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:491.out 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:492 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:492.out 2023-12-02T01:32:28.935 INFO:teuthology.orchestra.run.smithi001.stdout:493 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:493.out 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:494 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:494.out 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:495 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:495.out 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:496 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:496.out 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:497 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:497.out 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:498 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:498.out 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:499 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:499.out 2023-12-02T01:32:28.936 INFO:teuthology.orchestra.run.smithi001.stdout:500 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:500.out 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:501 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:501.out 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:502 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:502.out 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:503 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:503.out 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:504 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:504.out 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:505 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:505.out 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:506 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:506.out 2023-12-02T01:32:28.937 INFO:teuthology.orchestra.run.smithi001.stdout:507 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:507.out 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:508 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:508.out 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:509 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:509.out 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:510 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:510.out 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:511 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:511.out 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:512 2023-12-02T01:32:28.938 INFO:teuthology.orchestra.run.smithi001.stdout:512.out 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:513 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:513.out 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:514 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:514.out 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:515 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:515.out 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:516 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:516.out 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:517 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:517.out 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:518 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:518.out 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:519 2023-12-02T01:32:28.939 INFO:teuthology.orchestra.run.smithi001.stdout:519.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:520 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:520.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:521 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:521.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:522 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:522.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:523 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:523.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:524 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:524.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:525 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:525.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:526 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:526.out 2023-12-02T01:32:28.940 INFO:teuthology.orchestra.run.smithi001.stdout:527 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:527.out 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:528 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:528.out 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:529 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:529.out 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:530 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:530.out 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:531 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:531.out 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:532 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:532.out 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:533 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:533.out 2023-12-02T01:32:28.941 INFO:teuthology.orchestra.run.smithi001.stdout:534 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:534.out 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:535 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:535.out 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:536 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:536.out 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:537 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:537.out 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:538 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:538.out 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:539 2023-12-02T01:32:28.942 INFO:teuthology.orchestra.run.smithi001.stdout:539.out 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:540 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:540.out 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:541 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:541.out 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:542 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:542.out 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:543 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:543.out 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:544 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:544.out 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:545 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:545.out 2023-12-02T01:32:28.943 INFO:teuthology.orchestra.run.smithi001.stdout:546 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:546.out 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:547 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:547.out 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:548 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:548.out 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:549 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:549.out 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:550 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:550.out 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:551 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:551.out 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:552 2023-12-02T01:32:28.944 INFO:teuthology.orchestra.run.smithi001.stdout:552.out 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:553 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:553.out 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:554 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:554.out 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:555 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:555.out 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:556 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:556.out 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:557 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:557.out 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:558 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:558.out 2023-12-02T01:32:28.945 INFO:teuthology.orchestra.run.smithi001.stdout:559 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:559.out 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:560 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:560.out 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:561 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:561.out 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:562 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:562.out 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:563 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:563.out 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:564 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:564.out 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:565 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:565.out 2023-12-02T01:32:28.946 INFO:teuthology.orchestra.run.smithi001.stdout:566 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:566.out 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:567 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:567.out 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:568 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:568.out 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:569 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:569.out 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:570 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:570.out 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:571 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:571.out 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:572 2023-12-02T01:32:28.947 INFO:teuthology.orchestra.run.smithi001.stdout:572.out 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:573 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:573.out 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:574 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:574.out 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:575 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:575.out 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:576 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:576.out 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:577 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:577.out 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:578 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:578.out 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:579 2023-12-02T01:32:28.948 INFO:teuthology.orchestra.run.smithi001.stdout:579.out 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:580 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:580.out 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:581 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:581.out 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:582 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:582.out 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:583 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:583.out 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:584 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:584.out 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:585 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:585.out 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:586 2023-12-02T01:32:28.949 INFO:teuthology.orchestra.run.smithi001.stdout:586.out 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:587 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:587.out 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:588 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:588.out 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:589 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:589.out 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:590 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:590.out 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:591 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:591.out 2023-12-02T01:32:28.950 INFO:teuthology.orchestra.run.smithi001.stdout:592 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:592.out 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:593 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:593.out 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:594 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:594.out 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:595 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:595.out 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:596 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:596.out 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:597 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:597.out 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:598 2023-12-02T01:32:28.951 INFO:teuthology.orchestra.run.smithi001.stdout:598.out 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:599 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:599.out 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:600 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:600.out 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:601 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:601.out 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:602 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:602.out 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:603 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:603.out 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:604 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:604.out 2023-12-02T01:32:28.952 INFO:teuthology.orchestra.run.smithi001.stdout:605 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:605.out 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:606 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:606.out 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:607 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:607.out 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:608 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:608.out 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:609 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:609.out 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:610 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:610.out 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:611 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:611.out 2023-12-02T01:32:28.953 INFO:teuthology.orchestra.run.smithi001.stdout:612 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:612.out 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:613 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:613.out 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:614 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:614.out 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:615 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:615.out 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:616 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:616.out 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:617 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:617.out 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:618 2023-12-02T01:32:28.954 INFO:teuthology.orchestra.run.smithi001.stdout:618.out 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:619 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:619.out 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:620 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:620.out 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:621 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:621.out 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:622 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:622.out 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:623 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:623.out 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:624 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:624.out 2023-12-02T01:32:28.955 INFO:teuthology.orchestra.run.smithi001.stdout:625 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:625.out 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:626 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:626.out 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:627 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:627.out 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:628 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:628.out 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:629 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:629.out 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:630 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:630.out 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:631 2023-12-02T01:32:28.956 INFO:teuthology.orchestra.run.smithi001.stdout:631.out 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:632 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:632.out 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:633 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:633.out 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:634 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:634.out 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:635 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:635.out 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:636 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:636.out 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:637 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:637.out 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:638 2023-12-02T01:32:28.957 INFO:teuthology.orchestra.run.smithi001.stdout:638.out 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:639 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:639.out 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:640 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:640.out 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:641 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:641.out 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:642 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:642.out 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:643 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:643.out 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:644 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:644.out 2023-12-02T01:32:28.958 INFO:teuthology.orchestra.run.smithi001.stdout:645 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:645.out 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:646 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:646.out 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:647 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:647.out 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:648 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:648.out 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:649 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:649.out 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:650 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:650.out 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:651 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:651.out 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:652 2023-12-02T01:32:28.959 INFO:teuthology.orchestra.run.smithi001.stdout:652.out 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:653 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:653.out 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:654 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:654.out 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:655 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:655.out 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:656 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:656.out 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:657 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:657.out 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:658 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:658.out 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:659 2023-12-02T01:32:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:659.out 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:660 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:660.out 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:661 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:661.out 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:662 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:662.out 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:663 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:663.out 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:664 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:664.out 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:665 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:665.out 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:666 2023-12-02T01:32:28.961 INFO:teuthology.orchestra.run.smithi001.stdout:666.out 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:667 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:667.out 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:668 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:668.out 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:669 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:669.out 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:670 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:670.out 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:671 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:671.out 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:672 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:672.out 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:673 2023-12-02T01:32:28.962 INFO:teuthology.orchestra.run.smithi001.stdout:673.out 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:674 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:674.out 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:675 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:675.out 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:676 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:676.out 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:677 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:677.out 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:678 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:678.out 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:679 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:679.out 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:680 2023-12-02T01:32:28.963 INFO:teuthology.orchestra.run.smithi001.stdout:680.out 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:681 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:681.out 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:682 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:682.out 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:683 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:683.out 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:684 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:684.out 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:685 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:685.out 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:686 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:686.out 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:687 2023-12-02T01:32:28.964 INFO:teuthology.orchestra.run.smithi001.stdout:687.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:688 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:688.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:689 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:689.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:690 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:690.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:691 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:691.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:692 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:692.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:693 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:693.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:694 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:694.out 2023-12-02T01:32:28.965 INFO:teuthology.orchestra.run.smithi001.stdout:695 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:695.out 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:696 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:696.out 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:697 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:697.out 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:698 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:698.out 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:699 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:699.out 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:700 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:700.out 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:701 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:701.out 2023-12-02T01:32:28.966 INFO:teuthology.orchestra.run.smithi001.stdout:702 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:702.out 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:703 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:703.out 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:704 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:704.out 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:705 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:705.out 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:706 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:706.out 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:707 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:707.out 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:708 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:708.out 2023-12-02T01:32:28.967 INFO:teuthology.orchestra.run.smithi001.stdout:709 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:709.out 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:710 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:710.out 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:711 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:711.out 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:712 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:712.out 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:713 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:713.out 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:714 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:714.out 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:715 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:715.out 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:716 2023-12-02T01:32:28.968 INFO:teuthology.orchestra.run.smithi001.stdout:716.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:717 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:717.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:718 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:718.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:719 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:719.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:720 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:720.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:721 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:721.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:722 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:722.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:723 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:723.out 2023-12-02T01:32:28.969 INFO:teuthology.orchestra.run.smithi001.stdout:724 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:724.out 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:725 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:725.out 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:726 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:726.out 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:727 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:727.out 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:728 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:728.out 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:729 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:729.out 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:730 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:730.out 2023-12-02T01:32:28.970 INFO:teuthology.orchestra.run.smithi001.stdout:731 2023-12-02T01:32:28.971 INFO:teuthology.orchestra.run.smithi001.stdout:731.out 2023-12-02T01:32:28.971 INFO:teuthology.orchestra.run.smithi001.stdout:732 2023-12-02T01:32:28.971 INFO:teuthology.orchestra.run.smithi001.stdout:732.out 2023-12-02T01:32:28.971 INFO:teuthology.orchestra.run.smithi001.stdout:group.list 2023-12-02T01:32:28.971 INFO:teuthology.orchestra.run.smithi001.stdout:Makefile 2023-12-02T01:32:28.971 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-12-02T01:32:29.120 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:32:29.125 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:32:29.125 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:31.083 INFO:teuthology.orchestra.run.smithi001.stdout:generic/001 2s 2023-12-02T01:32:31.088 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/001 2023-12-02T01:32:31.088 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:32:31.090 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:31.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[102589]: fuse finished with error 0 and tester_r 0 2023-12-02T01:32:31.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:32:31.102 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-12-02T01:32:31.275 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:32:31.279 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:32:31.279 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:31.661 INFO:teuthology.orchestra.run.smithi001.stdout:generic/002 0s 2023-12-02T01:32:31.666 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/002 2023-12-02T01:32:31.666 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:32:31.668 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:31.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:32:31.679 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-12-02T01:32:31.871 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:32:31.875 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:32:31.875 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:31.982 INFO:teuthology.orchestra.run.smithi001.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:32:31.986 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/003 2023-12-02T01:32:31.986 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/003 2023-12-02T01:32:31.986 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:32:31.988 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:31.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:32:31.997 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-12-02T01:32:32.167 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:32:32.171 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:32:32.171 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:32.286 INFO:teuthology.orchestra.run.smithi001.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-02T01:32:32.290 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/004 2023-12-02T01:32:32.290 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/004 2023-12-02T01:32:32.290 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:32:32.292 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:32.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:32:32.302 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-12-02T01:32:32.472 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:32:32.476 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:32:32.476 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:32.932 INFO:teuthology.orchestra.run.smithi001.stdout:generic/005 0s 2023-12-02T01:32:32.937 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/005 2023-12-02T01:32:32.937 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:32:32.939 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:32.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:32:32.949 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-12-02T01:32:33.147 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:32:33.151 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:32:33.151 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:32:46.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:32:46.345 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:33:04.356 INFO:teuthology.orchestra.run.smithi001.stdout:generic/006 31s 2023-12-02T01:33:04.361 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/006 2023-12-02T01:33:04.361 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:33:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:33:04.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:33:04.373 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-12-02T01:33:04.581 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:33:04.585 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:33:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:33:16.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:33:16.635 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:33:46.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:33:46.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:34:10.289 INFO:teuthology.orchestra.run.smithi001.stdout:generic/007 66s 2023-12-02T01:34:10.459 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/007 2023-12-02T01:34:10.459 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:34:10.461 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:10.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:34:10.471 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-12-02T01:34:10.670 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:34:10.674 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:34:10.674 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:11.597 INFO:teuthology.orchestra.run.smithi001.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-02T01:34:11.600 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/008 2023-12-02T01:34:11.601 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/008 2023-12-02T01:34:11.601 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:34:11.603 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:11.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:34:11.612 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-12-02T01:34:11.780 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:34:11.784 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:34:11.784 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:12.623 INFO:teuthology.orchestra.run.smithi001.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-02T01:34:12.627 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/009 2023-12-02T01:34:12.627 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/009 2023-12-02T01:34:12.627 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:34:12.629 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:12.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:34:12.638 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-12-02T01:34:12.807 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:34:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:34:12.811 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:13.474 INFO:teuthology.orchestra.run.smithi001.stdout:generic/010 1s 2023-12-02T01:34:13.632 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/010 2023-12-02T01:34:13.632 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:34:13.635 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:13.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:34:13.655 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-12-02T01:34:13.847 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:34:13.851 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:34:13.851 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:16.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:34:16.989 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:34:47.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:34:47.614 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:34:48.678 INFO:teuthology.orchestra.run.smithi001.stdout:generic/011 35s 2023-12-02T01:34:48.683 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/011 2023-12-02T01:34:48.683 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:34:48.685 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:48.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:34:48.708 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-12-02T01:34:48.905 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:34:48.910 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:34:48.910 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:49.833 INFO:teuthology.orchestra.run.smithi001.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:34:49.837 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/012 2023-12-02T01:34:49.837 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/012 2023-12-02T01:34:49.837 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:34:49.839 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:34:49.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:34:49.855 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-12-02T01:34:50.047 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:34:50.051 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:34:50.051 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:35:17.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:35:17.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:35:48.326 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:35:48.329 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:36:18.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:36:18.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:36:24.035 INFO:teuthology.orchestra.run.smithi001.stdout:generic/013 94s 2023-12-02T01:36:24.043 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/013 2023-12-02T01:36:24.043 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:36:24.047 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:36:24.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:36:24.059 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-12-02T01:36:24.330 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:36:24.334 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:36:24.334 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:36:48.897 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:36:48.899 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:36:48.966 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T01:36:48.963+0000 7f32704a2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166546) UID: 0 2023-12-02T01:36:48.966 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T01:36:48.963+0000 7fbb5a4e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166546) UID: 0 2023-12-02T01:40:04.398 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:40:04.401 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:40:34.719 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:40:34.722 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:41:04.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:41:04.814 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:41:13.580 INFO:teuthology.orchestra.run.smithi001.stdout:generic/014 289s 2023-12-02T01:41:13.588 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/014 2023-12-02T01:41:13.589 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:13.592 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:13.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:13.606 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-12-02T01:41:13.875 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:13.881 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:13.881 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:14.033 INFO:teuthology.orchestra.run.smithi001.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:14.038 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/015 2023-12-02T01:41:14.038 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/015 2023-12-02T01:41:14.038 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:14.041 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:14.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:14.053 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-12-02T01:41:14.315 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:14.321 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:15.824 INFO:teuthology.orchestra.run.smithi001.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:41:15.828 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/016 2023-12-02T01:41:15.828 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/016 2023-12-02T01:41:15.828 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:15.831 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:15.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:15.845 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-12-02T01:41:16.280 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:16.285 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:16.449 INFO:teuthology.orchestra.run.smithi001.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:16.454 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/017 2023-12-02T01:41:16.454 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/017 2023-12-02T01:41:16.454 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:16.457 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:16.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:16.475 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-12-02T01:41:16.731 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:16.738 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:16.738 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:16.899 INFO:teuthology.orchestra.run.smithi001.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:16.904 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/018 2023-12-02T01:41:16.904 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/018 2023-12-02T01:41:16.904 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:16.907 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:16.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:16.919 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-12-02T01:41:17.176 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:17.180 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:17.180 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:17.340 INFO:teuthology.orchestra.run.smithi001.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:17.345 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/019 2023-12-02T01:41:17.345 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/019 2023-12-02T01:41:17.345 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:17.348 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:17.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:17.362 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-12-02T01:41:17.617 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:17.622 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:17.622 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:27.151 INFO:teuthology.orchestra.run.smithi001.stdout:generic/020 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/020.out.bad) 2023-12-02T01:41:27.154 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/020.out 2023-12-02 01:30:49.053044325 +0000 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/020.out.bad 2023-12-02 01:41:27.147218240 +0000 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -47,9 +47,13 @@ 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: user.snrub="fish2\012" 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: *** really long value 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: -0000000 00 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: -* 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: -ATTRSIZE 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: +attr_set: No space left on device 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: +Could not set "long_attr" for 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: +attr_get: No data available 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: +Could not get "long_attr" for 2023-12-02T01:41:27.155 INFO:teuthology.orchestra.run.smithi001.stdout: +0000000 2023-12-02T01:41:27.156 INFO:teuthology.orchestra.run.smithi001.stdout: +attr_remove: No data available 2023-12-02T01:41:27.156 INFO:teuthology.orchestra.run.smithi001.stdout: +Could not remove "long_attr" for 2023-12-02T01:41:27.156 INFO:teuthology.orchestra.run.smithi001.stdout: *** set/get/remove really long names (expect failure) 2023-12-02T01:41:27.156 INFO:teuthology.orchestra.run.smithi001.stdout: attr_set: Invalid argument 2023-12-02T01:41:27.156 INFO:teuthology.orchestra.run.smithi001.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-12-02T01:41:27.158 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/020 2023-12-02T01:41:27.158 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/020 2023-12-02T01:41:27.158 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T01:41:27.161 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:27.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T01:41:27.174 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T01:41:27.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T01:41:27.175 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-12-02T01:41:27.602 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:27.607 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:27.607 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:29.042 INFO:teuthology.orchestra.run.smithi001.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:41:29.046 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/021 2023-12-02T01:41:29.046 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/021 2023-12-02T01:41:29.046 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:29.048 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:29.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:29.061 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-12-02T01:41:29.509 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:29.513 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:29.513 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:30.899 INFO:teuthology.orchestra.run.smithi001.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:41:30.904 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/022 2023-12-02T01:41:30.904 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/022 2023-12-02T01:41:30.904 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:30.907 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:30.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:30.918 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-12-02T01:41:31.375 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:31.380 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:31.380 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:33.190 INFO:teuthology.orchestra.run.smithi001.stdout:generic/023 2s 2023-12-02T01:41:33.198 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/023 2023-12-02T01:41:33.198 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:33.202 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:33.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:33.215 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-12-02T01:41:33.659 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:33.665 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:33.665 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:33.874 INFO:teuthology.orchestra.run.smithi001.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-02T01:41:33.879 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/024 2023-12-02T01:41:33.879 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/024 2023-12-02T01:41:33.881 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:33.884 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:33.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:33.896 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-12-02T01:41:34.344 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:34.350 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:34.350 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:34.558 INFO:teuthology.orchestra.run.smithi001.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-02T01:41:34.563 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/025 2023-12-02T01:41:34.563 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/025 2023-12-02T01:41:34.563 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:34.566 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:34.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:34.582 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-12-02T01:41:34.909 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:41:34.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:41:35.073 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:35.079 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:35.079 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:35.287 INFO:teuthology.orchestra.run.smithi001.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-02T01:41:35.291 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/026 2023-12-02T01:41:35.292 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/026 2023-12-02T01:41:35.292 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:35.295 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:35.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:35.306 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-12-02T01:41:35.566 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:35.572 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:35.572 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:35.729 INFO:teuthology.orchestra.run.smithi001.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:35.734 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/027 2023-12-02T01:41:35.734 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/027 2023-12-02T01:41:35.734 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:35.737 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:35.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:35.749 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-12-02T01:41:36.008 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:36.013 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:36.014 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:41.196 INFO:teuthology.orchestra.run.smithi001.stdout:generic/028 5s 2023-12-02T01:41:41.206 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/028 2023-12-02T01:41:41.206 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:41.209 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:41.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:41.221 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-12-02T01:41:41.471 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:41.477 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:41.477 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:41.638 INFO:teuthology.orchestra.run.smithi001.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/029 2023-12-02T01:41:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/029 2023-12-02T01:41:41.643 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:41.646 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:41.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:41.658 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-12-02T01:41:41.905 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:41.911 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:41.911 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:42.067 INFO:teuthology.orchestra.run.smithi001.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:42.072 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/030 2023-12-02T01:41:42.072 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/030 2023-12-02T01:41:42.072 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:42.075 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:42.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:42.087 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-12-02T01:41:42.336 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:42.341 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:42.341 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:42.500 INFO:teuthology.orchestra.run.smithi001.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:42.505 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/031 2023-12-02T01:41:42.505 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/031 2023-12-02T01:41:42.505 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:42.508 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:42.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:42.520 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-12-02T01:41:42.763 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:42.769 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:42.769 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:42.920 INFO:teuthology.orchestra.run.smithi001.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:42.924 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/032 2023-12-02T01:41:42.924 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/032 2023-12-02T01:41:42.924 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:42.927 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:42.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:42.939 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-12-02T01:41:43.197 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:43.201 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:43.201 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:43.355 INFO:teuthology.orchestra.run.smithi001.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:43.359 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/033 2023-12-02T01:41:43.359 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/033 2023-12-02T01:41:43.359 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:43.362 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:43.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:43.374 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-12-02T01:41:43.634 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:43.639 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:43.640 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:43.819 INFO:teuthology.orchestra.run.smithi001.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:43.823 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/034 2023-12-02T01:41:43.824 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/034 2023-12-02T01:41:43.824 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:43.826 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:43.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:43.838 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-12-02T01:41:44.098 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:44.103 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:44.104 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:44.363 INFO:teuthology.orchestra.run.smithi001.stdout:generic/035 0s 2023-12-02T01:41:44.371 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/035 2023-12-02T01:41:44.371 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:44.373 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:44.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:44.385 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-12-02T01:41:44.784 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:44.790 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:44.790 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:55.075 INFO:teuthology.orchestra.run.smithi001.stdout:generic/036 11s 2023-12-02T01:41:55.082 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/036 2023-12-02T01:41:55.082 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:55.085 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:55.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:55.097 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-12-02T01:41:55.522 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:55.527 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:55.527 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:55.699 INFO:teuthology.orchestra.run.smithi001.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:55.703 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/037 2023-12-02T01:41:55.703 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/037 2023-12-02T01:41:55.703 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:55.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:55.718 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-12-02T01:41:55.986 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:55.991 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:56.151 INFO:teuthology.orchestra.run.smithi001.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:56.156 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/038 2023-12-02T01:41:56.156 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/038 2023-12-02T01:41:56.156 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:56.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:56.170 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-12-02T01:41:56.428 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:56.433 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:56.590 INFO:teuthology.orchestra.run.smithi001.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:56.594 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/039 2023-12-02T01:41:56.594 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/039 2023-12-02T01:41:56.594 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:56.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:56.608 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-12-02T01:41:56.843 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:56.849 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:57.009 INFO:teuthology.orchestra.run.smithi001.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:57.015 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/040 2023-12-02T01:41:57.015 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/040 2023-12-02T01:41:57.015 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:57.018 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:57.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:57.030 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-12-02T01:41:57.282 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:57.287 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:57.287 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:57.454 INFO:teuthology.orchestra.run.smithi001.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:57.460 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/041 2023-12-02T01:41:57.460 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/041 2023-12-02T01:41:57.460 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:57.463 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:57.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:57.475 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-12-02T01:41:57.721 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:57.726 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:57.726 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:57.886 INFO:teuthology.orchestra.run.smithi001.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:57.891 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/042 2023-12-02T01:41:57.891 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/042 2023-12-02T01:41:57.891 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:57.893 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:57.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:57.903 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-12-02T01:41:58.168 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:58.173 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:58.173 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:58.333 INFO:teuthology.orchestra.run.smithi001.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:58.337 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/043 2023-12-02T01:41:58.338 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/043 2023-12-02T01:41:58.338 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:58.341 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:58.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:58.355 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-12-02T01:41:58.607 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:58.612 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:58.612 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:58.778 INFO:teuthology.orchestra.run.smithi001.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:58.782 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/044 2023-12-02T01:41:58.782 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/044 2023-12-02T01:41:58.782 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:58.785 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:58.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:58.797 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-12-02T01:41:59.050 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:59.055 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:59.055 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:59.206 INFO:teuthology.orchestra.run.smithi001.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:59.211 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/045 2023-12-02T01:41:59.211 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/045 2023-12-02T01:41:59.211 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:59.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:59.225 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-12-02T01:41:59.482 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:59.487 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:59.643 INFO:teuthology.orchestra.run.smithi001.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:41:59.648 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/046 2023-12-02T01:41:59.648 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/046 2023-12-02T01:41:59.648 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:41:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:41:59.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:41:59.662 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-12-02T01:41:59.913 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:41:59.920 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:41:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:00.082 INFO:teuthology.orchestra.run.smithi001.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:00.086 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/047 2023-12-02T01:42:00.086 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/047 2023-12-02T01:42:00.086 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:00.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:00.100 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-12-02T01:42:00.352 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:00.357 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:00.515 INFO:teuthology.orchestra.run.smithi001.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:00.520 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/048 2023-12-02T01:42:00.520 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/048 2023-12-02T01:42:00.520 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:00.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:00.535 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-12-02T01:42:00.786 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:00.791 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:00.791 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:00.953 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/049 2023-12-02T01:42:00.953 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/049 2023-12-02T01:42:00.953 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:00.957 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:00.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:00.975 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-12-02T01:42:01.237 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:01.243 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:01.243 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:01.405 INFO:teuthology.orchestra.run.smithi001.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:01.410 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/050 2023-12-02T01:42:01.410 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/050 2023-12-02T01:42:01.410 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:01.413 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:01.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:01.429 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-12-02T01:42:01.677 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:01.682 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:01.682 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:01.838 INFO:teuthology.orchestra.run.smithi001.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:01.842 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/051 2023-12-02T01:42:01.843 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/051 2023-12-02T01:42:01.843 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:01.845 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:01.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:01.857 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-12-02T01:42:02.108 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:02.115 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:02.115 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:02.278 INFO:teuthology.orchestra.run.smithi001.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:02.283 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/052 2023-12-02T01:42:02.283 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/052 2023-12-02T01:42:02.283 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:02.286 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:02.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:02.300 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-12-02T01:42:02.550 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:02.554 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:02.554 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:02.710 INFO:teuthology.orchestra.run.smithi001.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:02.715 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/053 2023-12-02T01:42:02.715 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/053 2023-12-02T01:42:02.715 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:02.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:02.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:02.731 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-12-02T01:42:02.983 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:02.988 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:02.988 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:03.138 INFO:teuthology.orchestra.run.smithi001.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:03.142 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/054 2023-12-02T01:42:03.142 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/054 2023-12-02T01:42:03.142 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:03.145 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:03.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:03.168 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-12-02T01:42:03.427 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:03.432 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:03.584 INFO:teuthology.orchestra.run.smithi001.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:03.590 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/055 2023-12-02T01:42:03.590 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/055 2023-12-02T01:42:03.590 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:03.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:03.604 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-12-02T01:42:03.856 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:03.861 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:04.029 INFO:teuthology.orchestra.run.smithi001.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:04.034 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/056 2023-12-02T01:42:04.034 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/056 2023-12-02T01:42:04.034 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:04.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:04.049 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-12-02T01:42:04.320 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:04.325 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:04.500 INFO:teuthology.orchestra.run.smithi001.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:04.504 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/057 2023-12-02T01:42:04.505 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/057 2023-12-02T01:42:04.505 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:04.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:04.519 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-12-02T01:42:04.772 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:04.777 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:05.090 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:42:05.095 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:42:06.175 INFO:teuthology.orchestra.run.smithi001.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:42:06.180 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/058 2023-12-02T01:42:06.180 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/058 2023-12-02T01:42:06.180 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:06.183 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:06.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:06.202 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-12-02T01:42:06.620 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:06.624 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:06.625 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:06.803 INFO:teuthology.orchestra.run.smithi001.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:06.808 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/059 2023-12-02T01:42:06.808 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/059 2023-12-02T01:42:06.808 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:06.811 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:06.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:06.826 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-12-02T01:42:07.077 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:07.082 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:07.082 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:42:08.504 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/060 2023-12-02T01:42:08.504 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/060 2023-12-02T01:42:08.504 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:08.507 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:08.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:08.519 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-12-02T01:42:08.947 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:08.953 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:08.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:10.358 INFO:teuthology.orchestra.run.smithi001.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:42:10.362 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/061 2023-12-02T01:42:10.362 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/061 2023-12-02T01:42:10.362 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:10.365 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:10.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:10.388 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-12-02T01:42:10.797 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:10.803 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:10.803 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:10.977 INFO:teuthology.orchestra.run.smithi001.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:10.981 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/062 2023-12-02T01:42:10.981 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/062 2023-12-02T01:42:10.981 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:10.984 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:10.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:10.995 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-12-02T01:42:11.237 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:11.242 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:11.242 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:12.619 INFO:teuthology.orchestra.run.smithi001.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T01:42:12.624 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/063 2023-12-02T01:42:12.624 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/063 2023-12-02T01:42:12.624 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:12.630 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:12.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:12.653 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-12-02T01:42:13.040 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:13.046 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:13.046 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:13.195 INFO:teuthology.orchestra.run.smithi001.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:13.199 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/064 2023-12-02T01:42:13.199 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/064 2023-12-02T01:42:13.199 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:13.201 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:13.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:13.216 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-12-02T01:42:13.463 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:13.468 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:13.468 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:13.649 INFO:teuthology.orchestra.run.smithi001.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:13.653 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/065 2023-12-02T01:42:13.653 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/065 2023-12-02T01:42:13.653 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:13.657 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:13.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:13.670 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-12-02T01:42:13.923 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:13.931 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:13.931 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:14.117 INFO:teuthology.orchestra.run.smithi001.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:14.122 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/066 2023-12-02T01:42:14.122 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/066 2023-12-02T01:42:14.122 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:14.125 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:14.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:14.137 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-12-02T01:42:14.374 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:14.381 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:14.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:14.564 INFO:teuthology.orchestra.run.smithi001.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:14.569 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/067 2023-12-02T01:42:14.569 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/067 2023-12-02T01:42:14.570 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:14.573 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:14.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:14.585 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-12-02T01:42:14.836 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:14.841 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:14.841 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:15.012 INFO:teuthology.orchestra.run.smithi001.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:15.017 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/068 2023-12-02T01:42:15.017 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/068 2023-12-02T01:42:15.017 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:15.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:15.037 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-12-02T01:42:15.299 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:15.303 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:15.461 INFO:teuthology.orchestra.run.smithi001.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:42:15.466 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/069 2023-12-02T01:42:15.466 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/069 2023-12-02T01:42:15.466 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:42:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:15.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:42:15.480 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-12-02T01:42:15.711 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:42:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:42:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:42:35.196 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:42:35.199 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:43:05.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:43:05.416 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:43:27.134 INFO:teuthology.orchestra.run.smithi001.stdout:generic/070 72s 2023-12-02T01:43:27.140 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/070 2023-12-02T01:43:27.140 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:43:27.143 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:27.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:43:27.156 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-12-02T01:43:27.581 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:43:27.585 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:43:27.586 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:27.738 INFO:teuthology.orchestra.run.smithi001.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:43:27.742 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/071 2023-12-02T01:43:27.742 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/071 2023-12-02T01:43:27.742 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:43:27.745 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:27.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:43:27.755 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-12-02T01:43:27.924 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:43:27.928 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:43:27.928 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:29.315 INFO:teuthology.orchestra.run.smithi001.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-02T01:43:29.320 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/072 2023-12-02T01:43:29.320 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/072 2023-12-02T01:43:29.320 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:43:29.325 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:29.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:43:29.339 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-12-02T01:43:29.585 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:43:29.590 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:43:29.590 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:29.760 INFO:teuthology.orchestra.run.smithi001.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T01:43:29.764 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/073 2023-12-02T01:43:29.764 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/073 2023-12-02T01:43:29.764 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T01:43:29.768 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:29.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T01:43:29.783 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-12-02T01:43:30.025 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T01:43:30.030 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T01:43:30.030 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T01:43:35.477 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:43:35.483 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:44:05.548 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:44:05.551 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:44:35.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:44:35.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:45:05.701 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:45:05.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:45:35.791 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:45:35.794 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:46:05.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:46:05.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:46:36.038 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:46:36.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:47:06.310 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:47:06.313 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:47:36.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:47:36.455 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:48:06.551 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:48:06.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:48:36.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:48:36.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:49:06.913 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:49:06.916 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:49:36.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:49:36.987 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:50:07.418 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:50:07.425 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:50:37.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:50:37.683 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:51:08.004 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:51:08.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:51:38.074 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:51:38.076 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:52:08.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:52:08.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:52:38.245 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:52:38.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:53:08.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:53:08.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:53:28.538 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T01:53:28.535+0000 7f1deeced640 -1 bdev(0x5636bf822e00 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2023-12-02T01:53:28.538 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T01:53:28.536+0000 7f1df4cf9640 -1 bdev(0x5636bf822e00 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2023-12-02T01:53:38.418 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:53:38.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:54:08.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:54:08.518 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:54:38.845 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:54:38.848 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:55:08.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:55:08.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:55:39.329 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:55:39.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:56:09.432 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:56:09.434 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:56:39.613 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:56:39.616 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:57:09.719 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:57:09.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:57:39.866 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:57:39.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:58:10.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:58:10.383 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:58:40.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:58:40.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:59:10.635 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:59:10.638 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:59:40.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T01:59:40.727 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:00:10.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:00:10.801 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:00:41.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:00:41.014 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:01:11.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:01:11.096 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:01:41.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:01:41.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:02:11.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:02:11.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:02:41.393 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:02:41.397 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:02:41.462 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T02:02:41.459+0000 7f9970cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 197845) UID: 0 2023-12-02T02:02:41.463 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T02:02:41.459+0000 7f04ddaa3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 197845) UID: 0 2023-12-02T02:02:41.463 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T02:02:41.459+0000 7f56f3f48640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 197845) UID: 0 2023-12-02T02:02:41.470 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T02:02:41.460+0000 7fdc7a283640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 197845) UID: 0 2023-12-02T02:06:15.256 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:06:15.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:06:15.609 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T02:06:15.607+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97350) UID: 0 2023-12-02T02:06:15.610 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T02:06:15.607+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97350) UID: 0 2023-12-02T02:06:15.610 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T02:06:15.607+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97350) UID: 0 2023-12-02T02:06:15.616 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T02:06:15.607+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97350) UID: 0 2023-12-02T02:09:10.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:09:10.801 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:09:41.086 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:09:41.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:10:11.383 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:10:11.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:10:41.456 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:10:41.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:11:11.538 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:11:11.541 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:11:41.652 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:11:41.655 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:12:11.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:12:11.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:12:11.760 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T02:12:11.757+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97490) UID: 0 2023-12-02T02:12:11.760 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T02:12:11.757+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97490) UID: 0 2023-12-02T02:12:11.760 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T02:12:11.757+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97490) UID: 0 2023-12-02T02:12:11.761 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T02:12:11.758+0000 7f1e0ff26640 -1 Fail to open '/proc/97490/cmdline' error = (2) No such file or directory 2023-12-02T02:12:11.761 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T02:12:11.758+0000 7f1e0ff26640 -1 received signal: Hangup from (PID: 97490) UID: 0 2023-12-02T02:15:07.966 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:15:07.969 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:15:38.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:15:38.064 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:16:08.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:16:08.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:16:08.189 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T02:16:08.185+0000 7f9970cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198396) UID: 0 2023-12-02T02:16:08.189 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T02:16:08.185+0000 7fdc7a283640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198396) UID: 0 2023-12-02T02:16:08.189 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T02:16:08.186+0000 7f56f3f48640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198396) UID: 0 2023-12-02T02:16:08.190 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T02:16:08.187+0000 7f04ddaa3640 -1 Fail to open '/proc/198396/cmdline' error = (2) No such file or directory 2023-12-02T02:16:08.190 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T02:16:08.187+0000 7f04ddaa3640 -1 received signal: Hangup from (PID: 198396) UID: 0 2023-12-02T02:18:07.046 INFO:teuthology.orchestra.run.smithi001.stdout:generic/074 2076s 2023-12-02T02:18:07.153 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/074 2023-12-02T02:18:07.153 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:07.155 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:07.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:07.230 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-12-02T02:18:08.281 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:08.284 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:08.285 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:48.711 INFO:teuthology.orchestra.run.smithi001.stdout:generic/075 40s 2023-12-02T02:18:48.716 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/075 2023-12-02T02:18:48.716 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:48.718 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:48.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:48.727 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-12-02T02:18:49.144 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:49.149 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:49.149 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:49.284 INFO:teuthology.orchestra.run.smithi001.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:18:49.287 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/076 2023-12-02T02:18:49.287 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/076 2023-12-02T02:18:49.287 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:49.290 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:49.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:49.299 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-12-02T02:18:49.480 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:49.483 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:49.484 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:50.215 INFO:teuthology.orchestra.run.smithi001.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:18:50.219 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/077 2023-12-02T02:18:50.219 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/077 2023-12-02T02:18:50.219 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:50.221 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:50.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:50.230 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-12-02T02:18:50.403 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:50.407 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:50.407 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:50.562 INFO:teuthology.orchestra.run.smithi001.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-02T02:18:50.566 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/078 2023-12-02T02:18:50.566 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/078 2023-12-02T02:18:50.566 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:50.568 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:50.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:50.577 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-12-02T02:18:50.999 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:51.004 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:51.004 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:51.176 INFO:teuthology.orchestra.run.smithi001.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-02T02:18:51.179 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/079 2023-12-02T02:18:51.179 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/079 2023-12-02T02:18:51.179 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:51.182 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:51.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:51.191 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-12-02T02:18:51.367 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:51.371 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:51.372 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:53.544 INFO:teuthology.orchestra.run.smithi001.stdout:generic/080 2s 2023-12-02T02:18:53.550 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/080 2023-12-02T02:18:53.551 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:53.553 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:53.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:53.563 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-12-02T02:18:53.743 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:53.747 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:53.747 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:53.864 INFO:teuthology.orchestra.run.smithi001.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:18:53.868 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/081 2023-12-02T02:18:53.868 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/081 2023-12-02T02:18:53.868 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:53.870 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:53.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:53.879 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-12-02T02:18:54.052 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:54.056 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:54.056 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:54.170 INFO:teuthology.orchestra.run.smithi001.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:18:54.173 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/082 2023-12-02T02:18:54.173 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/082 2023-12-02T02:18:54.173 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:54.176 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:54.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:54.184 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-12-02T02:18:54.357 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:54.361 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:54.362 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:54.471 INFO:teuthology.orchestra.run.smithi001.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:18:54.474 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/083 2023-12-02T02:18:54.475 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/083 2023-12-02T02:18:54.475 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:54.477 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:54.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:54.496 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-12-02T02:18:54.668 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:54.672 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:54.672 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:54.786 INFO:teuthology.orchestra.run.smithi001.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:18:54.789 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/084 2023-12-02T02:18:54.789 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/084 2023-12-02T02:18:54.789 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:54.792 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:54.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:54.801 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-12-02T02:18:54.974 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:54.978 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:54.978 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:55.135 INFO:teuthology.orchestra.run.smithi001.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:18:55.138 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/085 2023-12-02T02:18:55.139 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/085 2023-12-02T02:18:55.139 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:55.141 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:55.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:55.149 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-12-02T02:18:55.320 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:18:55.325 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:18:55.325 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:59.115 INFO:teuthology.orchestra.run.smithi001.stdout:generic/086 4s 2023-12-02T02:18:59.160 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/086 2023-12-02T02:18:59.160 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:18:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:18:59.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:18:59.357 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-12-02T02:19:00.256 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:19:00.260 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:19:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:19:00.592 INFO:teuthology.orchestra.run.smithi001.stdout:generic/087 0s 2023-12-02T02:19:00.597 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/087 2023-12-02T02:19:00.597 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:19:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:19:00.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:19:00.608 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-12-02T02:19:01.045 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:19:01.049 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:19:01.049 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:19:01.237 INFO:teuthology.orchestra.run.smithi001.stdout:generic/088 0s 2023-12-02T02:19:01.243 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/088 2023-12-02T02:19:01.243 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:19:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:19:01.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:19:01.255 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-12-02T02:19:01.681 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:19:01.686 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:19:01.686 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:19:16.404 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:19:16.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:19:16.437 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T02:19:16.434+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97651) UID: 0 2023-12-02T02:19:16.438 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T02:19:16.434+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97651) UID: 0 2023-12-02T02:19:16.438 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T02:19:16.434+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97651) UID: 0 2023-12-02T02:19:16.438 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T02:19:16.434+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97651) UID: 0 2023-12-02T02:21:41.787 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:21:41.790 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:22:11.916 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:22:11.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:22:11.968 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T02:22:11.964+0000 7f32704a2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205973) UID: 0 2023-12-02T02:22:11.968 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T02:22:11.964+0000 7fbb5a4e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205973) UID: 0 2023-12-02T02:25:52.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:25:52.465 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:26:22.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:26:22.718 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:26:22.900 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T02:26:22.897+0000 7f32704a2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 206224) UID: 0 2023-12-02T02:26:22.900 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T02:26:22.897+0000 7fbb5a4e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 206224) UID: 0 2023-12-02T02:29:28.958 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:29:28.961 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:29:59.047 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:29:59.051 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:30:29.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:30:29.475 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:30:29.539 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T02:30:29.534+0000 7fbb5a4e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 208292) UID: 0 2023-12-02T02:30:29.539 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T02:30:29.536+0000 7f32704a2640 -1 received signal: Hangup from (PID: 208292) UID: 0 2023-12-02T02:33:20.751 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:33:20.754 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:33:43.716 INFO:teuthology.orchestra.run.smithi001.stdout:generic/089 882s 2023-12-02T02:33:43.950 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/089 2023-12-02T02:33:43.950 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:33:43.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:33:44.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:33:44.043 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-12-02T02:33:47.813 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:33:47.815 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:33:49.934 INFO:teuthology.orchestra.run.smithi001.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:33:49.939 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/090 2023-12-02T02:33:49.939 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/090 2023-12-02T02:33:49.939 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:33:49.942 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:33:49.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:33:49.953 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-12-02T02:33:50.135 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:33:50.139 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:33:50.139 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:33:51.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:33:51.105 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:34:21.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:34:21.201 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:34:51.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:34:51.267 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:35:21.411 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:35:21.415 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:35:46.614 INFO:teuthology.orchestra.run.smithi001.stdout:generic/091 116s 2023-12-02T02:35:46.619 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/091 2023-12-02T02:35:46.619 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:46.621 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:46.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:46.631 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-12-02T02:35:47.037 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:47.043 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:47.043 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:47.221 INFO:teuthology.orchestra.run.smithi001.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T02:35:47.225 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/092 2023-12-02T02:35:47.225 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/092 2023-12-02T02:35:47.225 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:47.227 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:47.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:47.243 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-12-02T02:35:47.651 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:47.656 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:47.656 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:48.489 INFO:teuthology.orchestra.run.smithi001.stdout:generic/093 1s 2023-12-02T02:35:48.494 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/093 2023-12-02T02:35:48.494 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:48.496 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:48.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:48.506 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-12-02T02:35:48.919 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:48.923 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:49.041 INFO:teuthology.orchestra.run.smithi001.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:35:49.045 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/094 2023-12-02T02:35:49.045 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/094 2023-12-02T02:35:49.045 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:49.047 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:49.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:49.056 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-12-02T02:35:49.231 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:49.235 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:49.236 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:49.344 INFO:teuthology.orchestra.run.smithi001.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:35:49.348 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/095 2023-12-02T02:35:49.348 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/095 2023-12-02T02:35:49.348 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:49.350 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:49.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:49.360 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-12-02T02:35:49.531 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:49.537 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:49.537 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:49.643 INFO:teuthology.orchestra.run.smithi001.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:35:49.647 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/096 2023-12-02T02:35:49.647 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/096 2023-12-02T02:35:49.647 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:49.649 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:49.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:49.659 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-12-02T02:35:49.830 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:49.834 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:49.835 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:50.433 INFO:teuthology.orchestra.run.smithi001.stdout:generic/097 1s 2023-12-02T02:35:50.441 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/097 2023-12-02T02:35:50.441 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:50.443 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:50.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:50.452 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-12-02T02:35:50.623 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:50.628 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:50.628 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:50.736 INFO:teuthology.orchestra.run.smithi001.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:35:50.740 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/098 2023-12-02T02:35:50.740 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/098 2023-12-02T02:35:50.740 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:50.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:50.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:50.751 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-12-02T02:35:50.922 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:50.926 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:50.926 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:51.072 INFO:teuthology.orchestra.run.smithi001.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-02T02:35:51.076 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/099 2023-12-02T02:35:51.076 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/099 2023-12-02T02:35:51.076 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:35:51.079 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:51.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:35:51.087 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-12-02T02:35:51.262 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:35:51.266 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:35:51.266 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:35:51.468 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:35:51.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:36:18.560 INFO:teuthology.orchestra.run.smithi001.stdout:generic/100 27s 2023-12-02T02:36:18.566 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/100 2023-12-02T02:36:18.566 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:18.568 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:18.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:18.584 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-12-02T02:36:18.876 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:18.892 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:18.892 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:19.133 INFO:teuthology.orchestra.run.smithi001.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:19.138 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/101 2023-12-02T02:36:19.138 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/101 2023-12-02T02:36:19.138 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:19.142 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:19.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:19.158 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-12-02T02:36:19.342 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:19.346 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:19.347 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:19.455 INFO:teuthology.orchestra.run.smithi001.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:19.459 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/102 2023-12-02T02:36:19.459 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/102 2023-12-02T02:36:19.459 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:19.462 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:19.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:19.471 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-12-02T02:36:19.645 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:19.650 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:19.650 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:19.757 INFO:teuthology.orchestra.run.smithi001.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:19.761 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/103 2023-12-02T02:36:19.761 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/103 2023-12-02T02:36:19.761 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:19.763 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:19.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:19.772 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-12-02T02:36:19.943 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:19.947 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:19.947 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.065 INFO:teuthology.orchestra.run.smithi001.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:20.069 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/104 2023-12-02T02:36:20.069 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/104 2023-12-02T02:36:20.069 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:20.071 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:20.080 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-12-02T02:36:20.251 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:20.255 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:20.255 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.364 INFO:teuthology.orchestra.run.smithi001.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:20.367 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/105 2023-12-02T02:36:20.367 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/105 2023-12-02T02:36:20.367 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:20.370 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:20.378 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-12-02T02:36:20.549 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:20.553 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:20.553 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.677 INFO:teuthology.orchestra.run.smithi001.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:20.680 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/106 2023-12-02T02:36:20.681 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/106 2023-12-02T02:36:20.681 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:20.683 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:20.692 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-12-02T02:36:20.862 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:20.866 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:20.866 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.985 INFO:teuthology.orchestra.run.smithi001.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:20.989 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/107 2023-12-02T02:36:20.989 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/107 2023-12-02T02:36:20.989 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:20.991 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:20.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:21.000 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-12-02T02:36:21.174 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:21.178 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:21.178 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:21.428 INFO:teuthology.orchestra.run.smithi001.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:21.431 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/108 2023-12-02T02:36:21.431 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/108 2023-12-02T02:36:21.431 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:21.434 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:21.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:21.442 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-12-02T02:36:21.614 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:36:21.615 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:21.616 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:36:21.619 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:21.619 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:21.727 INFO:teuthology.orchestra.run.smithi001.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:36:21.731 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/109 2023-12-02T02:36:21.731 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/109 2023-12-02T02:36:21.731 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:21.733 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:21.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:21.742 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-12-02T02:36:21.913 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:21.917 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:21.917 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:36:22.073 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/110 2023-12-02T02:36:22.073 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/110 2023-12-02T02:36:22.074 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:22.075 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:22.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:22.084 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-12-02T02:36:22.507 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:22.511 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:22.511 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:22.675 INFO:teuthology.orchestra.run.smithi001.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:36:22.678 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/111 2023-12-02T02:36:22.678 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/111 2023-12-02T02:36:22.679 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:36:22.681 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:22.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:36:22.690 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-12-02T02:36:23.109 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:36:23.113 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:36:23.113 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:36:51.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:36:51.940 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:37:02.380 INFO:teuthology.orchestra.run.smithi001.stdout:generic/112 39s 2023-12-02T02:37:02.385 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/112 2023-12-02T02:37:02.385 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:02.388 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:02.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:02.407 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-12-02T02:37:02.828 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:02.832 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:02.832 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:22.016 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:37:22.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:37:46.399 INFO:teuthology.orchestra.run.smithi001.stdout:generic/113 44s 2023-12-02T02:37:46.405 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/113 2023-12-02T02:37:46.405 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:46.407 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:46.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:46.439 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-12-02T02:37:46.865 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:46.870 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:46.871 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:47.063 INFO:teuthology.orchestra.run.smithi001.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-02T02:37:47.066 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/114 2023-12-02T02:37:47.067 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/114 2023-12-02T02:37:47.067 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:47.069 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:47.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:47.078 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-12-02T02:37:47.290 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:47.300 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:47.301 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:47.450 INFO:teuthology.orchestra.run.smithi001.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:37:47.453 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/115 2023-12-02T02:37:47.453 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/115 2023-12-02T02:37:47.453 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:47.456 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:47.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:47.465 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-12-02T02:37:47.888 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:47.893 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:47.893 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:48.055 INFO:teuthology.orchestra.run.smithi001.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:37:48.058 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/116 2023-12-02T02:37:48.058 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/116 2023-12-02T02:37:48.059 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:48.061 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:48.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:48.070 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-12-02T02:37:48.508 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:48.513 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:48.513 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:48.624 INFO:teuthology.orchestra.run.smithi001.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:37:48.628 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/117 2023-12-02T02:37:48.628 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/117 2023-12-02T02:37:48.628 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:48.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:48.639 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-12-02T02:37:48.809 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:48.813 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:48.813 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:48.962 INFO:teuthology.orchestra.run.smithi001.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:37:48.965 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/118 2023-12-02T02:37:48.965 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/118 2023-12-02T02:37:48.965 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:48.968 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:48.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:48.976 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-12-02T02:37:49.407 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:49.412 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:49.413 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:49.570 INFO:teuthology.orchestra.run.smithi001.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:37:49.574 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/119 2023-12-02T02:37:49.574 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/119 2023-12-02T02:37:49.574 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:49.576 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:49.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:49.585 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-12-02T02:37:50.015 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:50.020 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:50.020 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:50.135 INFO:teuthology.orchestra.run.smithi001.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:37:50.139 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/120 2023-12-02T02:37:50.139 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/120 2023-12-02T02:37:50.139 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:50.141 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:50.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:50.150 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-12-02T02:37:50.323 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:50.327 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:50.327 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:50.479 INFO:teuthology.orchestra.run.smithi001.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T02:37:50.483 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/121 2023-12-02T02:37:50.483 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/121 2023-12-02T02:37:50.483 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:50.485 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:50.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:50.508 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-12-02T02:37:50.924 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:50.928 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:50.928 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:51.089 INFO:teuthology.orchestra.run.smithi001.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T02:37:51.092 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/122 2023-12-02T02:37:51.092 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/122 2023-12-02T02:37:51.092 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:51.095 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:51.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:51.104 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-12-02T02:37:51.560 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:51.567 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:51.568 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:52.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:37:52.109 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:37:53.162 INFO:teuthology.orchestra.run.smithi001.stdout:generic/123 1s 2023-12-02T02:37:53.168 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/123 2023-12-02T02:37:53.168 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:53.170 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:53.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:53.181 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-12-02T02:37:53.673 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:53.677 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:53.677 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:53.851 INFO:teuthology.orchestra.run.smithi001.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:37:53.855 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/124 2023-12-02T02:37:53.855 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/124 2023-12-02T02:37:53.855 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:37:53.857 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:37:53.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:37:53.867 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-12-02T02:37:54.038 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:37:54.042 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:37:54.042 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:38:22.301 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:38:22.304 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:38:52.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:38:52.373 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:38:55.633 INFO:teuthology.orchestra.run.smithi001.stdout:generic/125 61s 2023-12-02T02:38:55.640 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/125 2023-12-02T02:38:55.640 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:38:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:38:55.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:38:55.658 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-12-02T02:38:56.101 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:38:56.105 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:38:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:38:56.623 INFO:teuthology.orchestra.run.smithi001.stdout:generic/126 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/126.out.bad) 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/126.out 2023-12-02 01:30:49.060044228 +0000 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/126.out.bad 2023-12-02 02:38:56.618711780 +0000 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,7 +1,7 @@ 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 126 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-12-02T02:38:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-12-02T02:38:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-12-02T02:38:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-12-02T02:38:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-12-02T02:38:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-12-02T02:38:56.627 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/126 2023-12-02T02:38:56.627 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/126 2023-12-02T02:38:56.627 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T02:38:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:38:56.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T02:38:56.639 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T02:38:56.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T02:38:56.639 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-12-02T02:38:57.073 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:38:57.077 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:38:57.079 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:39:22.508 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:39:22.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:39:52.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:39:52.651 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:40:22.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:40:22.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:40:52.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:40:52.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:41:22.982 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:41:22.985 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:41:53.121 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:41:53.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:42:23.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:42:23.189 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:42:53.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:42:53.287 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:43:23.348 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:43:23.351 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:43:53.453 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:43:53.456 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:44:23.609 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:44:23.612 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:44:53.741 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:44:53.744 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:45:23.822 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:45:23.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:45:53.935 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:45:53.938 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:45:53.986 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T02:45:53.982+0000 7fbb5a4e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 239961) UID: 0 2023-12-02T02:45:53.986 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T02:45:53.982+0000 7f32704a2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 239961) UID: 0 2023-12-02T02:48:30.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:48:30.922 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:49:01.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:49:01.200 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:49:31.272 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:49:31.275 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:50:01.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:50:01.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:50:31.752 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:50:31.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:51:01.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:51:01.828 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:51:31.981 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:51:31.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:51:49.874 INFO:teuthology.orchestra.run.smithi001.stdout:generic/127 772s 2023-12-02T02:51:49.880 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/127 2023-12-02T02:51:49.880 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:51:49.882 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:49.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:51:49.893 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-12-02T02:51:50.319 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:51:50.324 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:51:50.324 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:50.461 INFO:teuthology.orchestra.run.smithi001.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:51:50.464 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/128 2023-12-02T02:51:50.464 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/128 2023-12-02T02:51:50.465 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:51:50.467 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:50.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:51:50.476 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-12-02T02:51:50.650 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:51:50.652 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:51:50.653 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:50.765 INFO:teuthology.orchestra.run.smithi001.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:51:50.769 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/129 2023-12-02T02:51:50.769 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/129 2023-12-02T02:51:50.769 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:51:50.771 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:50.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:51:50.780 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-12-02T02:51:50.953 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:51:50.958 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:51:50.958 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:51.066 INFO:teuthology.orchestra.run.smithi001.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:51:51.070 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/130 2023-12-02T02:51:51.070 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/130 2023-12-02T02:51:51.070 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:51:51.072 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:51.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:51:51.081 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-12-02T02:51:51.254 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:51:51.259 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:51:51.259 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:52.600 INFO:teuthology.orchestra.run.smithi001.stdout:generic/131 1s 2023-12-02T02:51:52.605 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/131 2023-12-02T02:51:52.605 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:51:52.608 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:52.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:51:52.617 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-12-02T02:51:53.072 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:51:53.076 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:51:53.077 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:53.191 INFO:teuthology.orchestra.run.smithi001.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:51:53.195 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/132 2023-12-02T02:51:53.195 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/132 2023-12-02T02:51:53.195 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:51:53.197 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:51:53.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:51:53.207 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-12-02T02:51:53.379 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:51:53.383 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:51:53.383 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:52:02.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:52:02.081 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:52:32.209 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:52:32.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:53:02.364 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:53:02.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:53:32.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:53:32.499 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:54:02.560 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:54:02.563 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:54:32.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:54:32.619 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:55:02.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:55:02.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:55:31.146 INFO:teuthology.orchestra.run.smithi001.stdout:generic/133 218s 2023-12-02T02:55:31.151 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/133 2023-12-02T02:55:31.151 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:31.154 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:31.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:31.164 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-12-02T02:55:31.609 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:31.614 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:31.614 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:31.853 INFO:teuthology.orchestra.run.smithi001.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:31.857 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/134 2023-12-02T02:55:31.857 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/134 2023-12-02T02:55:31.857 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:31.859 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:31.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:31.868 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-12-02T02:55:32.310 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:32.315 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:32.315 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:32.480 INFO:teuthology.orchestra.run.smithi001.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:32.484 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/135 2023-12-02T02:55:32.484 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/135 2023-12-02T02:55:32.484 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:32.486 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:32.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:32.495 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-12-02T02:55:32.671 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:32.675 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:32.675 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:32.827 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:55:32.831 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:55:32.832 INFO:teuthology.orchestra.run.smithi001.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:32.836 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/136 2023-12-02T02:55:32.836 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/136 2023-12-02T02:55:32.836 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:32.837 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:32.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:32.847 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-12-02T02:55:33.276 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:33.281 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:33.281 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:33.444 INFO:teuthology.orchestra.run.smithi001.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:33.447 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/137 2023-12-02T02:55:33.447 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/137 2023-12-02T02:55:33.448 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:33.450 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:33.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:33.459 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-12-02T02:55:33.920 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:33.924 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:33.924 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:34.079 INFO:teuthology.orchestra.run.smithi001.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:34.083 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/138 2023-12-02T02:55:34.083 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/138 2023-12-02T02:55:34.083 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:34.085 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:34.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:34.095 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-12-02T02:55:34.549 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:34.554 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:34.554 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:34.714 INFO:teuthology.orchestra.run.smithi001.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:34.717 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/139 2023-12-02T02:55:34.717 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/139 2023-12-02T02:55:34.717 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:34.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:34.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:34.729 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-12-02T02:55:35.164 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:35.168 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:35.168 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:35.327 INFO:teuthology.orchestra.run.smithi001.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:35.331 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/140 2023-12-02T02:55:35.331 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/140 2023-12-02T02:55:35.331 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:35.333 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:35.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:35.342 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-12-02T02:55:35.772 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:35.777 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:35.777 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:35.897 INFO:teuthology.orchestra.run.smithi001.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:35.900 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/141 2023-12-02T02:55:35.900 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/141 2023-12-02T02:55:35.901 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:35.903 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:35.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:35.912 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-12-02T02:55:36.085 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:36.089 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:36.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:36.241 INFO:teuthology.orchestra.run.smithi001.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:36.244 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/142 2023-12-02T02:55:36.244 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/142 2023-12-02T02:55:36.244 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:36.247 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:36.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:36.255 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-12-02T02:55:36.706 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:36.710 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:36.713 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:36.871 INFO:teuthology.orchestra.run.smithi001.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:36.874 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/143 2023-12-02T02:55:36.875 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/143 2023-12-02T02:55:36.875 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:36.877 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:36.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:36.886 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-12-02T02:55:37.332 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:37.337 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:37.337 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:37.495 INFO:teuthology.orchestra.run.smithi001.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:37.498 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/144 2023-12-02T02:55:37.498 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/144 2023-12-02T02:55:37.498 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:37.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:37.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:37.510 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-12-02T02:55:37.970 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:37.975 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:37.975 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:38.132 INFO:teuthology.orchestra.run.smithi001.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:38.135 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/145 2023-12-02T02:55:38.135 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/145 2023-12-02T02:55:38.135 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:38.137 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:38.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:38.187 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-12-02T02:55:38.583 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:38.587 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:38.588 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:38.751 INFO:teuthology.orchestra.run.smithi001.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:38.755 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/146 2023-12-02T02:55:38.755 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/146 2023-12-02T02:55:38.755 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:38.757 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:38.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:38.769 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-12-02T02:55:39.215 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:39.219 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:39.219 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:39.379 INFO:teuthology.orchestra.run.smithi001.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:39.383 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/147 2023-12-02T02:55:39.383 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/147 2023-12-02T02:55:39.383 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:39.385 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:39.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:39.394 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-12-02T02:55:39.841 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:39.845 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:39.845 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:40.002 INFO:teuthology.orchestra.run.smithi001.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:40.006 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/148 2023-12-02T02:55:40.006 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/148 2023-12-02T02:55:40.006 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:40.008 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:40.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:40.017 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-12-02T02:55:40.462 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:40.467 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:40.467 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:40.624 INFO:teuthology.orchestra.run.smithi001.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:40.628 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/149 2023-12-02T02:55:40.628 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/149 2023-12-02T02:55:40.628 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:40.630 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:40.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:40.639 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-12-02T02:55:41.085 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:41.089 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:41.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:41.247 INFO:teuthology.orchestra.run.smithi001.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:41.251 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/150 2023-12-02T02:55:41.251 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/150 2023-12-02T02:55:41.251 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:41.253 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:41.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:41.288 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-12-02T02:55:41.706 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:41.712 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:41.712 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:41.871 INFO:teuthology.orchestra.run.smithi001.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:41.874 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/151 2023-12-02T02:55:41.874 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/151 2023-12-02T02:55:41.874 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:41.876 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:41.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:41.886 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-12-02T02:55:42.331 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:42.336 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:42.336 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:42.491 INFO:teuthology.orchestra.run.smithi001.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:42.495 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/152 2023-12-02T02:55:42.495 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/152 2023-12-02T02:55:42.495 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:42.497 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:42.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:42.507 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-12-02T02:55:42.946 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:42.951 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:42.951 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:43.109 INFO:teuthology.orchestra.run.smithi001.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:43.112 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/153 2023-12-02T02:55:43.112 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/153 2023-12-02T02:55:43.113 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:43.115 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:43.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:43.124 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-12-02T02:55:43.566 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:43.571 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:43.571 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:43.769 INFO:teuthology.orchestra.run.smithi001.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:43.772 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/154 2023-12-02T02:55:43.772 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/154 2023-12-02T02:55:43.772 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:43.774 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:43.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:43.798 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-12-02T02:55:44.236 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:44.240 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:44.240 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:44.396 INFO:teuthology.orchestra.run.smithi001.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:44.399 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/155 2023-12-02T02:55:44.399 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/155 2023-12-02T02:55:44.400 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:44.402 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:44.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:44.412 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-12-02T02:55:44.863 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:44.869 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:44.869 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:45.047 INFO:teuthology.orchestra.run.smithi001.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:45.051 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/156 2023-12-02T02:55:45.051 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/156 2023-12-02T02:55:45.051 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:45.053 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:45.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:45.062 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-12-02T02:55:45.494 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:45.499 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:45.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:45.661 INFO:teuthology.orchestra.run.smithi001.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:45.665 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/157 2023-12-02T02:55:45.665 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/157 2023-12-02T02:55:45.665 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:45.667 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:45.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:45.677 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-12-02T02:55:46.120 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:46.124 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:46.124 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:46.287 INFO:teuthology.orchestra.run.smithi001.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:46.290 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/158 2023-12-02T02:55:46.291 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/158 2023-12-02T02:55:46.291 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:46.293 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:46.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:46.323 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-12-02T02:55:46.767 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:46.771 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:46.771 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:46.951 INFO:teuthology.orchestra.run.smithi001.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-02T02:55:46.955 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/159 2023-12-02T02:55:46.955 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/159 2023-12-02T02:55:46.955 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:46.957 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:46.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:46.978 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-12-02T02:55:47.151 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:47.155 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:47.155 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:47.302 INFO:teuthology.orchestra.run.smithi001.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-02T02:55:47.306 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/160 2023-12-02T02:55:47.306 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/160 2023-12-02T02:55:47.306 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:47.308 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:47.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:47.317 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-12-02T02:55:47.490 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:47.494 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:47.494 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:47.603 INFO:teuthology.orchestra.run.smithi001.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:47.606 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/161 2023-12-02T02:55:47.606 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/161 2023-12-02T02:55:47.607 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:47.609 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:47.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:47.618 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-12-02T02:55:47.789 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:47.793 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:47.903 INFO:teuthology.orchestra.run.smithi001.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:47.907 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/162 2023-12-02T02:55:47.907 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/162 2023-12-02T02:55:47.907 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:47.909 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:47.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:47.930 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-12-02T02:55:48.102 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:48.107 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:48.107 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:48.215 INFO:teuthology.orchestra.run.smithi001.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:48.219 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/163 2023-12-02T02:55:48.219 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/163 2023-12-02T02:55:48.219 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:48.221 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:48.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:48.231 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-12-02T02:55:48.404 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:48.408 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:48.409 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:48.518 INFO:teuthology.orchestra.run.smithi001.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:48.522 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/164 2023-12-02T02:55:48.522 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/164 2023-12-02T02:55:48.522 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:48.524 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:48.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:48.533 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-12-02T02:55:48.706 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:48.739 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:48.739 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:48.820 INFO:teuthology.orchestra.run.smithi001.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:48.824 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/165 2023-12-02T02:55:48.824 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/165 2023-12-02T02:55:48.824 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:48.826 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:48.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:48.847 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-12-02T02:55:49.020 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:49.024 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:49.024 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:49.134 INFO:teuthology.orchestra.run.smithi001.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:49.138 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/166 2023-12-02T02:55:49.138 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/166 2023-12-02T02:55:49.138 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:49.140 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:49.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:49.150 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-12-02T02:55:49.322 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:49.326 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:49.326 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:49.438 INFO:teuthology.orchestra.run.smithi001.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:49.441 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/167 2023-12-02T02:55:49.441 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/167 2023-12-02T02:55:49.442 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:49.444 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:49.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:49.452 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-12-02T02:55:49.629 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:49.631 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:49.631 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:49.752 INFO:teuthology.orchestra.run.smithi001.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:49.756 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/168 2023-12-02T02:55:49.756 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/168 2023-12-02T02:55:49.757 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:49.758 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:49.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:49.767 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-12-02T02:55:49.941 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:49.945 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:49.945 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.054 INFO:teuthology.orchestra.run.smithi001.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:50.058 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/169 2023-12-02T02:55:50.058 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/169 2023-12-02T02:55:50.058 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:50.060 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:50.070 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-12-02T02:55:50.245 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:50.247 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:50.247 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.357 INFO:teuthology.orchestra.run.smithi001.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:50.360 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/170 2023-12-02T02:55:50.360 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/170 2023-12-02T02:55:50.361 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:50.380 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-12-02T02:55:50.553 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:50.557 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:50.557 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/171 2023-12-02T02:55:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/171 2023-12-02T02:55:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:50.677 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:50.686 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-12-02T02:55:50.862 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:50.863 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:50.863 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.978 INFO:teuthology.orchestra.run.smithi001.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:50.981 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/172 2023-12-02T02:55:50.982 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/172 2023-12-02T02:55:50.982 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:50.984 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:50.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:50.993 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-12-02T02:55:51.166 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:51.171 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:51.171 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:51.284 INFO:teuthology.orchestra.run.smithi001.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:51.287 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/173 2023-12-02T02:55:51.287 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/173 2023-12-02T02:55:51.287 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:51.290 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:51.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:51.298 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-12-02T02:55:51.474 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:51.476 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:51.476 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:51.590 INFO:teuthology.orchestra.run.smithi001.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:51.594 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/174 2023-12-02T02:55:51.594 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/174 2023-12-02T02:55:51.594 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:51.596 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:51.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:51.605 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-12-02T02:55:51.778 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:51.782 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:51.782 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:51.893 INFO:teuthology.orchestra.run.smithi001.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:51.898 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/175 2023-12-02T02:55:51.898 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/175 2023-12-02T02:55:51.898 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:51.899 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:51.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:51.918 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-12-02T02:55:52.090 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:52.094 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:52.094 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:52.206 INFO:teuthology.orchestra.run.smithi001.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:52.209 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/176 2023-12-02T02:55:52.209 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/176 2023-12-02T02:55:52.209 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:52.212 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:52.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:52.221 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-12-02T02:55:52.395 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:52.400 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:52.400 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:52.555 INFO:teuthology.orchestra.run.smithi001.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:52.558 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/177 2023-12-02T02:55:52.558 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/177 2023-12-02T02:55:52.558 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:52.560 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:52.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:52.569 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-12-02T02:55:52.742 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:52.746 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:52.746 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:52.899 INFO:teuthology.orchestra.run.smithi001.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:52.903 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/178 2023-12-02T02:55:52.903 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/178 2023-12-02T02:55:52.903 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:52.905 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:52.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:52.914 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-12-02T02:55:53.359 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:53.364 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:53.364 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:53.519 INFO:teuthology.orchestra.run.smithi001.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:53.523 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/179 2023-12-02T02:55:53.523 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/179 2023-12-02T02:55:53.523 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:53.525 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:53.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:53.551 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-12-02T02:55:54.010 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:54.014 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:54.014 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:54.170 INFO:teuthology.orchestra.run.smithi001.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:54.173 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/180 2023-12-02T02:55:54.174 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/180 2023-12-02T02:55:54.174 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:54.176 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:54.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:54.185 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-12-02T02:55:54.634 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:54.639 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:54.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:54.794 INFO:teuthology.orchestra.run.smithi001.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:54.798 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/181 2023-12-02T02:55:54.798 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/181 2023-12-02T02:55:54.798 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:54.800 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:54.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:54.810 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-12-02T02:55:55.260 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:55.265 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:55.265 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:55.426 INFO:teuthology.orchestra.run.smithi001.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T02:55:55.429 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/182 2023-12-02T02:55:55.429 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/182 2023-12-02T02:55:55.429 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:55.431 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:55.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:55.440 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-12-02T02:55:55.874 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:55.878 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:55.993 INFO:teuthology.orchestra.run.smithi001.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:55.996 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/183 2023-12-02T02:55:55.996 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/183 2023-12-02T02:55:55.997 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:55.999 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:56.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:56.008 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-12-02T02:55:56.181 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:56.186 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:56.364 INFO:teuthology.orchestra.run.smithi001.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/184.out.bad) 2023-12-02T02:55:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/184.out 2023-12-02 01:30:49.064044172 +0000 2023-12-02T02:55:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/184.out.bad 2023-12-02 02:55:56.360983390 +0000 2023-12-02T02:55:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1 +1,2 @@ 2023-12-02T02:55:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 184 2023-12-02T02:55:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: +/tmp/tmp.q8QLSYR2gwxfstests-dev/tests/generic/184: line 23: /tmp/tmp.iMk1cH1heVtest/null: Permission denied 2023-12-02T02:55:56.368 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/184 2023-12-02T02:55:56.368 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/184 2023-12-02T02:55:56.368 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T02:55:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:56.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T02:55:56.379 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T02:55:56.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T02:55:56.379 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-12-02T02:55:56.551 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:56.556 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:56.665 INFO:teuthology.orchestra.run.smithi001.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:56.668 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/185 2023-12-02T02:55:56.668 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/185 2023-12-02T02:55:56.669 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:56.671 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:56.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:56.680 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-12-02T02:55:56.853 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:56.857 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:56.968 INFO:teuthology.orchestra.run.smithi001.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:56.972 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/186 2023-12-02T02:55:56.972 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/186 2023-12-02T02:55:56.972 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:56.974 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:56.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:56.984 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-12-02T02:55:57.156 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:57.160 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:57.160 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:57.268 INFO:teuthology.orchestra.run.smithi001.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:57.272 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/187 2023-12-02T02:55:57.272 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/187 2023-12-02T02:55:57.272 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:57.274 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:57.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:57.283 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-12-02T02:55:57.455 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:57.459 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:57.459 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:57.580 INFO:teuthology.orchestra.run.smithi001.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:57.583 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/188 2023-12-02T02:55:57.583 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/188 2023-12-02T02:55:57.583 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:57.586 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:57.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:57.617 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-12-02T02:55:57.790 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:57.794 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:57.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:57.904 INFO:teuthology.orchestra.run.smithi001.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:57.907 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/189 2023-12-02T02:55:57.907 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/189 2023-12-02T02:55:57.907 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:57.909 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:57.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:57.918 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-12-02T02:55:58.092 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:58.096 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:58.096 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:58.205 INFO:teuthology.orchestra.run.smithi001.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:58.209 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/190 2023-12-02T02:55:58.209 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/190 2023-12-02T02:55:58.209 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:58.211 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:58.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:58.221 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-12-02T02:55:58.394 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:58.398 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:58.398 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:58.507 INFO:teuthology.orchestra.run.smithi001.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:55:58.511 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/191 2023-12-02T02:55:58.511 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/191 2023-12-02T02:55:58.511 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:58.513 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:58.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:58.522 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-12-02T02:55:58.695 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:58.699 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:58.699 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:58.815 INFO:teuthology.orchestra.run.smithi001.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-12-02T02:55:58.819 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/192 2023-12-02T02:55:58.819 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/192 2023-12-02T02:55:58.819 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:55:58.821 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:58.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:55:58.830 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-12-02T02:55:59.004 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:55:59.008 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:55:59.008 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:59.870 INFO:teuthology.orchestra.run.smithi001.stdout:generic/193 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/193.out.bad) 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/193.out 2023-12-02 01:30:49.065044158 +0000 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/193.out.bad 2023-12-02 02:55:59.865938805 +0000 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -24,7 +24,6 @@ 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: user: chmod a+r on root owned file (should fail) 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: check that the sgid bit is cleared 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: -rw-rw-rw- 2023-12-02T02:55:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: check that suid bit is not cleared 2023-12-02T02:55:59.874 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/193 2023-12-02T02:55:59.874 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/193 2023-12-02T02:55:59.874 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T02:55:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:55:59.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T02:55:59.886 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T02:55:59.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T02:55:59.886 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-12-02T02:56:00.329 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:00.334 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:00.446 INFO:teuthology.orchestra.run.smithi001.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:00.450 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/194 2023-12-02T02:56:00.450 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/194 2023-12-02T02:56:00.450 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:00.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:00.462 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-12-02T02:56:00.635 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:00.639 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:00.753 INFO:teuthology.orchestra.run.smithi001.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:00.756 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/195 2023-12-02T02:56:00.756 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/195 2023-12-02T02:56:00.756 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:00.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:00.768 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-12-02T02:56:00.940 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:00.944 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:00.944 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:01.053 INFO:teuthology.orchestra.run.smithi001.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:01.057 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/196 2023-12-02T02:56:01.058 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/196 2023-12-02T02:56:01.058 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:01.059 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:01.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:01.069 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-12-02T02:56:01.244 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:01.248 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:01.248 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:01.358 INFO:teuthology.orchestra.run.smithi001.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:01.362 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/197 2023-12-02T02:56:01.362 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/197 2023-12-02T02:56:01.362 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:01.364 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:01.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:01.373 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-12-02T02:56:01.546 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:01.551 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:01.551 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:02.254 INFO:teuthology.orchestra.run.smithi001.stdout:generic/198 1s 2023-12-02T02:56:02.259 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/198 2023-12-02T02:56:02.259 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:02.261 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:02.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:02.271 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-12-02T02:56:02.746 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:02.752 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:02.752 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:02.897 INFO:teuthology.orchestra.run.smithi001.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:02.901 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/199 2023-12-02T02:56:02.901 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/199 2023-12-02T02:56:02.901 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:02.903 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:56:02.904 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:02.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:56:02.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:02.914 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-12-02T02:56:03.127 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:03.131 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:03.131 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:03.242 INFO:teuthology.orchestra.run.smithi001.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:03.246 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/200 2023-12-02T02:56:03.246 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/200 2023-12-02T02:56:03.246 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:03.248 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:03.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:03.268 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-12-02T02:56:03.441 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:03.445 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:03.555 INFO:teuthology.orchestra.run.smithi001.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:03.558 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/201 2023-12-02T02:56:03.559 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/201 2023-12-02T02:56:03.559 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:03.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:03.571 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-12-02T02:56:03.745 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:03.750 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:03.871 INFO:teuthology.orchestra.run.smithi001.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:03.875 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/202 2023-12-02T02:56:03.876 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/202 2023-12-02T02:56:03.876 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:03.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:03.886 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-12-02T02:56:04.059 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:04.063 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:04.173 INFO:teuthology.orchestra.run.smithi001.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:04.176 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/203 2023-12-02T02:56:04.176 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/203 2023-12-02T02:56:04.176 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:04.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:04.188 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-12-02T02:56:04.363 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:04.367 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:05.974 INFO:teuthology.orchestra.run.smithi001.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:05.979 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/204 2023-12-02T02:56:05.979 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/204 2023-12-02T02:56:05.979 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:05.982 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:05.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:05.994 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-12-02T02:56:06.183 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:06.187 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:06.187 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:06.301 INFO:teuthology.orchestra.run.smithi001.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:06.304 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/205 2023-12-02T02:56:06.304 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/205 2023-12-02T02:56:06.304 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:06.307 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:06.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:06.315 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-12-02T02:56:06.492 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:06.496 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:06.496 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:06.612 INFO:teuthology.orchestra.run.smithi001.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:56:06.615 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/206 2023-12-02T02:56:06.615 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/206 2023-12-02T02:56:06.616 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:06.618 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:06.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:06.628 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-12-02T02:56:06.806 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:06.810 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:06.810 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:20.716 INFO:teuthology.orchestra.run.smithi001.stdout:generic/207 14s 2023-12-02T02:56:20.721 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/207 2023-12-02T02:56:20.721 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:56:20.723 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:20.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:56:20.733 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-12-02T02:56:21.158 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:56:21.162 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:56:21.162 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:56:33.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:56:33.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:57:03.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:57:03.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:57:33.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:57:33.204 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:58:03.274 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:58:03.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:58:33.338 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:58:33.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:59:03.686 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:59:03.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:59:33.816 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:59:33.819 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T02:59:41.437 INFO:teuthology.orchestra.run.smithi001.stdout:generic/208 200s 2023-12-02T02:59:41.439 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/208 2023-12-02T02:59:41.440 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:41.442 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:41.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:41.452 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-12-02T02:59:41.908 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:41.913 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:41.913 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:49.561 INFO:teuthology.orchestra.run.smithi001.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/209.out.bad) 2023-12-02T02:59:49.570 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/209.out 2023-12-02 01:30:49.066044144 +0000 2023-12-02T02:59:49.571 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/209.out.bad 2023-12-02 02:59:49.540001054 +0000 2023-12-02T02:59:49.571 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,2 +1,2 @@ 2023-12-02T02:59:49.571 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 209 2023-12-02T02:59:49.571 INFO:teuthology.orchestra.run.smithi001.stdout: -test ran for 30 seconds without error 2023-12-02T02:59:49.571 INFO:teuthology.orchestra.run.smithi001.stdout: +reader found old byte at pos 4096 2023-12-02T02:59:49.571 INFO:teuthology.orchestra.run.smithi001.stdout: \ No newline at end of file 2023-12-02T02:59:49.578 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/209 2023-12-02T02:59:49.578 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/209 2023-12-02T02:59:49.579 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T02:59:49.581 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:49.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T02:59:49.594 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T02:59:49.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T02:59:49.595 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-12-02T02:59:49.991 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:49.996 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:49.996 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:50.416 INFO:teuthology.orchestra.run.smithi001.stdout:generic/210 0s 2023-12-02T02:59:50.454 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/210 2023-12-02T02:59:50.455 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:50.457 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:50.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:50.482 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-12-02T02:59:50.914 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:50.919 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:50.919 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:51.206 INFO:teuthology.orchestra.run.smithi001.stdout:generic/211 1s 2023-12-02T02:59:51.211 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/211 2023-12-02T02:59:51.211 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:51.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:51.222 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-12-02T02:59:51.395 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:51.399 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:51.399 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:51.603 INFO:teuthology.orchestra.run.smithi001.stdout:generic/212 0s 2023-12-02T02:59:51.608 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/212 2023-12-02T02:59:51.608 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:51.611 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:51.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:51.619 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-12-02T02:59:51.795 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:51.800 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:51.800 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:52.190 INFO:teuthology.orchestra.run.smithi001.stdout:generic/213 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/213.out.bad) 2023-12-02T02:59:52.192 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/213.out 2023-12-02 01:30:49.067044130 +0000 2023-12-02T02:59:52.192 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/213.out.bad 2023-12-02 02:59:52.185967529 +0000 2023-12-02T02:59:52.192 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,4 +1,3 @@ 2023-12-02T02:59:52.193 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 213 2023-12-02T02:59:52.193 INFO:teuthology.orchestra.run.smithi001.stdout: We should get: fallocate: No space left on device 2023-12-02T02:59:52.193 INFO:teuthology.orchestra.run.smithi001.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-12-02T02:59:52.193 INFO:teuthology.orchestra.run.smithi001.stdout: -fallocate: No space left on device 2023-12-02T02:59:52.195 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/213 2023-12-02T02:59:52.196 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/213 2023-12-02T02:59:52.196 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T02:59:52.198 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:52.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T02:59:52.207 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T02:59:52.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T02:59:52.208 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-12-02T02:59:52.644 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:52.649 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:52.650 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:53.087 INFO:teuthology.orchestra.run.smithi001.stdout:generic/214 1s 2023-12-02T02:59:53.093 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/214 2023-12-02T02:59:53.093 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:53.096 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:53.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:53.106 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-12-02T02:59:53.575 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:53.580 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:53.580 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:56.691 INFO:teuthology.orchestra.run.smithi001.stdout:generic/215 3s 2023-12-02T02:59:56.698 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/215 2023-12-02T02:59:56.699 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:56.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:56.715 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-12-02T02:59:56.968 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:56.973 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:56.973 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:57.152 INFO:teuthology.orchestra.run.smithi001.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:59:57.158 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/216 2023-12-02T02:59:57.158 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/216 2023-12-02T02:59:57.158 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:57.161 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:57.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:57.175 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-12-02T02:59:57.432 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:57.436 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:57.436 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:57.602 INFO:teuthology.orchestra.run.smithi001.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:59:57.606 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/217 2023-12-02T02:59:57.606 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/217 2023-12-02T02:59:57.606 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:57.609 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:57.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:57.621 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-12-02T02:59:57.869 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:57.875 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:57.875 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:58.034 INFO:teuthology.orchestra.run.smithi001.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:59:58.038 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/218 2023-12-02T02:59:58.039 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/218 2023-12-02T02:59:58.039 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:58.042 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:58.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:58.054 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-12-02T02:59:58.297 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:58.302 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:58.302 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:58.459 INFO:teuthology.orchestra.run.smithi001.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:59:58.463 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/219 2023-12-02T02:59:58.463 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/219 2023-12-02T02:59:58.463 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:58.466 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:58.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:58.480 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-12-02T02:59:58.733 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:58.740 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:58.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:58.890 INFO:teuthology.orchestra.run.smithi001.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T02:59:58.894 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/220 2023-12-02T02:59:58.895 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/220 2023-12-02T02:59:58.895 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T02:59:58.898 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T02:59:58.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T02:59:58.909 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-12-02T02:59:59.165 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T02:59:59.170 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T02:59:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:00.389 INFO:teuthology.orchestra.run.smithi001.stdout:generic/221 1s 2023-12-02T03:00:00.396 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/221 2023-12-02T03:00:00.396 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:00.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:00.415 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-12-02T03:00:00.666 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:00.672 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:00.672 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:00.828 INFO:teuthology.orchestra.run.smithi001.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:00.833 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/222 2023-12-02T03:00:00.833 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/222 2023-12-02T03:00:00.833 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:00.836 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:00.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:00.848 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-12-02T03:00:01.099 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:01.105 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:01.105 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:01.257 INFO:teuthology.orchestra.run.smithi001.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:01.262 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/223 2023-12-02T03:00:01.262 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/223 2023-12-02T03:00:01.262 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:01.265 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:01.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:01.279 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-12-02T03:00:01.529 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:01.535 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:01.536 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:01.708 INFO:teuthology.orchestra.run.smithi001.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:01.713 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/224 2023-12-02T03:00:01.713 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/224 2023-12-02T03:00:01.713 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:01.716 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:01.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:01.728 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-12-02T03:00:01.983 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:01.988 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:01.988 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:02.153 INFO:teuthology.orchestra.run.smithi001.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:02.158 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/225 2023-12-02T03:00:02.158 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/225 2023-12-02T03:00:02.159 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:02.161 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:02.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:02.176 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-12-02T03:00:02.424 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:02.430 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:02.430 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:02.593 INFO:teuthology.orchestra.run.smithi001.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:02.598 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/226 2023-12-02T03:00:02.598 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/226 2023-12-02T03:00:02.598 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:02.601 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:02.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:02.614 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-12-02T03:00:02.855 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:02.860 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:02.860 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:03.015 INFO:teuthology.orchestra.run.smithi001.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:03.021 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/227 2023-12-02T03:00:03.021 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/227 2023-12-02T03:00:03.021 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:03.024 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:03.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:03.038 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-12-02T03:00:03.278 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:03.283 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:03.283 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:03.580 INFO:teuthology.orchestra.run.smithi001.stdout:generic/228 0s 2023-12-02T03:00:03.590 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/228 2023-12-02T03:00:03.590 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:03.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:03.608 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-12-02T03:00:03.923 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:00:03.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:00:04.093 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:04.097 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:04.251 INFO:teuthology.orchestra.run.smithi001.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:04.256 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/229 2023-12-02T03:00:04.256 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/229 2023-12-02T03:00:04.256 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:04.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:04.270 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-12-02T03:00:04.528 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:04.534 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:04.693 INFO:teuthology.orchestra.run.smithi001.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:04.696 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/230 2023-12-02T03:00:04.697 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/230 2023-12-02T03:00:04.697 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:04.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:04.713 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-12-02T03:00:04.959 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:04.963 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:04.964 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:05.133 INFO:teuthology.orchestra.run.smithi001.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:05.138 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/231 2023-12-02T03:00:05.139 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/231 2023-12-02T03:00:05.139 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:05.141 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:05.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:05.152 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-12-02T03:00:05.395 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:05.400 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:05.400 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:05.551 INFO:teuthology.orchestra.run.smithi001.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:05.556 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/232 2023-12-02T03:00:05.556 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/232 2023-12-02T03:00:05.556 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:05.560 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:05.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:05.573 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-12-02T03:00:05.828 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:05.833 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:05.834 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:05.983 INFO:teuthology.orchestra.run.smithi001.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:05.988 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/233 2023-12-02T03:00:05.988 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/233 2023-12-02T03:00:05.988 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:05.991 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:06.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:06.005 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-12-02T03:00:06.263 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:06.267 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:06.268 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:06.427 INFO:teuthology.orchestra.run.smithi001.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:06.432 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/234 2023-12-02T03:00:06.432 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/234 2023-12-02T03:00:06.432 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:06.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:06.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:06.460 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-12-02T03:00:06.704 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:06.708 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:06.708 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:06.864 INFO:teuthology.orchestra.run.smithi001.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:06.869 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/235 2023-12-02T03:00:06.870 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/235 2023-12-02T03:00:06.870 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:06.872 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:06.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:06.894 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-12-02T03:00:07.151 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:07.158 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:07.158 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:08.440 INFO:teuthology.orchestra.run.smithi001.stdout:generic/236 1s 2023-12-02T03:00:08.446 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/236 2023-12-02T03:00:08.446 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:08.448 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:08.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:08.459 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-12-02T03:00:08.945 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:08.950 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:08.950 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:09.175 INFO:teuthology.orchestra.run.smithi001.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-02T03:00:09.180 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/237 2023-12-02T03:00:09.180 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/237 2023-12-02T03:00:09.181 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:09.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:09.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:09.197 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-12-02T03:00:09.446 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:09.452 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:09.453 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:09.601 INFO:teuthology.orchestra.run.smithi001.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:00:09.604 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/238 2023-12-02T03:00:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/238 2023-12-02T03:00:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:00:09.608 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:09.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:00:09.624 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-12-02T03:00:09.867 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:00:09.872 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:00:09.873 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:00:34.313 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:00:34.319 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:01:04.633 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:01:04.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:01:34.735 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:01:34.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:02:04.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:02:04.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:02:27.699 INFO:teuthology.orchestra.run.smithi001.stdout:generic/239 138s 2023-12-02T03:02:27.708 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/239 2023-12-02T03:02:27.709 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:02:27.715 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:02:27.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:02:27.731 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-12-02T03:02:28.171 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:02:28.177 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:02:28.177 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:02:31.061 INFO:teuthology.orchestra.run.smithi001.stdout:generic/240 3s 2023-12-02T03:02:31.068 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/240 2023-12-02T03:02:31.068 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:02:31.071 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:02:31.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:02:31.087 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-12-02T03:02:31.539 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:02:31.544 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:02:31.544 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:02:34.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:02:34.949 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:03:05.052 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:03:05.055 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:03:35.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:03:35.420 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:03:45.717 INFO:teuthology.orchestra.run.smithi001.stdout:generic/241 74s 2023-12-02T03:03:45.728 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/241 2023-12-02T03:03:45.728 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:03:45.730 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:45.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:03:45.746 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-12-02T03:03:46.219 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:03:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:03:46.226 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:46.639 INFO:teuthology.orchestra.run.smithi001.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:03:46.643 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/242 2023-12-02T03:03:46.643 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/242 2023-12-02T03:03:46.643 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:03:46.646 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:46.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:03:46.661 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-12-02T03:03:46.912 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:03:46.917 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:03:46.918 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:47.098 INFO:teuthology.orchestra.run.smithi001.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:03:47.106 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/243 2023-12-02T03:03:47.106 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/243 2023-12-02T03:03:47.106 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:03:47.110 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:47.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:03:47.124 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-12-02T03:03:47.393 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:03:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:03:47.400 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:47.561 INFO:teuthology.orchestra.run.smithi001.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-02T03:03:47.565 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/244 2023-12-02T03:03:47.565 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/244 2023-12-02T03:03:47.565 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:03:47.567 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:47.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:03:47.577 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-12-02T03:03:47.826 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:03:47.831 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:03:47.831 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:48.133 INFO:teuthology.orchestra.run.smithi001.stdout:generic/245 1s 2023-12-02T03:03:48.141 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/245 2023-12-02T03:03:48.141 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:03:48.144 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:48.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:03:48.155 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-12-02T03:03:48.602 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:03:48.607 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:03:48.607 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:48.863 INFO:teuthology.orchestra.run.smithi001.stdout:generic/246 0s 2023-12-02T03:03:48.871 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/246 2023-12-02T03:03:48.872 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:03:48.875 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:03:48.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:03:48.886 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-12-02T03:03:49.346 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:03:49.352 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:03:49.352 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:05.508 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:04:05.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:04:31.266 INFO:teuthology.orchestra.run.smithi001.stdout:generic/247 42s 2023-12-02T03:04:31.274 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/247 2023-12-02T03:04:31.274 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:31.277 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:31.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:31.289 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-12-02T03:04:31.562 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:31.567 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:31.567 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:31.824 INFO:teuthology.orchestra.run.smithi001.stdout:generic/248 0s 2023-12-02T03:04:31.831 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/248 2023-12-02T03:04:31.831 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:31.834 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:31.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:31.845 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-12-02T03:04:32.113 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:32.117 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:32.117 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:34.401 INFO:teuthology.orchestra.run.smithi001.stdout:generic/249 2s 2023-12-02T03:04:34.410 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/249 2023-12-02T03:04:34.410 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:34.413 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:34.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:34.425 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-12-02T03:04:35.196 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:35.204 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:35.204 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:35.460 INFO:teuthology.orchestra.run.smithi001.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:35.464 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/250 2023-12-02T03:04:35.464 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/250 2023-12-02T03:04:35.464 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:35.468 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:35.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:35.480 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-12-02T03:04:35.596 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:04:35.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:04:35.728 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:35.733 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:35.733 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:35.914 INFO:teuthology.orchestra.run.smithi001.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:35.918 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/251 2023-12-02T03:04:35.918 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/251 2023-12-02T03:04:35.918 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:35.921 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:35.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:35.934 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-12-02T03:04:36.189 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:36.197 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:36.197 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:36.373 INFO:teuthology.orchestra.run.smithi001.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:36.376 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/252 2023-12-02T03:04:36.376 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/252 2023-12-02T03:04:36.377 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:36.380 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:36.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:36.393 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-12-02T03:04:36.641 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:36.647 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:36.648 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:36.816 INFO:teuthology.orchestra.run.smithi001.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:36.820 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/253 2023-12-02T03:04:36.820 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/253 2023-12-02T03:04:36.820 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:36.822 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:36.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:36.832 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-12-02T03:04:37.084 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:37.090 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:37.090 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:37.244 INFO:teuthology.orchestra.run.smithi001.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/254 2023-12-02T03:04:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/254 2023-12-02T03:04:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:37.252 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:37.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:37.262 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-12-02T03:04:37.503 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:37.508 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:37.508 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:38.869 INFO:teuthology.orchestra.run.smithi001.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T03:04:38.874 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/255 2023-12-02T03:04:38.874 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/255 2023-12-02T03:04:38.874 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:38.877 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:38.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:38.891 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-12-02T03:04:39.362 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:39.366 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:39.367 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:40.677 INFO:teuthology.orchestra.run.smithi001.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:40.683 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/256 2023-12-02T03:04:40.683 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/256 2023-12-02T03:04:40.683 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:40.686 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:40.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:40.698 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-12-02T03:04:40.947 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:40.953 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:40.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:42.325 INFO:teuthology.orchestra.run.smithi001.stdout:generic/257 2s 2023-12-02T03:04:42.337 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/257 2023-12-02T03:04:42.337 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:42.340 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:42.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:42.352 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-12-02T03:04:42.833 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:42.841 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:42.841 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:43.058 INFO:teuthology.orchestra.run.smithi001.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/258.out.bad) 2023-12-02T03:04:43.061 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/258.out 2023-12-02 01:30:49.070044089 +0000 2023-12-02T03:04:43.061 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/258.out.bad 2023-12-02 03:04:43.055274824 +0000 2023-12-02T03:04:43.061 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,5 +1,6 @@ 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 258 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: Creating file with timestamp of Jan 1, 1960 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: Testing for negative seconds since epoch 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: -Remounting to flush cache 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: -Testing for negative seconds since epoch 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: +Timestamp wrapped: 3979351756 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: +Timestamp wrapped 2023-12-02T03:04:43.062 INFO:teuthology.orchestra.run.smithi001.stdout: +(see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/258.full for details) 2023-12-02T03:04:43.065 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/258 2023-12-02T03:04:43.065 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/258 2023-12-02T03:04:43.065 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T03:04:43.067 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:43.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T03:04:43.077 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T03:04:43.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T03:04:43.078 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-12-02T03:04:43.325 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:43.332 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:43.333 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:43.495 INFO:teuthology.orchestra.run.smithi001.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:43.499 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/259 2023-12-02T03:04:43.499 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/259 2023-12-02T03:04:43.499 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:43.502 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:43.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:43.517 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-12-02T03:04:43.757 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:43.762 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:43.763 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:43.919 INFO:teuthology.orchestra.run.smithi001.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:43.924 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/260 2023-12-02T03:04:43.924 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/260 2023-12-02T03:04:43.924 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:43.927 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:43.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:43.939 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-12-02T03:04:44.178 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:44.183 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:44.183 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:44.346 INFO:teuthology.orchestra.run.smithi001.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:44.353 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/261 2023-12-02T03:04:44.353 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/261 2023-12-02T03:04:44.353 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:44.356 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:44.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:44.368 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-12-02T03:04:44.621 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:44.627 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:44.627 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:44.795 INFO:teuthology.orchestra.run.smithi001.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:04:44.800 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/262 2023-12-02T03:04:44.800 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/262 2023-12-02T03:04:44.800 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:04:44.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:04:44.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:04:44.815 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-12-02T03:04:45.065 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:04:45.070 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:04:45.070 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:05.665 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:05:05.668 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:05:35.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:05:35.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:05:47.764 INFO:teuthology.orchestra.run.smithi001.stdout:generic/263 62s 2023-12-02T03:05:47.769 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/263 2023-12-02T03:05:47.770 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:47.772 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:47.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:47.781 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-12-02T03:05:48.219 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:48.224 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:48.224 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:48.342 INFO:teuthology.orchestra.run.smithi001.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:48.345 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/264 2023-12-02T03:05:48.346 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/264 2023-12-02T03:05:48.346 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:48.348 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:48.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:48.357 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-12-02T03:05:48.529 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:48.533 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:48.533 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:48.715 INFO:teuthology.orchestra.run.smithi001.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:48.718 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/265 2023-12-02T03:05:48.719 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/265 2023-12-02T03:05:48.719 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:48.721 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:48.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:48.730 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-12-02T03:05:48.902 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:48.907 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:48.907 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.039 INFO:teuthology.orchestra.run.smithi001.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:49.042 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/266 2023-12-02T03:05:49.042 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/266 2023-12-02T03:05:49.043 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:49.045 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:49.054 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-12-02T03:05:49.227 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:49.231 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:49.231 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.353 INFO:teuthology.orchestra.run.smithi001.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:49.357 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/267 2023-12-02T03:05:49.357 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/267 2023-12-02T03:05:49.357 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:49.360 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:49.368 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-12-02T03:05:49.542 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:49.546 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:49.546 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.670 INFO:teuthology.orchestra.run.smithi001.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/268 2023-12-02T03:05:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/268 2023-12-02T03:05:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:49.676 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:49.685 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-12-02T03:05:49.858 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:49.862 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:49.862 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.970 INFO:teuthology.orchestra.run.smithi001.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:49.974 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/269 2023-12-02T03:05:49.974 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/269 2023-12-02T03:05:49.974 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:49.976 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:49.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:49.985 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-12-02T03:05:50.159 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:50.163 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:50.163 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:50.284 INFO:teuthology.orchestra.run.smithi001.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-02T03:05:50.287 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/270 2023-12-02T03:05:50.288 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/270 2023-12-02T03:05:50.288 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:50.290 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:50.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:50.298 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-12-02T03:05:50.471 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:50.475 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:50.475 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:50.595 INFO:teuthology.orchestra.run.smithi001.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:50.599 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/271 2023-12-02T03:05:50.599 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/271 2023-12-02T03:05:50.599 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:50.601 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:50.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:50.610 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-12-02T03:05:50.782 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:50.790 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:50.790 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:50.911 INFO:teuthology.orchestra.run.smithi001.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:50.915 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/272 2023-12-02T03:05:50.915 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/272 2023-12-02T03:05:50.915 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:50.917 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:50.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:50.926 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-12-02T03:05:51.098 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:51.103 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:51.103 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:51.331 INFO:teuthology.orchestra.run.smithi001.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:51.335 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/273 2023-12-02T03:05:51.335 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/273 2023-12-02T03:05:51.335 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:51.337 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:51.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:51.346 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-12-02T03:05:51.519 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:51.523 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:51.523 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:51.646 INFO:teuthology.orchestra.run.smithi001.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:51.650 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/274 2023-12-02T03:05:51.650 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/274 2023-12-02T03:05:51.650 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:51.652 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:51.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:51.660 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-12-02T03:05:51.833 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:51.837 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:51.837 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:51.947 INFO:teuthology.orchestra.run.smithi001.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:51.950 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/275 2023-12-02T03:05:51.951 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/275 2023-12-02T03:05:51.951 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:51.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:51.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:51.962 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-12-02T03:05:52.133 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:52.137 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:52.137 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:52.257 INFO:teuthology.orchestra.run.smithi001.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:52.261 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/276 2023-12-02T03:05:52.261 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/276 2023-12-02T03:05:52.261 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:52.263 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:52.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:52.272 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-12-02T03:05:52.446 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:52.450 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:52.450 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:52.576 INFO:teuthology.orchestra.run.smithi001.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:52.579 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/277 2023-12-02T03:05:52.579 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/277 2023-12-02T03:05:52.579 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:52.581 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:52.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:52.590 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-12-02T03:05:52.764 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:52.768 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:52.768 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:52.901 INFO:teuthology.orchestra.run.smithi001.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:52.904 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/278 2023-12-02T03:05:52.904 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/278 2023-12-02T03:05:52.904 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:52.907 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:52.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:52.916 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-12-02T03:05:53.090 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:53.094 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:53.094 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:53.215 INFO:teuthology.orchestra.run.smithi001.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:53.219 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/279 2023-12-02T03:05:53.219 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/279 2023-12-02T03:05:53.219 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:53.221 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:53.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:53.230 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-12-02T03:05:53.403 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:53.407 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:53.407 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:53.557 INFO:teuthology.orchestra.run.smithi001.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:53.561 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/280 2023-12-02T03:05:53.561 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/280 2023-12-02T03:05:53.561 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:53.563 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:53.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:53.585 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-12-02T03:05:53.759 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:53.763 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:53.763 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:53.885 INFO:teuthology.orchestra.run.smithi001.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:53.889 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/281 2023-12-02T03:05:53.889 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/281 2023-12-02T03:05:53.889 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:53.891 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:53.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:53.900 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-12-02T03:05:54.075 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:54.079 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:54.079 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:54.203 INFO:teuthology.orchestra.run.smithi001.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:54.206 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/282 2023-12-02T03:05:54.206 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/282 2023-12-02T03:05:54.206 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:54.209 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:54.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:54.217 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-12-02T03:05:54.390 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:54.394 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:54.394 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:54.515 INFO:teuthology.orchestra.run.smithi001.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:54.519 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/283 2023-12-02T03:05:54.519 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/283 2023-12-02T03:05:54.519 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:54.521 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:54.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:54.547 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-12-02T03:05:54.721 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:54.725 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:54.725 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:54.834 INFO:teuthology.orchestra.run.smithi001.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:05:54.838 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/284 2023-12-02T03:05:54.838 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/284 2023-12-02T03:05:54.838 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:54.841 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:54.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:54.850 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-12-02T03:05:55.023 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:55.027 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:55.027 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:56.585 INFO:teuthology.orchestra.run.smithi001.stdout:generic/285 1s 2023-12-02T03:05:56.613 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/285 2023-12-02T03:05:56.613 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:05:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:05:56.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:05:56.622 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-12-02T03:05:57.085 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:05:57.089 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:05:57.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:06.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:06:06.330 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:06:28.744 INFO:teuthology.orchestra.run.smithi001.stdout:generic/286 31s 2023-12-02T03:06:28.786 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/286 2023-12-02T03:06:28.786 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:28.788 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:28.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:28.797 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-12-02T03:06:30.440 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:30.446 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:30.446 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:31.124 INFO:teuthology.orchestra.run.smithi001.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:31.128 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/287 2023-12-02T03:06:31.128 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/287 2023-12-02T03:06:31.128 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:31.131 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:31.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:31.142 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-12-02T03:06:31.322 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:31.326 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:31.326 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:31.527 INFO:teuthology.orchestra.run.smithi001.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:31.530 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/288 2023-12-02T03:06:31.530 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/288 2023-12-02T03:06:31.530 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:31.533 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:31.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:31.541 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-12-02T03:06:31.712 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:31.717 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:31.717 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:31.975 INFO:teuthology.orchestra.run.smithi001.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:31.978 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/289 2023-12-02T03:06:31.978 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/289 2023-12-02T03:06:31.978 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:31.981 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:31.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:31.990 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-12-02T03:06:32.162 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:32.166 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:32.166 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:32.338 INFO:teuthology.orchestra.run.smithi001.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:32.341 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/290 2023-12-02T03:06:32.341 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/290 2023-12-02T03:06:32.341 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:32.344 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:32.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:32.353 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-12-02T03:06:32.528 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:32.532 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:32.532 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:32.876 INFO:teuthology.orchestra.run.smithi001.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:32.880 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/291 2023-12-02T03:06:32.880 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/291 2023-12-02T03:06:32.880 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:32.882 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:32.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:32.892 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-12-02T03:06:33.066 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:33.070 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:33.070 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:33.387 INFO:teuthology.orchestra.run.smithi001.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:33.390 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/292 2023-12-02T03:06:33.390 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/292 2023-12-02T03:06:33.390 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:33.393 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:33.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:33.402 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-12-02T03:06:33.575 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:33.578 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:33.579 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:33.911 INFO:teuthology.orchestra.run.smithi001.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:33.915 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/293 2023-12-02T03:06:33.915 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/293 2023-12-02T03:06:33.915 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:33.917 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:33.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:33.926 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-12-02T03:06:34.100 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:34.104 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:34.104 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:34.596 INFO:teuthology.orchestra.run.smithi001.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:34.600 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/294 2023-12-02T03:06:34.600 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/294 2023-12-02T03:06:34.600 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:34.602 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:34.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:34.611 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-12-02T03:06:34.786 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:34.790 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:34.790 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:35.174 INFO:teuthology.orchestra.run.smithi001.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:35.178 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/295 2023-12-02T03:06:35.178 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/295 2023-12-02T03:06:35.178 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:35.181 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:35.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:35.190 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-12-02T03:06:35.364 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:35.368 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:35.369 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:35.655 INFO:teuthology.orchestra.run.smithi001.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:35.658 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/296 2023-12-02T03:06:35.658 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/296 2023-12-02T03:06:35.658 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:35.661 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:35.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:35.670 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-12-02T03:06:35.844 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:35.848 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:35.848 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:35.980 INFO:teuthology.orchestra.run.smithi001.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:35.984 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/297 2023-12-02T03:06:35.984 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/297 2023-12-02T03:06:35.984 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:35.986 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:35.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:35.996 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-12-02T03:06:36.168 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:36.172 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:36.172 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:36.284 INFO:teuthology.orchestra.run.smithi001.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:36.287 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/298 2023-12-02T03:06:36.287 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/298 2023-12-02T03:06:36.287 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:36.290 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:36.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:36.299 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-12-02T03:06:36.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:06:36.420 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:06:36.474 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:36.478 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:36.478 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:36.590 INFO:teuthology.orchestra.run.smithi001.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:36.594 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/299 2023-12-02T03:06:36.594 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/299 2023-12-02T03:06:36.594 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:36.596 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:36.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:36.615 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-12-02T03:06:36.789 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:36.793 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:36.794 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:36.902 INFO:teuthology.orchestra.run.smithi001.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/300 2023-12-02T03:06:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/300 2023-12-02T03:06:36.905 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:36.908 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:36.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:36.917 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-12-02T03:06:37.090 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:37.094 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:37.094 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:37.209 INFO:teuthology.orchestra.run.smithi001.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:37.212 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/301 2023-12-02T03:06:37.213 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/301 2023-12-02T03:06:37.213 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:37.215 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:37.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:37.224 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-12-02T03:06:37.397 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:37.401 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:37.401 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:37.510 INFO:teuthology.orchestra.run.smithi001.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:37.514 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/302 2023-12-02T03:06:37.514 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/302 2023-12-02T03:06:37.514 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:37.517 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:37.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:37.525 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-12-02T03:06:37.698 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:37.702 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:37.702 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:37.856 INFO:teuthology.orchestra.run.smithi001.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T03:06:37.860 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/303 2023-12-02T03:06:37.860 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/303 2023-12-02T03:06:37.860 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:37.862 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:37.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:37.872 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-12-02T03:06:38.321 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:38.326 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:38.327 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:38.484 INFO:teuthology.orchestra.run.smithi001.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T03:06:38.487 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/304 2023-12-02T03:06:38.487 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/304 2023-12-02T03:06:38.487 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:38.490 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:38.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:38.499 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-12-02T03:06:38.934 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:38.938 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:38.938 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:39.053 INFO:teuthology.orchestra.run.smithi001.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:39.057 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/305 2023-12-02T03:06:39.057 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/305 2023-12-02T03:06:39.057 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:39.059 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:39.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:39.068 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-12-02T03:06:39.240 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:39.244 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:39.245 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:39.353 INFO:teuthology.orchestra.run.smithi001.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:39.356 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/306 2023-12-02T03:06:39.356 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/306 2023-12-02T03:06:39.356 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:39.359 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:39.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:39.368 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-12-02T03:06:39.541 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:39.545 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:39.545 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:39.655 INFO:teuthology.orchestra.run.smithi001.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:06:39.658 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/307 2023-12-02T03:06:39.658 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/307 2023-12-02T03:06:39.658 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:39.660 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:39.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:39.691 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-12-02T03:06:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:39.868 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:39.868 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:40.011 INFO:teuthology.orchestra.run.smithi001.stdout:generic/308 1s 2023-12-02T03:06:40.017 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/308 2023-12-02T03:06:40.017 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:40.019 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:40.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:40.028 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-12-02T03:06:40.202 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:40.206 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:40.206 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:41.394 INFO:teuthology.orchestra.run.smithi001.stdout:generic/309 1s 2023-12-02T03:06:41.400 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/309 2023-12-02T03:06:41.400 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:06:41.403 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:06:41.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:06:41.413 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-12-02T03:06:41.855 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:06:41.859 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:06:41.859 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:07:06.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:07:06.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:07:36.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:07:36.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:08:02.410 INFO:teuthology.orchestra.run.smithi001.stdout:generic/310 81s 2023-12-02T03:08:02.437 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/310 2023-12-02T03:08:02.437 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:02.443 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:02.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:02.466 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-12-02T03:08:03.136 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:03.142 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:03.142 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:04.091 INFO:teuthology.orchestra.run.smithi001.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:08:04.096 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/311 2023-12-02T03:08:04.096 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/311 2023-12-02T03:08:04.096 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:04.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:04.110 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-12-02T03:08:04.294 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:04.298 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:04.893 INFO:teuthology.orchestra.run.smithi001.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:08:04.896 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/312 2023-12-02T03:08:04.897 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/312 2023-12-02T03:08:04.897 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:04.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:04.909 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-12-02T03:08:05.082 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:05.086 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:05.086 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:07.209 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:08:07.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:08:09.865 INFO:teuthology.orchestra.run.smithi001.stdout:generic/313 4s 2023-12-02T03:08:09.878 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/313 2023-12-02T03:08:09.878 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:09.881 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:09.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:09.894 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-12-02T03:08:10.077 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:10.081 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:10.081 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:11.457 INFO:teuthology.orchestra.run.smithi001.stdout:generic/314 1s 2023-12-02T03:08:11.462 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/314 2023-12-02T03:08:11.462 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:11.464 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:11.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:11.474 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-12-02T03:08:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:11.654 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:13.231 INFO:teuthology.orchestra.run.smithi001.stdout:generic/315 2s 2023-12-02T03:08:13.238 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/315 2023-12-02T03:08:13.238 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:13.240 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:13.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:13.251 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-12-02T03:08:13.710 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:13.715 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:13.715 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:14.614 INFO:teuthology.orchestra.run.smithi001.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T03:08:14.618 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/316 2023-12-02T03:08:14.618 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/316 2023-12-02T03:08:14.618 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:14.620 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:14.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:14.629 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-12-02T03:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/317 2023-12-02T03:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/317 2023-12-02T03:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:15.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:15.239 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-12-02T03:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/318 2023-12-02T03:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/318 2023-12-02T03:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:15.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:15.544 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-12-02T03:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-02T03:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/319 2023-12-02T03:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/319 2023-12-02T03:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:15.872 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:15.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:15.881 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-12-02T03:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/320 2023-12-02T03:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/320 2023-12-02T03:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:16.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:16.184 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-12-02T03:08:16.355 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:16.359 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:16.359 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:16.479 INFO:teuthology.orchestra.run.smithi001.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:08:16.483 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/321 2023-12-02T03:08:16.483 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/321 2023-12-02T03:08:16.483 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:16.485 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:16.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:16.494 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-12-02T03:08:16.667 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:16.671 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:16.672 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:16.795 INFO:teuthology.orchestra.run.smithi001.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:08:16.798 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/322 2023-12-02T03:08:16.798 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/322 2023-12-02T03:08:16.799 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:08:16.801 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:16.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:08:16.811 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-12-02T03:08:17.000 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:08:17.004 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:08:17.004 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:08:37.598 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:08:37.601 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:09:07.668 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:09:07.671 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:09:38.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:09:38.044 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:09:38.098 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T03:09:38.096+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99160) UID: 0 2023-12-02T03:09:38.098 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T03:09:38.096+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99160) UID: 0 2023-12-02T03:09:38.099 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T03:09:38.096+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99160) UID: 0 2023-12-02T03:09:38.099 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T03:09:38.096+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99160) UID: 0 2023-12-02T03:10:17.732 INFO:teuthology.orchestra.run.smithi001.stdout:generic/323 120s 2023-12-02T03:10:17.737 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/323 2023-12-02T03:10:17.737 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:17.740 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:17.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:17.770 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-12-02T03:10:18.179 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:18.184 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:18.184 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:18.324 INFO:teuthology.orchestra.run.smithi001.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:18.328 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/324 2023-12-02T03:10:18.328 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/324 2023-12-02T03:10:18.328 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:18.330 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:18.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:18.339 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-12-02T03:10:18.515 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:18.519 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:18.519 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:18.696 INFO:teuthology.orchestra.run.smithi001.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:18.700 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/325 2023-12-02T03:10:18.700 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/325 2023-12-02T03:10:18.700 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:18.702 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:18.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:18.711 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-12-02T03:10:18.885 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:18.890 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:18.890 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.002 INFO:teuthology.orchestra.run.smithi001.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:19.005 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/326 2023-12-02T03:10:19.005 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/326 2023-12-02T03:10:19.006 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:19.008 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:19.017 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-12-02T03:10:19.192 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:19.196 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:19.196 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.307 INFO:teuthology.orchestra.run.smithi001.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:19.311 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/327 2023-12-02T03:10:19.311 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/327 2023-12-02T03:10:19.311 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:19.313 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:19.322 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-12-02T03:10:19.501 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:19.505 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:19.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.628 INFO:teuthology.orchestra.run.smithi001.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:19.632 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/328 2023-12-02T03:10:19.632 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/328 2023-12-02T03:10:19.632 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:19.634 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:19.644 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-12-02T03:10:19.819 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:19.823 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:19.823 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.956 INFO:teuthology.orchestra.run.smithi001.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:19.960 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/329 2023-12-02T03:10:19.960 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/329 2023-12-02T03:10:19.960 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:19.962 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:19.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:19.971 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-12-02T03:10:20.148 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:20.152 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:20.152 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:20.275 INFO:teuthology.orchestra.run.smithi001.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:20.279 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/330 2023-12-02T03:10:20.279 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/330 2023-12-02T03:10:20.279 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:20.281 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:20.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:20.290 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-12-02T03:10:20.465 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:20.470 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:20.470 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:20.590 INFO:teuthology.orchestra.run.smithi001.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:20.593 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/331 2023-12-02T03:10:20.593 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/331 2023-12-02T03:10:20.593 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:20.595 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:20.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:20.604 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-12-02T03:10:20.779 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:20.783 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:20.783 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:20.893 INFO:teuthology.orchestra.run.smithi001.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:20.897 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/332 2023-12-02T03:10:20.897 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/332 2023-12-02T03:10:20.897 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:20.899 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:20.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:20.909 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-12-02T03:10:21.086 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:21.090 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:21.090 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:21.200 INFO:teuthology.orchestra.run.smithi001.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:21.204 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/333 2023-12-02T03:10:21.204 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/333 2023-12-02T03:10:21.204 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:21.206 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:21.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:21.216 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-12-02T03:10:21.388 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:21.392 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:21.392 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:21.503 INFO:teuthology.orchestra.run.smithi001.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:21.506 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/334 2023-12-02T03:10:21.506 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/334 2023-12-02T03:10:21.506 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:21.509 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:21.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:21.518 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-12-02T03:10:21.689 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:21.694 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:21.694 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:21.813 INFO:teuthology.orchestra.run.smithi001.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:21.817 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/335 2023-12-02T03:10:21.817 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/335 2023-12-02T03:10:21.817 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:21.819 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:21.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:21.828 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-12-02T03:10:22.001 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:22.005 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:22.005 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:22.137 INFO:teuthology.orchestra.run.smithi001.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:22.141 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/336 2023-12-02T03:10:22.141 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/336 2023-12-02T03:10:22.141 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:22.143 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:22.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:22.153 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-12-02T03:10:22.325 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:22.329 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:22.329 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:22.451 INFO:teuthology.orchestra.run.smithi001.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:22.454 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/337 2023-12-02T03:10:22.454 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/337 2023-12-02T03:10:22.455 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:22.457 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:22.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:22.465 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-12-02T03:10:22.638 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:22.642 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:22.642 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:22.761 INFO:teuthology.orchestra.run.smithi001.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:22.764 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/338 2023-12-02T03:10:22.764 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/338 2023-12-02T03:10:22.764 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:22.767 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:22.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:22.776 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-12-02T03:10:22.948 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:22.952 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:22.952 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:23.062 INFO:teuthology.orchestra.run.smithi001.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:23.066 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/339 2023-12-02T03:10:23.066 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/339 2023-12-02T03:10:23.066 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:23.069 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:23.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:23.078 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-12-02T03:10:23.251 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:23.255 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:23.255 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:23.363 INFO:teuthology.orchestra.run.smithi001.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:23.367 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/340 2023-12-02T03:10:23.367 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/340 2023-12-02T03:10:23.367 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:23.369 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:23.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:23.390 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-12-02T03:10:23.562 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:23.566 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:23.566 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:23.685 INFO:teuthology.orchestra.run.smithi001.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:23.688 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/341 2023-12-02T03:10:23.688 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/341 2023-12-02T03:10:23.688 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:23.691 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:23.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:23.700 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-12-02T03:10:23.873 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:23.877 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:23.877 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:23.996 INFO:teuthology.orchestra.run.smithi001.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:24.000 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/342 2023-12-02T03:10:24.000 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/342 2023-12-02T03:10:24.000 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:24.003 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:24.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:24.012 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-12-02T03:10:24.184 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:24.188 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:24.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:24.307 INFO:teuthology.orchestra.run.smithi001.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:24.311 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/343 2023-12-02T03:10:24.311 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/343 2023-12-02T03:10:24.311 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:24.313 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:24.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:24.323 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-12-02T03:10:24.494 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:24.499 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:24.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:24.606 INFO:teuthology.orchestra.run.smithi001.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:24.610 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/344 2023-12-02T03:10:24.610 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/344 2023-12-02T03:10:24.610 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:24.612 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:24.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:24.621 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-12-02T03:10:24.795 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:24.799 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:24.799 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:24.907 INFO:teuthology.orchestra.run.smithi001.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:24.910 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/345 2023-12-02T03:10:24.910 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/345 2023-12-02T03:10:24.910 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:24.913 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:24.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:24.921 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-12-02T03:10:25.094 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:25.098 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:25.098 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:25.208 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/346 2023-12-02T03:10:25.208 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/346 2023-12-02T03:10:25.208 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:25.210 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:25.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:25.219 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-12-02T03:10:25.392 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:25.396 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:25.396 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:25.565 INFO:teuthology.orchestra.run.smithi001.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:25.568 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/347 2023-12-02T03:10:25.568 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/347 2023-12-02T03:10:25.569 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:25.571 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:25.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:25.580 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-12-02T03:10:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:25.757 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:25.757 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:25.884 INFO:teuthology.orchestra.run.smithi001.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:25.888 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/348 2023-12-02T03:10:25.888 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/348 2023-12-02T03:10:25.888 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:25.890 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:25.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:25.899 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-12-02T03:10:26.071 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:26.075 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:26.075 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:26.990 INFO:teuthology.orchestra.run.smithi001.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-02T03:10:26.993 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/349 2023-12-02T03:10:26.994 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/349 2023-12-02T03:10:26.994 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:26.996 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:27.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:27.015 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-12-02T03:10:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:27.191 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:27.191 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:28.594 INFO:teuthology.orchestra.run.smithi001.stdout:generic/350 1s 2023-12-02T03:10:28.599 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/350 2023-12-02T03:10:28.599 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:28.602 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:28.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:28.610 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-12-02T03:10:28.785 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:28.789 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:28.789 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:29.682 INFO:teuthology.orchestra.run.smithi001.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-02T03:10:29.686 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/351 2023-12-02T03:10:29.686 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/351 2023-12-02T03:10:29.686 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:29.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:29.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:29.697 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-12-02T03:10:30.131 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:30.135 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:30.135 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:30.264 INFO:teuthology.orchestra.run.smithi001.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:30.267 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/352 2023-12-02T03:10:30.267 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/352 2023-12-02T03:10:30.268 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:30.270 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:30.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:30.279 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-12-02T03:10:30.457 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:30.461 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:30.461 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:30.572 INFO:teuthology.orchestra.run.smithi001.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:30.575 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/353 2023-12-02T03:10:30.575 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/353 2023-12-02T03:10:30.575 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:30.578 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:30.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:30.586 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-12-02T03:10:30.760 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:30.764 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:30.764 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:30.877 INFO:teuthology.orchestra.run.smithi001.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:30.881 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/354 2023-12-02T03:10:30.881 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/354 2023-12-02T03:10:30.881 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:30.883 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:30.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:30.894 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-12-02T03:10:31.069 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:31.073 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:31.073 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:31.641 INFO:teuthology.orchestra.run.smithi001.stdout:generic/355 0s 2023-12-02T03:10:31.646 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/355 2023-12-02T03:10:31.646 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:31.649 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:31.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:31.658 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-12-02T03:10:32.102 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:32.107 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:32.107 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:32.242 INFO:teuthology.orchestra.run.smithi001.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:32.246 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/356 2023-12-02T03:10:32.246 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/356 2023-12-02T03:10:32.246 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:32.248 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:32.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:32.257 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-12-02T03:10:32.434 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:32.438 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:32.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:32.549 INFO:teuthology.orchestra.run.smithi001.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:32.552 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/357 2023-12-02T03:10:32.552 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/357 2023-12-02T03:10:32.552 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:32.555 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:32.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:32.573 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-12-02T03:10:32.747 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:32.752 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:32.752 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:32.861 INFO:teuthology.orchestra.run.smithi001.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:32.865 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/358 2023-12-02T03:10:32.865 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/358 2023-12-02T03:10:32.865 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:32.867 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:32.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:32.877 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-12-02T03:10:33.051 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:33.055 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:33.055 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:33.166 INFO:teuthology.orchestra.run.smithi001.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:33.170 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/359 2023-12-02T03:10:33.170 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/359 2023-12-02T03:10:33.170 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:33.172 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:33.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:33.181 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-12-02T03:10:33.353 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:33.358 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:33.358 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:33.517 INFO:teuthology.orchestra.run.smithi001.stdout:generic/360 0s 2023-12-02T03:10:33.522 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/360 2023-12-02T03:10:33.522 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:33.525 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:33.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:33.534 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-12-02T03:10:33.706 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:33.710 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:33.710 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:33.836 INFO:teuthology.orchestra.run.smithi001.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:33.839 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/361 2023-12-02T03:10:33.839 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/361 2023-12-02T03:10:33.839 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:33.842 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:33.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:33.851 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-12-02T03:10:34.026 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:34.030 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:34.030 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:34.138 INFO:teuthology.orchestra.run.smithi001.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:34.141 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/362 2023-12-02T03:10:34.141 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/362 2023-12-02T03:10:34.141 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:34.144 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:34.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:34.162 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-12-02T03:10:34.334 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:34.338 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:34.338 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:34.451 INFO:teuthology.orchestra.run.smithi001.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:34.455 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/363 2023-12-02T03:10:34.455 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/363 2023-12-02T03:10:34.456 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:34.458 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:34.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:34.466 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-12-02T03:10:34.639 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:34.644 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:34.644 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:34.753 INFO:teuthology.orchestra.run.smithi001.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:34.756 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/364 2023-12-02T03:10:34.756 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/364 2023-12-02T03:10:34.756 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:34.759 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:34.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:34.768 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-12-02T03:10:34.941 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:34.946 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:34.946 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.053 INFO:teuthology.orchestra.run.smithi001.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:35.057 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/365 2023-12-02T03:10:35.057 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/365 2023-12-02T03:10:35.057 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:35.059 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:35.068 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-12-02T03:10:35.240 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:35.244 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:35.244 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.351 INFO:teuthology.orchestra.run.smithi001.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:35.355 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/366 2023-12-02T03:10:35.355 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/366 2023-12-02T03:10:35.355 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:35.357 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:35.366 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-12-02T03:10:35.538 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:35.542 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:35.543 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.650 INFO:teuthology.orchestra.run.smithi001.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:35.654 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/367 2023-12-02T03:10:35.654 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/367 2023-12-02T03:10:35.654 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:35.657 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:35.676 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-12-02T03:10:35.849 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:35.853 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:35.853 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.965 INFO:teuthology.orchestra.run.smithi001.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:35.969 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/368 2023-12-02T03:10:35.969 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/368 2023-12-02T03:10:35.969 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:35.971 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:35.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:35.981 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-12-02T03:10:36.154 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:36.158 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:36.158 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:36.266 INFO:teuthology.orchestra.run.smithi001.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:36.269 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/369 2023-12-02T03:10:36.269 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/369 2023-12-02T03:10:36.269 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:36.271 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:36.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:36.280 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-12-02T03:10:36.452 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:36.456 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:36.456 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:36.564 INFO:teuthology.orchestra.run.smithi001.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:36.568 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/370 2023-12-02T03:10:36.568 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/370 2023-12-02T03:10:36.568 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:36.570 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:36.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:36.579 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-12-02T03:10:36.752 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:36.756 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:36.756 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:36.878 INFO:teuthology.orchestra.run.smithi001.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:36.882 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/371 2023-12-02T03:10:36.882 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/371 2023-12-02T03:10:36.882 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:36.884 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:36.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:36.894 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-12-02T03:10:37.066 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:37.070 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:37.070 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:37.180 INFO:teuthology.orchestra.run.smithi001.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:37.183 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/372 2023-12-02T03:10:37.184 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/372 2023-12-02T03:10:37.184 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:37.186 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:37.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:37.195 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-12-02T03:10:37.366 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:37.370 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:37.371 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:37.530 INFO:teuthology.orchestra.run.smithi001.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:37.534 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/373 2023-12-02T03:10:37.534 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/373 2023-12-02T03:10:37.535 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:37.537 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:37.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:37.545 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-12-02T03:10:37.718 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:37.722 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:37.722 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:37.863 INFO:teuthology.orchestra.run.smithi001.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:37.866 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/374 2023-12-02T03:10:37.866 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/374 2023-12-02T03:10:37.866 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:37.869 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:37.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:37.878 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-12-02T03:10:38.052 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:38.056 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:38.056 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:38.249 INFO:teuthology.orchestra.run.smithi001.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-02T03:10:38.253 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/375 2023-12-02T03:10:38.253 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/375 2023-12-02T03:10:38.253 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:38.255 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:38.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:38.274 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-12-02T03:10:38.447 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:38.451 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:38.451 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:38.935 INFO:teuthology.orchestra.run.smithi001.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:38.938 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/376 2023-12-02T03:10:38.938 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/376 2023-12-02T03:10:38.939 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:38.941 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:38.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:38.951 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-12-02T03:10:39.126 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:39.129 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:39.130 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:39.247 INFO:teuthology.orchestra.run.smithi001.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:39.251 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/377 2023-12-02T03:10:39.251 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/377 2023-12-02T03:10:39.251 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:39.253 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:39.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:39.279 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-12-02T03:10:39.451 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:39.456 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:39.456 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:39.662 INFO:teuthology.orchestra.run.smithi001.stdout:generic/378 0s 2023-12-02T03:10:39.667 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/378 2023-12-02T03:10:39.667 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:39.670 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:39.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:39.679 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-12-02T03:10:40.111 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:40.116 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:40.117 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:40.252 INFO:teuthology.orchestra.run.smithi001.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:40.256 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/379 2023-12-02T03:10:40.256 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/379 2023-12-02T03:10:40.256 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:40.258 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:40.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:40.278 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-12-02T03:10:40.450 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:40.454 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:40.454 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:40.565 INFO:teuthology.orchestra.run.smithi001.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:40.569 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/380 2023-12-02T03:10:40.570 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/380 2023-12-02T03:10:40.570 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:40.571 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:40.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:40.581 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-12-02T03:10:40.753 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:40.757 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:40.757 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:40.868 INFO:teuthology.orchestra.run.smithi001.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:40.871 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/381 2023-12-02T03:10:40.872 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/381 2023-12-02T03:10:40.872 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:40.874 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:40.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:40.883 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-12-02T03:10:41.056 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:41.060 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:41.061 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/382 2023-12-02T03:10:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/382 2023-12-02T03:10:41.175 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:41.177 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:41.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:41.185 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-12-02T03:10:41.358 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:41.362 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:41.362 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:41.472 INFO:teuthology.orchestra.run.smithi001.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:41.475 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/383 2023-12-02T03:10:41.475 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/383 2023-12-02T03:10:41.475 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:41.478 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:41.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:41.486 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-12-02T03:10:41.658 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:41.662 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:41.662 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:41.778 INFO:teuthology.orchestra.run.smithi001.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-02T03:10:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/384 2023-12-02T03:10:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/384 2023-12-02T03:10:41.781 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:41.784 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:41.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:41.806 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-12-02T03:10:41.979 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:41.983 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:41.983 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:42.095 INFO:teuthology.orchestra.run.smithi001.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:42.098 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/385 2023-12-02T03:10:42.098 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/385 2023-12-02T03:10:42.099 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:42.101 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:42.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:42.110 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-12-02T03:10:42.282 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:42.286 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:42.286 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:42.397 INFO:teuthology.orchestra.run.smithi001.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-02T03:10:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/386 2023-12-02T03:10:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/386 2023-12-02T03:10:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:42.403 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:42.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:42.412 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-12-02T03:10:42.586 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:42.590 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:42.590 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:42.705 INFO:teuthology.orchestra.run.smithi001.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:42.708 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/387 2023-12-02T03:10:42.708 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/387 2023-12-02T03:10:42.708 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:42.711 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:42.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:42.720 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-12-02T03:10:42.893 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:42.897 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:42.897 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:43.011 INFO:teuthology.orchestra.run.smithi001.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:43.015 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/388 2023-12-02T03:10:43.015 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/388 2023-12-02T03:10:43.015 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:43.017 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:43.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:43.027 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-12-02T03:10:43.200 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:43.205 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:43.205 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:43.322 INFO:teuthology.orchestra.run.smithi001.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-02T03:10:43.326 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/389 2023-12-02T03:10:43.326 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/389 2023-12-02T03:10:43.326 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:43.328 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:43.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:43.348 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-12-02T03:10:43.520 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:43.524 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:43.524 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:43.653 INFO:teuthology.orchestra.run.smithi001.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:10:43.656 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/390 2023-12-02T03:10:43.656 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/390 2023-12-02T03:10:43.657 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:10:43.659 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:10:43.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:10:43.667 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-12-02T03:10:43.840 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:10:43.844 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:10:43.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:04.137 INFO:teuthology.orchestra.run.smithi001.stdout:generic/391 21s 2023-12-02T03:11:04.186 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/391 2023-12-02T03:11:04.186 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:04.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:04.338 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-12-02T03:11:05.217 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:05.222 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:05.222 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:05.414 INFO:teuthology.orchestra.run.smithi001.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:05.419 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/392 2023-12-02T03:11:05.419 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/392 2023-12-02T03:11:05.419 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:05.422 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:05.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:05.436 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-12-02T03:11:05.695 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:05.700 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:05.700 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:05.873 INFO:teuthology.orchestra.run.smithi001.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:05.877 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/393 2023-12-02T03:11:05.878 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/393 2023-12-02T03:11:05.878 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:05.880 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:05.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:05.891 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-12-02T03:11:06.166 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:06.171 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:06.172 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:06.385 INFO:teuthology.orchestra.run.smithi001.stdout:generic/394 0s 2023-12-02T03:11:06.391 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/394 2023-12-02T03:11:06.391 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:06.394 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:06.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:06.404 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-12-02T03:11:06.849 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:06.855 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:06.855 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:07.043 INFO:teuthology.orchestra.run.smithi001.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:07.047 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/395 2023-12-02T03:11:07.047 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/395 2023-12-02T03:11:07.047 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:07.050 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:07.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:07.062 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-12-02T03:11:07.311 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:07.318 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:07.318 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:07.525 INFO:teuthology.orchestra.run.smithi001.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:07.531 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/396 2023-12-02T03:11:07.532 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/396 2023-12-02T03:11:07.532 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:07.534 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:07.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:07.545 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-12-02T03:11:07.800 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:07.805 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:07.805 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:08.021 INFO:teuthology.orchestra.run.smithi001.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:08.025 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/397 2023-12-02T03:11:08.025 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/397 2023-12-02T03:11:08.025 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:08.027 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:08.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:08.043 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-12-02T03:11:08.290 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:08.297 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:08.297 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:08.448 INFO:teuthology.orchestra.run.smithi001.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:08.451 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/398 2023-12-02T03:11:08.451 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/398 2023-12-02T03:11:08.451 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:08.454 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:08.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:08.463 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-12-02T03:11:08.635 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:08.639 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:08.640 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:08.774 INFO:teuthology.orchestra.run.smithi001.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:08.777 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/399 2023-12-02T03:11:08.777 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/399 2023-12-02T03:11:08.777 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:08.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:08.789 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-12-02T03:11:08.961 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:08.965 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:08.965 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.074 INFO:teuthology.orchestra.run.smithi001.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-02T03:11:09.078 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/400 2023-12-02T03:11:09.078 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/400 2023-12-02T03:11:09.078 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:09.080 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:09.089 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-12-02T03:11:09.262 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:09.266 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:09.266 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.375 INFO:teuthology.orchestra.run.smithi001.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:09.378 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/401 2023-12-02T03:11:09.379 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/401 2023-12-02T03:11:09.379 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:09.381 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:09.389 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-12-02T03:11:09.562 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:09.566 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:09.566 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.676 INFO:teuthology.orchestra.run.smithi001.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:09.679 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/402 2023-12-02T03:11:09.679 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/402 2023-12-02T03:11:09.679 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:09.682 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:09.691 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-12-02T03:11:09.867 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:09.872 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:09.872 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.980 INFO:teuthology.orchestra.run.smithi001.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:09.983 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/403 2023-12-02T03:11:09.984 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/403 2023-12-02T03:11:09.984 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:09.986 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:09.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:09.995 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-12-02T03:11:10.167 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:10.171 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:10.171 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:11.032 INFO:teuthology.orchestra.run.smithi001.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-02T03:11:11.036 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/404 2023-12-02T03:11:11.036 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/404 2023-12-02T03:11:11.036 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:11.038 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:11.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:11.087 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-12-02T03:11:11.506 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:11.511 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:11.511 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:11.681 INFO:teuthology.orchestra.run.smithi001.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:11.684 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/405 2023-12-02T03:11:11.685 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/405 2023-12-02T03:11:11.685 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:11.687 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:11.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:11.696 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-12-02T03:11:11.869 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:11.873 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:11.873 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:11.981 INFO:teuthology.orchestra.run.smithi001.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:11.985 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/406 2023-12-02T03:11:11.985 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/406 2023-12-02T03:11:11.985 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:11.987 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:12.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:12.012 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-12-02T03:11:12.184 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:12.188 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:12.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:12.347 INFO:teuthology.orchestra.run.smithi001.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T03:11:12.350 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/407 2023-12-02T03:11:12.350 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/407 2023-12-02T03:11:12.351 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:12.353 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:12.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:12.361 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-12-02T03:11:12.801 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:12.807 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:12.807 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:12.972 INFO:teuthology.orchestra.run.smithi001.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T03:11:12.976 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/408 2023-12-02T03:11:12.976 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/408 2023-12-02T03:11:12.977 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:12.979 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:12.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:12.988 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-12-02T03:11:13.414 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:13.418 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:13.418 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:13.545 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/409 2023-12-02T03:11:13.545 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/409 2023-12-02T03:11:13.546 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:13.548 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:13.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:13.567 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-12-02T03:11:13.741 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:13.745 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:13.745 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:13.858 INFO:teuthology.orchestra.run.smithi001.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:13.862 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/410 2023-12-02T03:11:13.862 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/410 2023-12-02T03:11:13.862 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:13.864 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:13.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:13.873 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-12-02T03:11:14.047 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:14.051 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:14.051 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:14.171 INFO:teuthology.orchestra.run.smithi001.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:14.174 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/411 2023-12-02T03:11:14.175 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/411 2023-12-02T03:11:14.175 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:14.177 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:14.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:14.186 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-12-02T03:11:14.359 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:14.363 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:14.363 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:14.476 INFO:teuthology.orchestra.run.smithi001.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:14.480 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/412 2023-12-02T03:11:14.480 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/412 2023-12-02T03:11:14.480 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:14.482 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:14.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:14.491 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-12-02T03:11:14.665 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:14.669 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:14.669 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:14.797 INFO:teuthology.orchestra.run.smithi001.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:14.801 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/413 2023-12-02T03:11:14.801 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/413 2023-12-02T03:11:14.801 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:14.803 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:14.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:14.812 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-12-02T03:11:14.985 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:14.989 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:15.098 INFO:teuthology.orchestra.run.smithi001.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:15.102 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/414 2023-12-02T03:11:15.102 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/414 2023-12-02T03:11:15.102 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:15.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:15.113 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-12-02T03:11:15.285 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:15.289 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:15.400 INFO:teuthology.orchestra.run.smithi001.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:15.404 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/415 2023-12-02T03:11:15.404 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/415 2023-12-02T03:11:15.404 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:15.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:15.415 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-12-02T03:11:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:15.593 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:15.703 INFO:teuthology.orchestra.run.smithi001.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:15.706 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/416 2023-12-02T03:11:15.706 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/416 2023-12-02T03:11:15.707 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:15.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:15.717 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-12-02T03:11:15.890 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:15.895 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:16.003 INFO:teuthology.orchestra.run.smithi001.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:16.007 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/417 2023-12-02T03:11:16.008 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/417 2023-12-02T03:11:16.008 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:16.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:16.019 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-12-02T03:11:16.191 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:16.195 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:16.350 INFO:teuthology.orchestra.run.smithi001.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-12-02T03:11:16.354 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/418 2023-12-02T03:11:16.354 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/418 2023-12-02T03:11:16.354 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:16.356 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:16.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:16.367 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-12-02T03:11:16.543 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:16.547 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:16.547 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:16.682 INFO:teuthology.orchestra.run.smithi001.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:16.686 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/419 2023-12-02T03:11:16.686 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/419 2023-12-02T03:11:16.686 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:16.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:16.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:16.709 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-12-02T03:11:16.881 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:16.886 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:16.886 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:17.755 INFO:teuthology.orchestra.run.smithi001.stdout:generic/420 1s 2023-12-02T03:11:17.760 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/420 2023-12-02T03:11:17.760 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:17.762 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:17.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:17.772 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-12-02T03:11:18.198 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:18.203 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:18.203 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:18.344 INFO:teuthology.orchestra.run.smithi001.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:18.347 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/421 2023-12-02T03:11:18.347 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/421 2023-12-02T03:11:18.347 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:18.350 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:18.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:18.359 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-12-02T03:11:18.533 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:18.537 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:18.538 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:18.651 INFO:teuthology.orchestra.run.smithi001.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:18.655 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/422 2023-12-02T03:11:18.655 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/422 2023-12-02T03:11:18.656 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:18.657 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:18.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:18.667 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-12-02T03:11:18.840 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:18.844 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:18.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:19.084 INFO:teuthology.orchestra.run.smithi001.stdout:generic/423 1s 2023-12-02T03:11:19.090 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/423 2023-12-02T03:11:19.090 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:19.092 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:19.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:19.101 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-12-02T03:11:19.511 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:19.517 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:19.518 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:19.682 INFO:teuthology.orchestra.run.smithi001.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-02T03:11:19.685 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/424 2023-12-02T03:11:19.685 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/424 2023-12-02T03:11:19.686 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:19.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:19.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:19.706 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-12-02T03:11:19.880 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:19.884 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:19.884 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:19.994 INFO:teuthology.orchestra.run.smithi001.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:19.997 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/425 2023-12-02T03:11:19.997 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/425 2023-12-02T03:11:19.997 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:20.000 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:20.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:20.009 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-12-02T03:11:20.182 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:20.185 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:20.186 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:51.168 INFO:teuthology.orchestra.run.smithi001.stdout:generic/426 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/426.out.bad) 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/426.out 2023-12-02 01:30:49.084043893 +0000 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/426.out.bad 2023-12-02 03:11:51.149923146 +0000 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,5 +1,430 @@ 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 426 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/426-dir -d 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000000) opened an unlinked file! 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000001) opened an unlinked file! 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000002) opened an unlinked file! 2023-12-02T03:11:51.184 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000003) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000004) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000005) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000006) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000007) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000008) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000009) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000010) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000011) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000012) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000013) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000014) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000015) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000016) opened an unlinked file! 2023-12-02T03:11:51.185 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000017) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000018) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000019) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000020) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000021) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000022) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000023) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000024) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000025) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000026) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000027) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000028) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000029) opened an unlinked file! 2023-12-02T03:11:51.186 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000030) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000031) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000032) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000033) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000034) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000035) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000036) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000037) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000038) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000039) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000040) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000041) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000042) opened an unlinked file! 2023-12-02T03:11:51.187 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000043) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000044) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000045) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000046) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000047) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000048) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000049) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000050) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000051) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000052) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000053) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000054) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000055) opened an unlinked file! 2023-12-02T03:11:51.188 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000056) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000057) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000058) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000059) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000060) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000061) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000062) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000063) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000064) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000065) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000066) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000067) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000068) opened an unlinked file! 2023-12-02T03:11:51.189 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000069) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000070) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000071) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000072) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000073) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000074) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000075) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000076) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000077) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000078) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000079) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000080) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000081) opened an unlinked file! 2023-12-02T03:11:51.190 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000082) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000083) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000084) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000085) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000086) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000087) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000088) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000089) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000090) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000091) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000092) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000093) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000094) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000095) opened an unlinked file! 2023-12-02T03:11:51.191 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000096) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000097) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000098) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000099) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000100) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000101) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000102) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000103) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000104) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000105) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000106) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000706) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000707) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000708) opened an unlinked file! 2023-12-02T03:11:51.192 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000709) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000710) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000711) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000712) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000713) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000714) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000715) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000716) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000717) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000718) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000719) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000720) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000721) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000722) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000723) opened an unlinked file! 2023-12-02T03:11:51.193 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000724) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000725) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000726) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000727) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000728) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000729) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000730) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000731) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000732) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000733) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000734) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000735) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000736) opened an unlinked file! 2023-12-02T03:11:51.194 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000737) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000738) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000739) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000740) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000741) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000742) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000743) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000744) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000745) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000746) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000747) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000748) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000749) opened an unlinked file! 2023-12-02T03:11:51.195 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000750) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000751) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000752) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000753) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000754) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000755) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000756) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000757) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000758) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000759) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000760) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000761) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000762) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000763) opened an unlinked file! 2023-12-02T03:11:51.196 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000764) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000765) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000766) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000767) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000768) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000769) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000770) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000771) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000772) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000773) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000774) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000775) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000776) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000777) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000778) opened an unlinked file! 2023-12-02T03:11:51.197 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000779) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000780) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000781) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000782) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000783) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000784) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000785) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000786) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000787) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000788) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000789) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000790) opened an unlinked file! 2023-12-02T03:11:51.198 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000791) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000792) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000793) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000794) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000795) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000796) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000797) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000798) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000799) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000800) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000801) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000802) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000803) opened an unlinked file! 2023-12-02T03:11:51.199 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000804) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000805) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000806) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000807) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000808) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000809) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000810) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000811) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000812) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000813) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000814) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000815) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000816) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000817) opened an unlinked file! 2023-12-02T03:11:51.200 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000818) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000819) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000820) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000821) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000822) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000823) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000824) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000825) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000826) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000827) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000828) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000829) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000830) opened an unlinked file! 2023-12-02T03:11:51.201 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000831) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000832) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000833) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000834) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000835) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000836) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000837) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000838) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000839) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000840) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000841) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000842) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000843) opened an unlinked file! 2023-12-02T03:11:51.202 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000844) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000845) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000846) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000847) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000848) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000849) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000850) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000851) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000852) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000853) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000854) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000855) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000856) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000857) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000858) opened an unlinked file! 2023-12-02T03:11:51.203 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000859) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000860) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000861) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000862) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000863) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000864) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000865) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000866) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000867) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000868) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000869) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000870) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000871) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000872) opened an unlinked file! 2023-12-02T03:11:51.204 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000873) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000874) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000875) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000876) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000877) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000878) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000879) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000880) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000881) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000882) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000883) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000884) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000885) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000886) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000887) opened an unlinked file! 2023-12-02T03:11:51.205 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000888) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000889) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000890) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000891) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000892) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000893) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000894) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000895) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000896) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000897) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000898) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000899) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000900) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000901) opened an unlinked file! 2023-12-02T03:11:51.206 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000902) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000903) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000904) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000905) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000906) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000907) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000908) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000909) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000910) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000911) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000912) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000913) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000914) opened an unlinked file! 2023-12-02T03:11:51.207 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000915) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000916) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000917) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000918) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000919) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000920) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000921) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000922) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000923) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000924) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000925) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000926) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000927) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000928) opened an unlinked file! 2023-12-02T03:11:51.208 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000929) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000930) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000931) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000932) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000933) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000934) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000935) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000936) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000937) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000938) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000939) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000940) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000941) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000942) opened an unlinked file! 2023-12-02T03:11:51.209 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000943) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000944) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000945) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000946) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000947) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000948) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000949) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000950) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000951) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000952) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000953) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000954) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000955) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000956) opened an unlinked file! 2023-12-02T03:11:51.210 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000957) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000958) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000959) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000960) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000961) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000962) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000963) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000964) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000965) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000966) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000967) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000968) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000969) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000970) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000971) opened an unlinked file! 2023-12-02T03:11:51.211 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000972) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000973) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000974) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000975) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000976) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000977) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000978) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000979) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000980) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000981) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000982) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000983) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000984) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000985) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000986) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000987) opened an unlinked file! 2023-12-02T03:11:51.212 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000988) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000989) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000990) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000991) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000992) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000993) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000994) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000995) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000996) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000997) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000998) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file000999) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001000) opened an unlinked file! 2023-12-02T03:11:51.213 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001001) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001002) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001003) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001004) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001005) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001006) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001007) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001008) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001009) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001010) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001011) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001012) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001013) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001014) opened an unlinked file! 2023-12-02T03:11:51.214 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001015) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001016) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001017) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001018) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001019) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001020) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001021) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001022) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/426-dir/file001023) opened an unlinked file! 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/426-dir 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/426-dir -l 2023-12-02T03:11:51.215 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/426-dir -u 2023-12-02T03:11:51.216 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/426 2023-12-02T03:11:51.216 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/426 2023-12-02T03:11:51.216 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T03:11:51.243 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:51.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T03:11:51.398 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T03:11:51.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T03:11:51.399 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-12-02T03:11:52.504 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:52.508 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:52.508 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:52.654 INFO:teuthology.orchestra.run.smithi001.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:52.657 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/427 2023-12-02T03:11:52.657 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/427 2023-12-02T03:11:52.657 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:52.660 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:52.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:52.668 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-12-02T03:11:52.852 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:52.856 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:53.020 INFO:teuthology.orchestra.run.smithi001.stdout:generic/428 1s 2023-12-02T03:11:53.025 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/428 2023-12-02T03:11:53.025 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:53.028 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:53.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:53.036 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-12-02T03:11:53.209 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:53.214 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:53.214 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:53.365 INFO:teuthology.orchestra.run.smithi001.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:53.369 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/429 2023-12-02T03:11:53.369 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/429 2023-12-02T03:11:53.369 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:53.371 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:53.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:53.380 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-12-02T03:11:53.553 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:53.557 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:53.557 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:53.851 INFO:teuthology.orchestra.run.smithi001.stdout:generic/430 0s 2023-12-02T03:11:53.855 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/430 2023-12-02T03:11:53.856 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:53.858 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:53.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:53.867 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-12-02T03:11:54.316 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:54.320 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:54.320 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:54.548 INFO:teuthology.orchestra.run.smithi001.stdout:generic/431 0s 2023-12-02T03:11:54.553 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/431 2023-12-02T03:11:54.553 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:54.556 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:54.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:54.564 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-12-02T03:11:55.004 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:55.009 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:55.010 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:55.248 INFO:teuthology.orchestra.run.smithi001.stdout:generic/432 0s 2023-12-02T03:11:55.253 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/432 2023-12-02T03:11:55.254 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:55.256 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:55.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:55.265 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-12-02T03:11:55.718 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:55.722 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:55.932 INFO:teuthology.orchestra.run.smithi001.stdout:generic/433 0s 2023-12-02T03:11:55.938 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/433 2023-12-02T03:11:55.938 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:55.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:55.949 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-12-02T03:11:56.370 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:56.375 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:56.584 INFO:teuthology.orchestra.run.smithi001.stdout:generic/434 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/434.out.bad) 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/434.out 2023-12-02 01:30:49.084043893 +0000 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/434.out.bad 2023-12-02 03:11:56.581854485 +0000 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -9,6 +9,6 @@ 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: copy_range: Bad file descriptor 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: Try to copy to a device 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: -copy_range: Invalid argument 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: +/tmp/tmp.iMk1cH1heVtest/test-434/dev1: Permission denied 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: Try to copy to a fifo 2023-12-02T03:11:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: copy_range: Invalid argument 2023-12-02T03:11:56.588 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/434 2023-12-02T03:11:56.588 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/434 2023-12-02T03:11:56.588 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T03:11:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:56.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T03:11:56.600 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T03:11:56.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T03:11:56.600 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-12-02T03:11:57.051 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:57.055 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:57.056 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:57.191 INFO:teuthology.orchestra.run.smithi001.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:11:57.195 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/435 2023-12-02T03:11:57.195 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/435 2023-12-02T03:11:57.195 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:57.197 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:57.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:57.207 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-12-02T03:11:57.378 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:57.381 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:57.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:58.245 INFO:teuthology.orchestra.run.smithi001.stdout:generic/436 1s 2023-12-02T03:11:58.250 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/436 2023-12-02T03:11:58.250 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:58.253 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:58.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:58.262 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-12-02T03:11:58.703 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:58.707 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:58.707 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:59.529 INFO:teuthology.orchestra.run.smithi001.stdout:generic/437 1s 2023-12-02T03:11:59.534 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/437 2023-12-02T03:11:59.534 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:11:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:11:59.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:11:59.546 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-12-02T03:11:59.718 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:11:59.722 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:11:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:12:20.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:12:20.361 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:12:50.482 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:12:50.485 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:13:02.541 INFO:teuthology.orchestra.run.smithi001.stdout:generic/438 63s 2023-12-02T03:13:02.546 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/438 2023-12-02T03:13:02.546 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:02.548 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:02.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:02.558 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-12-02T03:13:02.730 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:02.734 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:02.735 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:02.846 INFO:teuthology.orchestra.run.smithi001.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:02.850 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/439 2023-12-02T03:13:02.850 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/439 2023-12-02T03:13:02.850 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:02.853 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:02.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:02.861 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-12-02T03:13:03.033 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:03.038 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:03.038 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:03.174 INFO:teuthology.orchestra.run.smithi001.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:03.177 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/440 2023-12-02T03:13:03.177 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/440 2023-12-02T03:13:03.177 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:03.180 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:03.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:03.189 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-12-02T03:13:03.361 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:03.365 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:03.366 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:03.554 INFO:teuthology.orchestra.run.smithi001.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:03.558 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/441 2023-12-02T03:13:03.558 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/441 2023-12-02T03:13:03.558 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:03.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:03.569 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-12-02T03:13:03.740 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:03.744 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:03.878 INFO:teuthology.orchestra.run.smithi001.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:03.882 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/442 2023-12-02T03:13:03.882 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/442 2023-12-02T03:13:03.882 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:03.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:03.893 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-12-02T03:13:04.065 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:04.069 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:04.221 INFO:teuthology.orchestra.run.smithi001.stdout:generic/443 0s 2023-12-02T03:13:04.226 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/443 2023-12-02T03:13:04.226 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:04.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:04.237 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-12-02T03:13:04.411 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:04.415 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:04.583 INFO:teuthology.orchestra.run.smithi001.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-02T03:13:04.587 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/444 2023-12-02T03:13:04.587 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/444 2023-12-02T03:13:04.587 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:04.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:04.598 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-12-02T03:13:04.773 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:04.776 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:04.777 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:05.681 INFO:teuthology.orchestra.run.smithi001.stdout:generic/445 1s 2023-12-02T03:13:05.687 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/445 2023-12-02T03:13:05.687 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:05.689 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:05.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:05.698 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-12-02T03:13:06.147 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:06.151 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:06.151 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:06.261 INFO:teuthology.orchestra.run.smithi001.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:06.264 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/446 2023-12-02T03:13:06.264 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/446 2023-12-02T03:13:06.265 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:06.267 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:06.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:06.276 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-12-02T03:13:06.448 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:06.452 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:06.452 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:06.570 INFO:teuthology.orchestra.run.smithi001.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:06.573 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/447 2023-12-02T03:13:06.573 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/447 2023-12-02T03:13:06.573 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:06.575 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:06.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:06.584 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-12-02T03:13:06.761 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:06.765 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:06.765 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:07.817 INFO:teuthology.orchestra.run.smithi001.stdout:generic/448 1s 2023-12-02T03:13:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/448 2023-12-02T03:13:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:07.825 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:07.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:07.834 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-12-02T03:13:08.277 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:08.282 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:08.282 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:08.411 INFO:teuthology.orchestra.run.smithi001.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:08.414 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/449 2023-12-02T03:13:08.414 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/449 2023-12-02T03:13:08.415 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:08.417 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:08.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:08.426 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-12-02T03:13:08.599 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:08.604 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:08.604 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:09.504 INFO:teuthology.orchestra.run.smithi001.stdout:generic/450 1s 2023-12-02T03:13:09.579 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/450 2023-12-02T03:13:09.580 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:09.582 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:09.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:09.591 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-12-02T03:13:10.025 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:10.030 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:10.030 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:10.346 INFO:teuthology.orchestra.run.smithi001.stdout:generic/451 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/451.out.bad) 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/451.out 2023-12-02 01:30:49.086043866 +0000 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/451.out.bad 2023-12-02 03:13:10.343918113 +0000 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,2 +1,5 @@ 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 451 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: +get stale data from buffer read 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: +000a0000 2023-12-02T03:13:10.348 INFO:teuthology.orchestra.run.smithi001.stdout: Silence is golden 2023-12-02T03:13:10.350 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/451 2023-12-02T03:13:10.350 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/451 2023-12-02T03:13:10.350 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T03:13:10.353 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:10.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T03:13:10.383 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T03:13:10.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T03:13:10.384 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-12-02T03:13:10.806 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:10.811 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:10.811 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:10.919 INFO:teuthology.orchestra.run.smithi001.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:10.922 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/452 2023-12-02T03:13:10.923 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/452 2023-12-02T03:13:10.923 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:10.925 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:10.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:10.934 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-12-02T03:13:11.108 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:11.112 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:11.112 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:11.239 INFO:teuthology.orchestra.run.smithi001.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:11.242 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/453 2023-12-02T03:13:11.242 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/453 2023-12-02T03:13:11.243 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:11.245 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:11.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:11.254 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-12-02T03:13:11.426 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:11.430 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:11.430 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:11.541 INFO:teuthology.orchestra.run.smithi001.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:11.544 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/454 2023-12-02T03:13:11.544 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/454 2023-12-02T03:13:11.544 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:11.547 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:11.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:11.555 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-12-02T03:13:11.728 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:11.732 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:11.732 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:11.910 INFO:teuthology.orchestra.run.smithi001.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:11.914 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/455 2023-12-02T03:13:11.914 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/455 2023-12-02T03:13:11.914 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:11.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:11.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:11.934 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-12-02T03:13:12.109 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:12.113 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:12.113 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/456 2023-12-02T03:13:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/456 2023-12-02T03:13:12.248 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:12.250 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:12.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:12.261 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-12-02T03:13:12.434 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:12.438 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:12.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:12.603 INFO:teuthology.orchestra.run.smithi001.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:12.607 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/457 2023-12-02T03:13:12.607 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/457 2023-12-02T03:13:12.607 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:12.609 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:12.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:12.618 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-12-02T03:13:12.794 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:12.798 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:12.798 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:12.907 INFO:teuthology.orchestra.run.smithi001.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:12.910 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/458 2023-12-02T03:13:12.911 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/458 2023-12-02T03:13:12.911 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:12.913 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:12.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:12.922 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-12-02T03:13:13.095 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:13.099 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:13.099 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:13.338 INFO:teuthology.orchestra.run.smithi001.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:13.342 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/459 2023-12-02T03:13:13.342 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/459 2023-12-02T03:13:13.342 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:13.344 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:13.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:13.353 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-12-02T03:13:13.526 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:13.530 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:13.530 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:13.638 INFO:teuthology.orchestra.run.smithi001.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:13.642 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/460 2023-12-02T03:13:13.642 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/460 2023-12-02T03:13:13.642 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:13.644 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:13.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:13.653 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-12-02T03:13:13.825 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:13.829 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:13.830 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:13.939 INFO:teuthology.orchestra.run.smithi001.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:13.942 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/461 2023-12-02T03:13:13.942 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/461 2023-12-02T03:13:13.942 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:13.945 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:13.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:13.954 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-12-02T03:13:14.128 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:14.132 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:14.133 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:14.244 INFO:teuthology.orchestra.run.smithi001.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:14.248 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/462 2023-12-02T03:13:14.248 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/462 2023-12-02T03:13:14.248 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:14.250 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:14.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:14.259 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-12-02T03:13:14.434 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:14.438 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:14.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:14.601 INFO:teuthology.orchestra.run.smithi001.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T03:13:14.605 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/463 2023-12-02T03:13:14.605 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/463 2023-12-02T03:13:14.605 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:14.607 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:14.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:14.616 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-12-02T03:13:15.065 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:15.069 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:15.180 INFO:teuthology.orchestra.run.smithi001.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:15.183 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/464 2023-12-02T03:13:15.183 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/464 2023-12-02T03:13:15.183 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:15.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:15.194 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-12-02T03:13:15.367 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:15.371 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:20.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:13:20.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:13:28.265 INFO:teuthology.orchestra.run.smithi001.stdout:generic/465 13s 2023-12-02T03:13:28.303 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/465 2023-12-02T03:13:28.307 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:28.316 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:28.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:28.328 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-12-02T03:13:28.727 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:28.733 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:28.733 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:28.844 INFO:teuthology.orchestra.run.smithi001.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:28.848 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/466 2023-12-02T03:13:28.848 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/466 2023-12-02T03:13:28.848 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:28.850 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:28.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:28.859 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-12-02T03:13:29.031 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:29.035 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:29.035 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:34.946 INFO:teuthology.orchestra.run.smithi001.stdout:generic/467 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/467.out.bad) 2023-12-02T03:13:34.953 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/467.out 2023-12-02 01:30:49.087043852 +0000 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/467.out.bad 2023-12-02 03:13:34.927603647 +0000 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,5 +1,15 @@ 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 467 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000000) opened an unlinked file! 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000001) opened an unlinked file! 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000002) opened an unlinked file! 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000003) opened an unlinked file! 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000004) opened an unlinked file! 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000005) opened an unlinked file! 2023-12-02T03:13:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000006) opened an unlinked file! 2023-12-02T03:13:34.955 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000007) opened an unlinked file! 2023-12-02T03:13:34.955 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000008) opened an unlinked file! 2023-12-02T03:13:34.955 INFO:teuthology.orchestra.run.smithi001.stdout: +open_by_handle(/tmp/tmp.iMk1cH1heVtest/467-dir/file000009) opened an unlinked file! 2023-12-02T03:13:34.955 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-12-02T03:13:34.955 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-12-02T03:13:34.955 INFO:teuthology.orchestra.run.smithi001.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-12-02T03:13:34.973 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/467 2023-12-02T03:13:34.973 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/467 2023-12-02T03:13:34.974 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T03:13:35.018 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:35.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T03:13:35.185 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T03:13:35.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T03:13:35.186 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-12-02T03:13:36.184 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:36.188 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:36.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:36.331 INFO:teuthology.orchestra.run.smithi001.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:36.335 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/468 2023-12-02T03:13:36.335 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/468 2023-12-02T03:13:36.335 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:36.337 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:36.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:36.346 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-12-02T03:13:36.519 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:36.523 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:36.524 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:38.170 INFO:teuthology.orchestra.run.smithi001.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-02T03:13:38.174 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/469 2023-12-02T03:13:38.174 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/469 2023-12-02T03:13:38.174 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:38.176 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:38.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:38.185 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-12-02T03:13:38.642 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:38.647 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:38.647 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:38.821 INFO:teuthology.orchestra.run.smithi001.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:13:38.825 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/470 2023-12-02T03:13:38.825 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/470 2023-12-02T03:13:38.825 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:13:38.827 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:38.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:13:38.836 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-12-02T03:13:39.026 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:13:39.030 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:13:39.030 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:13:50.843 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:13:50.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:14:20.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:14:20.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:14:35.000 INFO:teuthology.orchestra.run.smithi001.stdout:generic/471 55s 2023-12-02T03:14:35.011 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/471 2023-12-02T03:14:35.011 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:14:35.014 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:35.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:14:35.036 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-12-02T03:14:35.676 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:14:35.685 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:14:35.685 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:35.945 INFO:teuthology.orchestra.run.smithi001.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:14:35.955 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/472 2023-12-02T03:14:35.955 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/472 2023-12-02T03:14:35.955 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:14:35.959 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:35.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:14:35.972 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-12-02T03:14:36.521 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:14:36.530 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:14:36.531 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:36.916 INFO:teuthology.orchestra.run.smithi001.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T03:14:36.928 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/473 2023-12-02T03:14:36.928 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/473 2023-12-02T03:14:36.928 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:14:36.931 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:36.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:14:36.947 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-12-02T03:14:37.176 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:14:37.180 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:14:37.181 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:37.289 INFO:teuthology.orchestra.run.smithi001.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:14:37.293 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/474 2023-12-02T03:14:37.293 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/474 2023-12-02T03:14:37.293 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:14:37.295 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:37.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:14:37.304 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-12-02T03:14:37.476 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:14:37.480 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:14:37.480 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:37.614 INFO:teuthology.orchestra.run.smithi001.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:14:37.618 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/475 2023-12-02T03:14:37.618 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/475 2023-12-02T03:14:37.618 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:14:37.620 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:37.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:14:37.630 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-12-02T03:14:37.802 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:14:37.806 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:14:37.806 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:37.918 INFO:teuthology.orchestra.run.smithi001.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:14:37.921 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/476 2023-12-02T03:14:37.921 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/476 2023-12-02T03:14:37.921 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:14:37.923 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:37.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:14:37.933 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-12-02T03:14:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:14:38.110 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:14:38.110 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:49.150 INFO:teuthology.orchestra.run.smithi001.stdout:generic/477 11s 2023-12-02T03:14:49.214 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/477 2023-12-02T03:14:49.214 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:14:49.217 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:49.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:14:49.283 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-12-02T03:14:50.336 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:14:50.340 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:14:50.341 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:14:51.334 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:14:51.336 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:15:00.481 INFO:teuthology.orchestra.run.smithi001.stdout:generic/478 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/478.out.bad) 2023-12-02T03:15:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/478.out 2023-12-02 01:30:49.088043838 +0000 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/478.out.bad 2023-12-02 03:15:00.478495072 +0000 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -10,7 +10,7 @@ 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: get wrlck 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: -lock could be placed 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: +get wrlck 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -25,7 +25,7 @@ 2023-12-02T03:15:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: get wrlck 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: -lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: +get wrlck 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -37,7 +37,7 @@ 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: get rdlck 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: get rdlck 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: -lock could be placed 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: +get rdlck 2023-12-02T03:15:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: get rdlck 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: get rdlck 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -46,7 +46,7 @@ 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: get rdlck 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: get rdlck 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: -lock could be placed 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: +get rdlck 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: lock could be placed 2023-12-02T03:15:00.487 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/478 2023-12-02T03:15:00.487 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/478 2023-12-02T03:15:00.487 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T03:15:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:00.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T03:15:00.501 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T03:15:00.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T03:15:00.501 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-12-02T03:15:00.685 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:00.689 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:00.858 INFO:teuthology.orchestra.run.smithi001.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:00.862 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/479 2023-12-02T03:15:00.862 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/479 2023-12-02T03:15:00.862 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:00.864 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:00.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:00.884 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-12-02T03:15:01.058 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:01.062 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:01.063 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:01.185 INFO:teuthology.orchestra.run.smithi001.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:01.188 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/480 2023-12-02T03:15:01.188 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/480 2023-12-02T03:15:01.188 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:01.191 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:01.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:01.200 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-12-02T03:15:01.372 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:01.376 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:01.376 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:01.498 INFO:teuthology.orchestra.run.smithi001.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:01.501 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/481 2023-12-02T03:15:01.501 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/481 2023-12-02T03:15:01.501 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:01.504 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:01.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:01.513 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-12-02T03:15:01.687 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:01.691 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:01.691 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:01.868 INFO:teuthology.orchestra.run.smithi001.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:01.871 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/482 2023-12-02T03:15:01.871 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/482 2023-12-02T03:15:01.872 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:01.874 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:01.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:01.883 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-12-02T03:15:02.056 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:02.060 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:02.060 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:02.189 INFO:teuthology.orchestra.run.smithi001.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:02.192 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/483 2023-12-02T03:15:02.192 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/483 2023-12-02T03:15:02.192 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:02.195 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:02.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:02.204 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-12-02T03:15:02.376 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:02.382 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:02.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:02.511 INFO:teuthology.orchestra.run.smithi001.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:02.515 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/484 2023-12-02T03:15:02.515 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/484 2023-12-02T03:15:02.515 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:02.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:02.526 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-12-02T03:15:02.699 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:02.703 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:02.703 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:03.572 INFO:teuthology.orchestra.run.smithi001.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-02T03:15:03.576 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/485 2023-12-02T03:15:03.576 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/485 2023-12-02T03:15:03.577 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:03.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:03.587 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-12-02T03:15:04.034 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:04.039 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:04.182 INFO:teuthology.orchestra.run.smithi001.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:04.185 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/486 2023-12-02T03:15:04.185 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/486 2023-12-02T03:15:04.186 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:04.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:04.197 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-12-02T03:15:04.370 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:04.374 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:04.495 INFO:teuthology.orchestra.run.smithi001.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:04.499 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/487 2023-12-02T03:15:04.499 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/487 2023-12-02T03:15:04.499 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:04.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:04.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:04.511 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-12-02T03:15:04.684 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:04.688 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:04.798 INFO:teuthology.orchestra.run.smithi001.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:04.801 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/488 2023-12-02T03:15:04.802 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/488 2023-12-02T03:15:04.802 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:04.804 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:04.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:04.814 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-12-02T03:15:04.987 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:04.992 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:04.992 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:05.111 INFO:teuthology.orchestra.run.smithi001.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:05.114 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/489 2023-12-02T03:15:05.115 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/489 2023-12-02T03:15:05.115 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:05.117 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:05.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:05.126 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-12-02T03:15:05.299 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:05.303 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:05.303 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:06.276 INFO:teuthology.orchestra.run.smithi001.stdout:generic/490 1s 2023-12-02T03:15:06.281 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/490 2023-12-02T03:15:06.282 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:06.284 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:06.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:06.309 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-12-02T03:15:06.740 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:06.745 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:06.745 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:06.877 INFO:teuthology.orchestra.run.smithi001.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:06.882 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/491 2023-12-02T03:15:06.882 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/491 2023-12-02T03:15:06.882 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:06.883 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:06.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:06.893 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-12-02T03:15:07.065 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:07.069 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:07.069 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:07.182 INFO:teuthology.orchestra.run.smithi001.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:07.186 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/492 2023-12-02T03:15:07.186 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/492 2023-12-02T03:15:07.186 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:07.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:07.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:07.197 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-12-02T03:15:07.368 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:07.372 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:07.372 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:07.488 INFO:teuthology.orchestra.run.smithi001.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:07.491 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/493 2023-12-02T03:15:07.491 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/493 2023-12-02T03:15:07.491 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:07.494 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:07.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:07.515 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-12-02T03:15:07.687 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:07.691 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:07.691 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:07.801 INFO:teuthology.orchestra.run.smithi001.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:07.804 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/494 2023-12-02T03:15:07.804 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/494 2023-12-02T03:15:07.805 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:07.807 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:07.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:07.816 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-12-02T03:15:07.990 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:07.994 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:07.994 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:08.103 INFO:teuthology.orchestra.run.smithi001.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:08.106 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/495 2023-12-02T03:15:08.106 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/495 2023-12-02T03:15:08.106 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:08.109 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:08.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:08.118 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-12-02T03:15:08.290 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:08.294 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:08.295 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:08.410 INFO:teuthology.orchestra.run.smithi001.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:08.414 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/496 2023-12-02T03:15:08.414 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/496 2023-12-02T03:15:08.414 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:08.416 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:08.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:08.425 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-12-02T03:15:08.597 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:08.601 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:08.601 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:08.711 INFO:teuthology.orchestra.run.smithi001.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:08.714 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/497 2023-12-02T03:15:08.714 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/497 2023-12-02T03:15:08.714 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:08.717 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:08.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:08.725 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-12-02T03:15:08.899 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:08.903 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:08.903 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:09.026 INFO:teuthology.orchestra.run.smithi001.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:09.029 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/498 2023-12-02T03:15:09.030 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/498 2023-12-02T03:15:09.030 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:09.032 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:09.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:09.041 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-12-02T03:15:09.214 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:09.218 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:09.218 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:09.326 INFO:teuthology.orchestra.run.smithi001.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:09.330 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/499 2023-12-02T03:15:09.331 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/499 2023-12-02T03:15:09.331 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:09.332 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:09.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:09.342 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-12-02T03:15:09.515 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:09.519 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:09.519 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:09.674 INFO:teuthology.orchestra.run.smithi001.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:09.677 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/500 2023-12-02T03:15:09.677 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/500 2023-12-02T03:15:09.678 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:09.680 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:09.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:09.698 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-12-02T03:15:09.870 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:09.874 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:09.875 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:09.995 INFO:teuthology.orchestra.run.smithi001.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:09.998 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/501 2023-12-02T03:15:09.998 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/501 2023-12-02T03:15:09.999 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:10.001 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:10.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:10.010 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-12-02T03:15:10.183 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:10.187 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:10.187 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:10.305 INFO:teuthology.orchestra.run.smithi001.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:10.308 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/502 2023-12-02T03:15:10.308 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/502 2023-12-02T03:15:10.308 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:10.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:10.320 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-12-02T03:15:10.493 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:10.497 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:10.497 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:10.613 INFO:teuthology.orchestra.run.smithi001.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:10.616 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/503 2023-12-02T03:15:10.616 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/503 2023-12-02T03:15:10.616 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:10.618 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:10.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:10.642 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-12-02T03:15:10.816 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:10.820 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:10.820 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:10.974 INFO:teuthology.orchestra.run.smithi001.stdout:generic/504 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/504.out.bad) 2023-12-02T03:15:10.976 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/504.out 2023-12-02 01:30:49.090043810 +0000 2023-12-02T03:15:10.976 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/504.out.bad 2023-12-02 03:15:10.971357908 +0000 2023-12-02T03:15:10.976 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,2 +1,3 @@ 2023-12-02T03:15:10.976 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 504 2023-12-02T03:15:10.976 INFO:teuthology.orchestra.run.smithi001.stdout: +lock info not found 2023-12-02T03:15:10.976 INFO:teuthology.orchestra.run.smithi001.stdout: Silence is golden 2023-12-02T03:15:10.978 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/504 2023-12-02T03:15:10.978 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/504 2023-12-02T03:15:10.978 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T03:15:10.980 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:10.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T03:15:10.990 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T03:15:10.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T03:15:10.990 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-12-02T03:15:11.164 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:11.168 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:11.168 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:11.277 INFO:teuthology.orchestra.run.smithi001.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:11.280 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/505 2023-12-02T03:15:11.280 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/505 2023-12-02T03:15:11.280 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:11.283 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:11.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:11.291 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-12-02T03:15:11.465 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:11.469 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:11.469 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:11.582 INFO:teuthology.orchestra.run.smithi001.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:11.585 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/506 2023-12-02T03:15:11.585 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/506 2023-12-02T03:15:11.585 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:11.587 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:11.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:11.598 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-12-02T03:15:11.771 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:11.775 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:11.775 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:11.939 INFO:teuthology.orchestra.run.smithi001.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-02T03:15:11.943 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/507 2023-12-02T03:15:11.943 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/507 2023-12-02T03:15:11.943 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:11.946 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:11.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:11.955 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-12-02T03:15:12.127 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:12.131 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:12.132 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:12.244 INFO:teuthology.orchestra.run.smithi001.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-12-02T03:15:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/508 2023-12-02T03:15:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/508 2023-12-02T03:15:12.247 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:12.249 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:12.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:12.259 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-12-02T03:15:12.430 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:12.434 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:12.434 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:12.552 INFO:teuthology.orchestra.run.smithi001.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:12.556 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/509 2023-12-02T03:15:12.556 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/509 2023-12-02T03:15:12.556 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:12.558 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:12.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:12.567 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-12-02T03:15:12.741 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:12.745 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:12.745 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:12.868 INFO:teuthology.orchestra.run.smithi001.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:12.871 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/510 2023-12-02T03:15:12.872 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/510 2023-12-02T03:15:12.872 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:12.874 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:12.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:12.883 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-12-02T03:15:13.057 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:13.062 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:13.062 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:13.170 INFO:teuthology.orchestra.run.smithi001.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:13.173 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/511 2023-12-02T03:15:13.173 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/511 2023-12-02T03:15:13.173 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:13.176 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:13.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:13.198 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-12-02T03:15:13.371 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:13.375 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:13.375 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:13.495 INFO:teuthology.orchestra.run.smithi001.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:13.499 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/512 2023-12-02T03:15:13.499 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/512 2023-12-02T03:15:13.499 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:13.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:13.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:13.511 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-12-02T03:15:13.683 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:13.687 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:13.687 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:13.798 INFO:teuthology.orchestra.run.smithi001.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:13.802 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/513 2023-12-02T03:15:13.802 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/513 2023-12-02T03:15:13.803 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:13.804 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:13.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:13.814 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-12-02T03:15:13.985 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:13.989 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:13.990 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:14.100 INFO:teuthology.orchestra.run.smithi001.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:14.104 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/514 2023-12-02T03:15:14.104 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/514 2023-12-02T03:15:14.104 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:14.106 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:14.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:14.116 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-12-02T03:15:14.289 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:14.294 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:14.294 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:14.404 INFO:teuthology.orchestra.run.smithi001.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:14.407 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/515 2023-12-02T03:15:14.408 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/515 2023-12-02T03:15:14.408 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:14.410 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:14.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:14.419 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-12-02T03:15:14.592 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:14.596 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:14.596 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:14.754 INFO:teuthology.orchestra.run.smithi001.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-02T03:15:14.757 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/516 2023-12-02T03:15:14.757 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/516 2023-12-02T03:15:14.757 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:14.759 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:14.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:14.768 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-12-02T03:15:15.197 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:15.201 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:15.320 INFO:teuthology.orchestra.run.smithi001.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:15.324 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/517 2023-12-02T03:15:15.324 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/517 2023-12-02T03:15:15.324 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:15.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:15.335 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-12-02T03:15:15.507 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:15.511 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:15.625 INFO:teuthology.orchestra.run.smithi001.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:15.629 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/518 2023-12-02T03:15:15.629 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/518 2023-12-02T03:15:15.629 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:15.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:15.640 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-12-02T03:15:15.813 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:15.817 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:15.817 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:15.928 INFO:teuthology.orchestra.run.smithi001.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:15.931 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/519 2023-12-02T03:15:15.931 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/519 2023-12-02T03:15:15.931 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:15.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:15.942 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-12-02T03:15:16.115 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:16.119 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:16.243 INFO:teuthology.orchestra.run.smithi001.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T03:15:16.246 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/520 2023-12-02T03:15:16.246 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/520 2023-12-02T03:15:16.247 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T03:15:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:16.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T03:15:16.277 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-12-02T03:15:16.451 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T03:15:16.456 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T03:15:16.456 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T03:15:21.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:15:21.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:15:51.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:15:51.552 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:16:21.789 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:16:21.792 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:16:51.848 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:16:51.850 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:16:51.884 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T03:16:51.882+0000 7f9970cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 494951) UID: 0 2023-12-02T03:16:51.884 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T03:16:51.882+0000 7f56f3f48640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 494951) UID: 0 2023-12-02T03:16:51.884 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T03:16:51.882+0000 7fdc7a283640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 494951) UID: 0 2023-12-02T03:16:51.885 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T03:16:51.882+0000 7f04ddaa3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 494951) UID: 0 2023-12-02T03:19:25.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:19:25.548 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:19:55.712 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:19:55.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:20:25.999 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:20:26.002 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:20:56.089 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:20:56.092 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:21:26.147 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:21:26.150 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:21:56.203 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:21:56.206 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:22:26.309 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:22:26.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:22:56.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:22:56.652 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:23:26.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:23:26.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:23:56.776 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:23:56.779 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:24:26.915 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:24:26.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:24:57.251 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:24:57.253 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:25:27.332 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:25:27.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:25:27.377 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T03:25:27.376+0000 7f32704a2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 495210) UID: 0 2023-12-02T03:25:27.377 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T03:25:27.376+0000 7fbb5a4e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 495210) UID: 0 2023-12-02T03:28:07.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:28:07.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:28:37.894 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:28:37.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:29:07.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:29:07.991 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:29:38.114 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:29:38.117 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:30:08.212 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:30:08.215 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:30:38.291 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:30:38.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:31:08.391 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:31:08.394 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:31:38.464 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:31:38.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:32:08.520 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:32:08.523 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:32:38.601 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:32:38.604 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:33:08.658 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:33:08.661 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:33:08.692 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T03:33:08.691+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99794) UID: 0 2023-12-02T03:33:08.693 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T03:33:08.691+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99794) UID: 0 2023-12-02T03:33:08.693 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T03:33:08.691+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99794) UID: 0 2023-12-02T03:33:08.693 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T03:33:08.691+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99794) UID: 0 2023-12-02T03:35:27.800 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:35:27.803 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:35:57.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:35:57.883 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:36:28.020 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:36:28.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:36:58.151 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:36:58.154 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:37:28.533 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:37:28.535 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:37:58.613 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:37:58.615 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:38:28.696 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:38:28.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:38:58.758 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:38:58.761 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:39:28.831 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:39:28.834 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:39:59.087 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:39:59.089 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:40:29.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:40:29.162 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:40:59.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:40:59.503 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:41:29.741 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:41:29.743 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:41:59.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:41:59.807 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:42:29.902 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:42:29.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:43:00.015 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:43:00.017 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:43:00.048 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T03:43:00.047+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100091) UID: 0 2023-12-02T03:43:00.049 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T03:43:00.047+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100091) UID: 0 2023-12-02T03:43:00.049 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T03:43:00.047+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100091) UID: 0 2023-12-02T03:43:00.049 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T03:43:00.047+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100091) UID: 0 2023-12-02T03:45:28.127 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:45:28.130 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:45:58.190 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:45:58.192 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:46:28.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:46:28.265 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:46:58.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:46:58.322 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:47:28.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:47:28.453 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:47:58.510 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:47:58.513 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:48:28.620 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:48:28.623 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:48:58.801 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:48:58.804 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:49:28.900 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:49:28.902 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:49:58.971 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:49:58.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:50:29.212 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:50:29.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:50:59.272 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:50:59.275 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:51:29.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:51:29.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:51:59.429 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:51:59.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:52:29.610 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:52:29.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:52:59.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:52:59.695 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:53:29.755 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:53:29.758 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:53:59.813 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:53:59.816 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:54:29.870 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:54:29.873 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:54:59.944 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:54:59.946 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:55:30.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:55:30.011 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:56:00.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:56:00.453 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:56:30.514 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:56:30.516 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:57:00.578 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:57:00.581 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:57:30.903 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:57:30.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:58:00.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:58:00.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:58:31.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:58:31.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:59:01.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:59:01.133 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:59:31.260 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T03:59:31.264 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:00:01.318 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:00:01.321 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:00:31.384 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:00:31.387 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:01:01.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:01:01.443 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:01:31.497 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:01:31.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:02:01.558 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:02:01.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:02:09.748 INFO:teuthology.orchestra.run.smithi001.stdout:generic/521 2813s 2023-12-02T04:02:09.754 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/521 2023-12-02T04:02:09.754 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:02:09.756 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:02:09.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:02:09.765 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-12-02T04:02:10.212 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:02:10.217 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:02:10.217 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:02:31.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:02:31.649 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:03:01.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:03:01.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:03:31.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:03:31.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:04:01.981 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:04:01.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:04:32.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:04:32.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:05:02.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:05:02.215 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:05:32.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:05:32.360 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:06:02.427 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:06:02.430 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:06:32.494 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:06:32.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:07:02.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:07:02.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:07:32.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:07:32.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:08:02.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:08:02.684 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:08:32.843 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:08:32.846 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:08:32.876 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T04:08:32.875+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100969) UID: 0 2023-12-02T04:08:32.888 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T04:08:32.875+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100969) UID: 0 2023-12-02T04:08:32.889 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T04:08:32.875+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100969) UID: 0 2023-12-02T04:08:32.889 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T04:08:32.875+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100969) UID: 0 2023-12-02T04:10:57.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:10:57.086 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:11:27.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:11:27.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:11:57.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:11:57.437 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:12:27.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:12:27.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:12:57.736 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:12:57.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:13:27.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:13:27.801 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:13:57.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:13:57.959 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:14:28.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:14:28.025 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:14:58.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:14:58.114 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:15:28.192 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:15:28.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:15:58.313 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:15:58.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:16:28.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:16:28.447 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:16:58.745 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:16:58.748 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:17:28.811 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:17:28.814 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:17:58.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:17:58.892 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:18:29.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:18:29.012 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:18:59.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:18:59.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:19:29.247 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:19:29.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:19:59.312 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:19:59.315 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:20:29.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:20:29.412 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:20:59.474 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:20:59.477 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:21:29.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:21:29.809 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:21:59.863 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:21:59.865 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:22:29.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:22:29.961 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:23:00.331 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:23:00.334 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:23:30.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:23:30.395 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:24:00.485 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:24:00.487 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:24:30.549 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:24:30.552 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:25:00.672 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:25:00.674 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:25:30.785 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:25:30.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:25:30.864 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T04:25:30.863+0000 7f32704a2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 497612) UID: 0 2023-12-02T04:25:30.864 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T04:25:30.863+0000 7fbb5a4e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 497612) UID: 0 2023-12-02T04:28:12.740 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:28:12.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:28:42.811 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:28:42.814 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:29:12.868 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:29:12.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:29:42.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:29:42.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:30:13.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:30:13.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:30:43.067 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:30:43.070 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:31:13.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:31:13.133 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:31:43.205 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:31:43.208 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:32:13.310 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:32:13.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:32:13.347 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T04:32:13.346+0000 7f9970cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497784) UID: 0 2023-12-02T04:32:13.348 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T04:32:13.346+0000 7f04ddaa3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497784) UID: 0 2023-12-02T04:32:13.348 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T04:32:13.346+0000 7fdc7a283640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497784) UID: 0 2023-12-02T04:32:13.348 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T04:32:13.346+0000 7f56f3f48640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497784) UID: 0 2023-12-02T04:33:47.345 INFO:teuthology.orchestra.run.smithi001.stdout:generic/522 1897s 2023-12-02T04:33:47.387 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/522 2023-12-02T04:33:47.388 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:47.397 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:47.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:47.418 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-12-02T04:33:47.872 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:47.876 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:48.066 INFO:teuthology.orchestra.run.smithi001.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/523 2023-12-02T04:33:48.069 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/523 2023-12-02T04:33:48.070 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:48.071 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:48.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:48.080 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-12-02T04:33:48.258 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:48.262 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:48.380 INFO:teuthology.orchestra.run.smithi001.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:48.383 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/524 2023-12-02T04:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/524 2023-12-02T04:33:48.384 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:48.386 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:48.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:48.395 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-12-02T04:33:48.572 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:48.577 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:48.689 INFO:teuthology.orchestra.run.smithi001.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/525 2023-12-02T04:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/525 2023-12-02T04:33:48.693 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:48.695 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:48.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:48.704 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-12-02T04:33:48.880 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:48.884 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:49.052 INFO:teuthology.orchestra.run.smithi001.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:49.056 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/526 2023-12-02T04:33:49.056 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/526 2023-12-02T04:33:49.056 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:49.058 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:49.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:49.067 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-12-02T04:33:49.244 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:49.248 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:49.248 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:49.375 INFO:teuthology.orchestra.run.smithi001.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:49.379 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/527 2023-12-02T04:33:49.379 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/527 2023-12-02T04:33:49.379 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:49.381 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:49.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:49.390 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-12-02T04:33:49.565 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:49.569 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:49.569 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:49.717 INFO:teuthology.orchestra.run.smithi001.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-12-02T04:33:49.718 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/528 2023-12-02T04:33:49.719 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/528 2023-12-02T04:33:49.719 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:49.721 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:49.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:49.730 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-12-02T04:33:49.908 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:49.912 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:49.912 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:50.075 INFO:teuthology.orchestra.run.smithi001.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-02T04:33:50.078 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/529 2023-12-02T04:33:50.078 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/529 2023-12-02T04:33:50.079 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:50.081 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:50.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:50.090 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-12-02T04:33:50.271 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:50.273 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:50.273 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:50.405 INFO:teuthology.orchestra.run.smithi001.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:50.408 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/530 2023-12-02T04:33:50.409 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/530 2023-12-02T04:33:50.409 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:50.411 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:50.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:50.420 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-12-02T04:33:50.605 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:50.609 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:50.609 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:50.720 INFO:teuthology.orchestra.run.smithi001.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:50.724 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/531 2023-12-02T04:33:50.724 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/531 2023-12-02T04:33:50.724 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:50.726 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:50.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:50.736 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-12-02T04:33:50.913 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:50.918 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:50.918 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:51.065 INFO:teuthology.orchestra.run.smithi001.stdout:generic/532 1s 2023-12-02T04:33:51.071 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/532 2023-12-02T04:33:51.071 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:51.073 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:51.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:51.082 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-12-02T04:33:51.260 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:51.264 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:51.264 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:51.644 INFO:teuthology.orchestra.run.smithi001.stdout:generic/533 0s 2023-12-02T04:33:51.650 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/533 2023-12-02T04:33:51.650 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:51.652 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:51.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:51.661 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-12-02T04:33:51.837 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:51.841 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:51.841 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:51.972 INFO:teuthology.orchestra.run.smithi001.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:51.975 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/534 2023-12-02T04:33:51.975 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/534 2023-12-02T04:33:51.976 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:51.978 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:51.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:51.987 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-12-02T04:33:52.180 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:52.184 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:52.184 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:52.306 INFO:teuthology.orchestra.run.smithi001.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:52.310 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/535 2023-12-02T04:33:52.310 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/535 2023-12-02T04:33:52.310 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:52.313 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:52.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:52.333 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-12-02T04:33:52.509 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:52.514 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:52.514 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:52.624 INFO:teuthology.orchestra.run.smithi001.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:52.627 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/536 2023-12-02T04:33:52.628 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/536 2023-12-02T04:33:52.628 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:52.630 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:52.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:52.639 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-12-02T04:33:52.816 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:52.820 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:52.820 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:52.933 INFO:teuthology.orchestra.run.smithi001.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T04:33:52.937 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/537 2023-12-02T04:33:52.937 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/537 2023-12-02T04:33:52.937 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T04:33:52.939 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:33:52.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T04:33:52.948 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-12-02T04:33:53.123 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T04:33:53.127 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T04:33:53.127 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T04:34:47.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:34:47.383 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:35:17.460 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:35:17.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:35:47.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:35:47.622 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:36:17.739 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:36:17.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:36:48.070 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:36:48.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:37:18.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:37:18.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:37:48.239 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:37:48.242 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:38:18.387 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:38:18.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:38:48.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:38:48.454 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:39:18.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:39:18.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:39:48.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:39:48.650 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:40:18.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:40:18.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:40:48.751 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:40:48.754 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:41:18.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:41:18.902 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:41:49.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:41:49.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:42:19.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:42:19.149 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:42:49.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:42:49.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:43:19.335 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:43:19.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:43:49.400 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:43:49.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:44:19.609 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:44:19.612 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:44:49.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:44:49.695 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:45:19.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:45:19.756 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:45:50.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:45:50.188 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:46:20.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:46:20.244 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:46:50.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:46:50.358 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:47:20.428 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:47:20.431 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:47:50.567 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:47:50.570 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:48:20.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:48:20.648 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:48:50.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:48:50.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:49:20.869 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:49:20.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:49:50.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:49:50.937 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:50:21.081 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:50:21.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:50:51.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:50:51.206 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:51:21.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:51:21.289 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:51:51.471 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:51:51.473 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:52:21.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:52:21.545 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:52:21.580 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T04:52:21.579+0000 7f9970cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508481) UID: 0 2023-12-02T04:52:21.580 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T04:52:21.579+0000 7f56f3f48640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508481) UID: 0 2023-12-02T04:52:21.580 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T04:52:21.579+0000 7f04ddaa3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508481) UID: 0 2023-12-02T04:52:21.580 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T04:52:21.579+0000 7fdc7a283640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508481) UID: 0 2023-12-02T04:54:54.560 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:54:54.563 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:54:54.690 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T04:54:54.689+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102380) UID: 0 2023-12-02T04:54:54.690 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T04:54:54.689+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102380) UID: 0 2023-12-02T04:54:54.691 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T04:54:54.689+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102380) UID: 0 2023-12-02T04:54:54.691 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T04:54:54.689+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102380) UID: 0 2023-12-02T04:57:18.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:57:18.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:57:48.596 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:57:48.599 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:58:18.728 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:58:18.731 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:58:48.785 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:58:48.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:59:18.858 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:59:18.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:59:48.923 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T04:59:48.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:00:18.999 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:00:19.001 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:00:49.080 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:00:49.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:01:19.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:01:19.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:01:49.209 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:01:49.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:02:19.283 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:02:19.286 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:02:49.592 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:02:49.595 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:03:19.654 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:03:19.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:03:49.749 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:03:49.752 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:04:19.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:04:19.859 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:04:19.895 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T05:04:19.894+0000 7f9970cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510681) UID: 0 2023-12-02T05:04:19.896 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T05:04:19.894+0000 7f56f3f48640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510681) UID: 0 2023-12-02T05:04:19.896 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T05:04:19.894+0000 7f04ddaa3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510681) UID: 0 2023-12-02T05:04:19.896 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T05:04:19.894+0000 7fdc7a283640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510681) UID: 0 2023-12-02T05:06:51.796 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:06:51.799 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:07:21.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:07:21.942 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:07:52.028 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:07:52.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:08:22.182 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:08:22.185 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:08:52.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:08:52.250 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:09:22.309 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:09:22.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:09:52.535 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:09:52.538 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:10:22.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:10:22.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:10:52.697 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:10:52.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:11:22.754 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:11:22.757 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:11:52.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:11:52.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:12:20.996 INFO:teuthology.orchestra.run.smithi001.stdout:generic/538 2307s 2023-12-02T05:12:21.001 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/538 2023-12-02T05:12:21.001 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:21.003 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:21.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:21.014 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-12-02T05:12:21.512 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:21.517 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:21.517 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:22.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:12:22.884 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:12:23.343 INFO:teuthology.orchestra.run.smithi001.stdout:generic/539 2s 2023-12-02T05:12:23.348 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/539 2023-12-02T05:12:23.348 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:23.351 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:23.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:23.359 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-12-02T05:12:23.804 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:23.809 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:23.809 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:23.934 INFO:teuthology.orchestra.run.smithi001.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:23.937 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/540 2023-12-02T05:12:23.938 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/540 2023-12-02T05:12:23.938 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:23.940 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:23.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:23.949 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-12-02T05:12:24.135 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:24.139 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:24.139 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:24.248 INFO:teuthology.orchestra.run.smithi001.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:24.252 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/541 2023-12-02T05:12:24.252 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/541 2023-12-02T05:12:24.252 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:24.254 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:24.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:24.263 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-12-02T05:12:24.439 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:24.443 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:24.443 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:24.563 INFO:teuthology.orchestra.run.smithi001.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:24.567 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/542 2023-12-02T05:12:24.567 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/542 2023-12-02T05:12:24.567 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:24.569 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:24.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:24.578 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-12-02T05:12:24.763 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:24.863 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:24.863 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:24.879 INFO:teuthology.orchestra.run.smithi001.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:24.882 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/543 2023-12-02T05:12:24.883 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/543 2023-12-02T05:12:24.883 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:24.885 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:24.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:24.894 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-12-02T05:12:25.067 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:25.071 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:25.071 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:25.185 INFO:teuthology.orchestra.run.smithi001.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:25.188 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/544 2023-12-02T05:12:25.188 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/544 2023-12-02T05:12:25.188 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:25.191 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:25.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:25.200 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-12-02T05:12:25.379 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:25.383 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:25.383 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:25.569 INFO:teuthology.orchestra.run.smithi001.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-02T05:12:25.573 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/545 2023-12-02T05:12:25.573 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/545 2023-12-02T05:12:25.573 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:25.576 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:25.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:25.585 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-12-02T05:12:25.764 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:25.768 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:25.768 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:25.954 INFO:teuthology.orchestra.run.smithi001.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:25.957 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/546 2023-12-02T05:12:25.958 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/546 2023-12-02T05:12:25.958 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:25.960 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:25.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:25.970 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-12-02T05:12:26.147 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:26.151 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:26.152 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:26.275 INFO:teuthology.orchestra.run.smithi001.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:26.279 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/547 2023-12-02T05:12:26.279 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/547 2023-12-02T05:12:26.279 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:26.281 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:26.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:26.290 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-12-02T05:12:26.465 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:26.469 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:26.469 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:26.625 INFO:teuthology.orchestra.run.smithi001.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:26.629 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/548 2023-12-02T05:12:26.629 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/548 2023-12-02T05:12:26.629 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:26.631 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:26.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:26.640 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-12-02T05:12:26.813 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:26.817 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:26.817 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:26.959 INFO:teuthology.orchestra.run.smithi001.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:26.962 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/549 2023-12-02T05:12:26.962 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/549 2023-12-02T05:12:26.962 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:26.965 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:26.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:26.973 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-12-02T05:12:27.148 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:27.152 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:27.152 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:27.288 INFO:teuthology.orchestra.run.smithi001.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:27.292 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/550 2023-12-02T05:12:27.292 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/550 2023-12-02T05:12:27.292 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:27.294 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:27.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:27.303 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-12-02T05:12:27.476 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:27.480 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:27.480 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:27.594 INFO:teuthology.orchestra.run.smithi001.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:27.598 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/551 2023-12-02T05:12:27.598 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/551 2023-12-02T05:12:27.598 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:27.600 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:27.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:27.609 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-12-02T05:12:27.781 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:27.785 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:27.785 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:27.906 INFO:teuthology.orchestra.run.smithi001.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/552 2023-12-02T05:12:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/552 2023-12-02T05:12:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:27.912 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:27.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:27.922 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-12-02T05:12:28.094 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:28.098 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:28.098 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:28.270 INFO:teuthology.orchestra.run.smithi001.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-12-02T05:12:28.274 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/553 2023-12-02T05:12:28.274 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/553 2023-12-02T05:12:28.274 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:28.276 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:28.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:28.286 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-12-02T05:12:28.715 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:28.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:28.838 INFO:teuthology.orchestra.run.smithi001.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:28.842 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/554 2023-12-02T05:12:28.842 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/554 2023-12-02T05:12:28.842 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:28.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:28.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:28.853 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-12-02T05:12:29.026 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:29.030 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:29.030 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:29.183 INFO:teuthology.orchestra.run.smithi001.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-12-02T05:12:29.187 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/555 2023-12-02T05:12:29.187 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/555 2023-12-02T05:12:29.187 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:29.189 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:29.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:29.198 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-12-02T05:12:29.651 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:29.655 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:29.655 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:29.767 INFO:teuthology.orchestra.run.smithi001.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/556 2023-12-02T05:12:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/556 2023-12-02T05:12:29.771 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:29.773 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:29.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:29.782 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-12-02T05:12:29.954 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:29.959 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:29.959 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:30.077 INFO:teuthology.orchestra.run.smithi001.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:30.081 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/557 2023-12-02T05:12:30.081 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/557 2023-12-02T05:12:30.081 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:30.084 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:30.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:30.101 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-12-02T05:12:30.278 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:30.282 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:30.282 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:30.403 INFO:teuthology.orchestra.run.smithi001.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:30.407 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/558 2023-12-02T05:12:30.407 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/558 2023-12-02T05:12:30.407 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:30.409 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:30.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:30.418 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-12-02T05:12:30.592 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:30.595 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:30.596 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:30.705 INFO:teuthology.orchestra.run.smithi001.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:30.709 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/559 2023-12-02T05:12:30.709 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/559 2023-12-02T05:12:30.709 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:30.712 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:30.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:30.721 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-12-02T05:12:30.896 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:30.900 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:30.900 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.010 INFO:teuthology.orchestra.run.smithi001.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:31.013 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/560 2023-12-02T05:12:31.014 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/560 2023-12-02T05:12:31.014 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:31.016 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:31.024 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-12-02T05:12:31.197 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:31.201 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:31.201 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.311 INFO:teuthology.orchestra.run.smithi001.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:31.315 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/561 2023-12-02T05:12:31.315 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/561 2023-12-02T05:12:31.315 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:31.317 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:31.326 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-12-02T05:12:31.500 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:31.504 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:31.504 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.616 INFO:teuthology.orchestra.run.smithi001.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:31.620 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/562 2023-12-02T05:12:31.620 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/562 2023-12-02T05:12:31.620 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:31.622 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:31.646 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-12-02T05:12:31.818 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:31.822 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:31.823 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.978 INFO:teuthology.orchestra.run.smithi001.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:31.981 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/563 2023-12-02T05:12:31.981 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/563 2023-12-02T05:12:31.981 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:31.983 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:31.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:31.992 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-12-02T05:12:32.166 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:32.170 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:32.170 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:32.569 INFO:teuthology.orchestra.run.smithi001.stdout:generic/564 0s 2023-12-02T05:12:32.574 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/564 2023-12-02T05:12:32.574 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:32.576 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:32.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:32.586 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-12-02T05:12:33.038 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:33.042 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:33.043 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:33.161 INFO:teuthology.orchestra.run.smithi001.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:33.164 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/565 2023-12-02T05:12:33.164 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/565 2023-12-02T05:12:33.164 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:33.167 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:33.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:33.184 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-12-02T05:12:33.357 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:33.361 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:33.361 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:33.471 INFO:teuthology.orchestra.run.smithi001.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:33.475 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/566 2023-12-02T05:12:33.475 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/566 2023-12-02T05:12:33.475 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:33.477 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:33.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:33.487 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-12-02T05:12:33.660 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:33.664 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:33.664 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:33.773 INFO:teuthology.orchestra.run.smithi001.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:33.776 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/567 2023-12-02T05:12:33.776 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/567 2023-12-02T05:12:33.776 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:33.778 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:33.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:33.787 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-12-02T05:12:33.959 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:33.963 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:33.964 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:34.135 INFO:teuthology.orchestra.run.smithi001.stdout:generic/568 1s 2023-12-02T05:12:34.159 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/568 2023-12-02T05:12:34.159 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:34.171 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:34.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:34.184 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-12-02T05:12:34.576 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:34.581 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:34.581 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:34.737 INFO:teuthology.orchestra.run.smithi001.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:34.741 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/569 2023-12-02T05:12:34.741 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/569 2023-12-02T05:12:34.741 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:34.743 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:34.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:34.753 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-12-02T05:12:34.927 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:34.931 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:34.931 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:35.041 INFO:teuthology.orchestra.run.smithi001.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:35.044 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/570 2023-12-02T05:12:35.044 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/570 2023-12-02T05:12:35.044 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:35.047 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:35.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:35.055 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-12-02T05:12:35.228 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:35.232 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:35.232 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:41.495 INFO:teuthology.orchestra.run.smithi001.stdout:generic/571 6s 2023-12-02T05:12:41.502 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/571 2023-12-02T05:12:41.502 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:41.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:41.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:41.516 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-12-02T05:12:41.966 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:41.971 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:41.971 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:42.111 INFO:teuthology.orchestra.run.smithi001.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:42.115 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/572 2023-12-02T05:12:42.115 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/572 2023-12-02T05:12:42.115 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:42.117 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:42.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:42.126 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-12-02T05:12:42.299 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:42.303 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:42.303 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:42.419 INFO:teuthology.orchestra.run.smithi001.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:42.422 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/573 2023-12-02T05:12:42.422 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/573 2023-12-02T05:12:42.423 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:42.425 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:42.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:42.434 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-12-02T05:12:42.608 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:42.612 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:42.612 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:42.722 INFO:teuthology.orchestra.run.smithi001.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:42.726 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/574 2023-12-02T05:12:42.726 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/574 2023-12-02T05:12:42.726 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:42.730 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:42.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:42.738 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-12-02T05:12:42.914 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:42.918 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:42.918 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:43.028 INFO:teuthology.orchestra.run.smithi001.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:43.031 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/575 2023-12-02T05:12:43.031 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/575 2023-12-02T05:12:43.032 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:43.034 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:43.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:43.043 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-12-02T05:12:43.215 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:43.219 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:43.219 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:43.357 INFO:teuthology.orchestra.run.smithi001.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:43.360 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/576 2023-12-02T05:12:43.360 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/576 2023-12-02T05:12:43.361 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:43.363 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:43.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:43.372 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-12-02T05:12:43.545 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:43.549 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:43.549 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:43.664 INFO:teuthology.orchestra.run.smithi001.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:43.667 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/577 2023-12-02T05:12:43.667 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/577 2023-12-02T05:12:43.667 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:43.670 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:43.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:43.679 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-12-02T05:12:43.851 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:43.855 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:43.855 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:43.999 INFO:teuthology.orchestra.run.smithi001.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-02T05:12:44.003 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/578 2023-12-02T05:12:44.003 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/578 2023-12-02T05:12:44.003 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:44.005 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:44.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:44.015 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-12-02T05:12:44.189 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:44.193 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:44.193 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:44.320 INFO:teuthology.orchestra.run.smithi001.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:44.323 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/579 2023-12-02T05:12:44.323 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/579 2023-12-02T05:12:44.323 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:44.326 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:44.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:44.335 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-12-02T05:12:44.507 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:44.511 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:44.512 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:44.649 INFO:teuthology.orchestra.run.smithi001.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:44.652 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/580 2023-12-02T05:12:44.652 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/580 2023-12-02T05:12:44.652 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:44.654 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:44.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:44.664 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-12-02T05:12:44.838 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:44.842 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:44.842 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:45.409 INFO:teuthology.orchestra.run.smithi001.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:45.413 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/581 2023-12-02T05:12:45.413 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/581 2023-12-02T05:12:45.413 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:45.415 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:45.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:45.424 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-12-02T05:12:45.599 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:45.603 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:45.603 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:45.757 INFO:teuthology.orchestra.run.smithi001.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:45.760 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/582 2023-12-02T05:12:45.760 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/582 2023-12-02T05:12:45.761 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:45.763 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:45.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:45.772 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-12-02T05:12:45.946 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:45.950 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:45.950 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:46.087 INFO:teuthology.orchestra.run.smithi001.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:46.091 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/583 2023-12-02T05:12:46.091 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/583 2023-12-02T05:12:46.091 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:46.093 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:46.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:46.102 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-12-02T05:12:46.277 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:46.281 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:46.282 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:46.418 INFO:teuthology.orchestra.run.smithi001.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:46.422 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/584 2023-12-02T05:12:46.422 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/584 2023-12-02T05:12:46.422 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:46.424 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:46.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:46.433 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-12-02T05:12:46.606 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:46.610 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:46.610 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:46.720 INFO:teuthology.orchestra.run.smithi001.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:12:46.723 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/585 2023-12-02T05:12:46.724 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/585 2023-12-02T05:12:46.724 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:12:46.726 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:46.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:12:46.735 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-12-02T05:12:46.912 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:12:46.916 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:12:46.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:12:52.958 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:12:52.961 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:13:03.646 INFO:teuthology.orchestra.run.smithi001.stdout:generic/586 17s 2023-12-02T05:13:03.651 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/586 2023-12-02T05:13:03.651 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:03.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:03.664 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-12-02T05:13:04.120 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:04.124 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:04.384 INFO:teuthology.orchestra.run.smithi001.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-02T05:13:04.388 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/587 2023-12-02T05:13:04.388 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/587 2023-12-02T05:13:04.388 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:04.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:04.400 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-12-02T05:13:04.574 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:04.578 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:04.699 INFO:teuthology.orchestra.run.smithi001.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:04.702 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/588 2023-12-02T05:13:04.703 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/588 2023-12-02T05:13:04.703 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:04.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:04.715 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-12-02T05:13:04.888 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:04.892 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:05.007 INFO:teuthology.orchestra.run.smithi001.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:05.010 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/589 2023-12-02T05:13:05.010 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/589 2023-12-02T05:13:05.011 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:05.013 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:05.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:05.022 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-12-02T05:13:05.195 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:05.199 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:05.199 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:05.315 INFO:teuthology.orchestra.run.smithi001.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:05.318 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/590 2023-12-02T05:13:05.318 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/590 2023-12-02T05:13:05.319 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:05.321 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:05.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:05.330 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-12-02T05:13:05.501 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:05.505 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:05.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:generic/591 0s 2023-12-02T05:13:05.777 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/591 2023-12-02T05:13:05.777 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:05.779 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:05.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:05.788 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-12-02T05:13:06.264 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:06.268 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:06.269 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:06.421 INFO:teuthology.orchestra.run.smithi001.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:06.425 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/592 2023-12-02T05:13:06.425 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/592 2023-12-02T05:13:06.425 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:06.427 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:06.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:06.438 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-12-02T05:13:06.611 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:06.615 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:06.615 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:06.751 INFO:teuthology.orchestra.run.smithi001.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:06.755 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/593 2023-12-02T05:13:06.755 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/593 2023-12-02T05:13:06.755 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:06.757 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:06.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:06.766 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-12-02T05:13:06.940 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:06.944 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:06.944 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:07.053 INFO:teuthology.orchestra.run.smithi001.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:07.057 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/594 2023-12-02T05:13:07.057 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/594 2023-12-02T05:13:07.057 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:07.059 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:07.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:07.068 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-12-02T05:13:07.243 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:07.247 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:07.247 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:07.388 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/595 2023-12-02T05:13:07.388 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/595 2023-12-02T05:13:07.388 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:07.391 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:07.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:07.400 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-12-02T05:13:07.574 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:07.578 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:07.578 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:07.769 INFO:teuthology.orchestra.run.smithi001.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-12-02T05:13:07.773 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/596 2023-12-02T05:13:07.773 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/596 2023-12-02T05:13:07.773 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:07.775 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:07.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:07.785 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-12-02T05:13:07.975 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:07.978 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:07.979 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:08.614 INFO:teuthology.orchestra.run.smithi001.stdout:generic/597 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/597.out.bad) 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/597.out 2023-12-02 01:30:49.097043712 +0000 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/597.out.bad 2023-12-02 05:13:08.611090078 +0000 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -4,11 +4,11 @@ 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_symlinks = 0 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: successfully followed symlink 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_symlinks = 1 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: -Permission denied 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: +successfully followed symlink 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: == Test hardlink create protection when 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: == process != target owner and process cannot read target 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_hardlinks = 0 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: -successfully created hardlink 2023-12-02T05:13:08.616 INFO:teuthology.orchestra.run.smithi001.stdout: +Permission denied 2023-12-02T05:13:08.617 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_hardlinks = 1 2023-12-02T05:13:08.617 INFO:teuthology.orchestra.run.smithi001.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-12-02T05:13:08.617 INFO:teuthology.orchestra.run.smithi001.stdout: +Permission denied 2023-12-02T05:13:08.618 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/597 2023-12-02T05:13:08.618 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/597 2023-12-02T05:13:08.618 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T05:13:08.620 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:08.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T05:13:08.630 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T05:13:08.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T05:13:08.630 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-12-02T05:13:09.150 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:09.154 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:09.155 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:09.635 INFO:teuthology.orchestra.run.smithi001.stdout:generic/598 - output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/598.out.bad) 2023-12-02T05:13:09.636 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/598.out 2023-12-02 01:30:49.097043712 +0000 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/598.out.bad 2023-12-02 05:13:09.632076615 +0000 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -5,13 +5,10 @@ 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: = only group writable dir 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_regular = 1 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: = group & world writable dir 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: -Permission denied 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: = only group writable dir 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_regular = 2 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: = group & world writable dir 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: -Permission denied 2023-12-02T05:13:09.637 INFO:teuthology.orchestra.run.smithi001.stdout: = only group writable dir 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: -Permission denied 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_fifos = 0 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -19,10 +16,7 @@ 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: = only group writable dir 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_fifos = 1 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: = group & world writable dir 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: -Permission denied 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: = only group writable dir 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: fs.protected_fifos = 2 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: = group & world writable dir 2023-12-02T05:13:09.638 INFO:teuthology.orchestra.run.smithi001.stdout: -Permission denied 2023-12-02T05:13:09.639 INFO:teuthology.orchestra.run.smithi001.stdout: = only group writable dir 2023-12-02T05:13:09.639 INFO:teuthology.orchestra.run.smithi001.stdout: -Permission denied 2023-12-02T05:13:09.639 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/598 2023-12-02T05:13:09.639 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/598 2023-12-02T05:13:09.639 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T05:13:09.641 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:09.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T05:13:09.651 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T05:13:09.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T05:13:09.651 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-12-02T05:13:10.101 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:10.106 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:10.106 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:10.228 INFO:teuthology.orchestra.run.smithi001.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:10.232 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/599 2023-12-02T05:13:10.232 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/599 2023-12-02T05:13:10.232 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:10.234 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:10.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:10.243 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-12-02T05:13:10.416 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:10.420 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:10.420 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:10.531 INFO:teuthology.orchestra.run.smithi001.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:10.535 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/600 2023-12-02T05:13:10.535 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/600 2023-12-02T05:13:10.535 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:10.537 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:10.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:10.563 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-12-02T05:13:10.737 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:10.741 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:10.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:10.870 INFO:teuthology.orchestra.run.smithi001.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:10.874 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/601 2023-12-02T05:13:10.874 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/601 2023-12-02T05:13:10.874 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:10.876 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:10.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:10.885 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-12-02T05:13:11.060 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:11.064 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:11.064 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:11.202 INFO:teuthology.orchestra.run.smithi001.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:11.205 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/602 2023-12-02T05:13:11.205 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/602 2023-12-02T05:13:11.205 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:11.208 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:11.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:11.216 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-12-02T05:13:11.390 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:11.394 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:11.394 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:11.506 INFO:teuthology.orchestra.run.smithi001.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:11.510 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/603 2023-12-02T05:13:11.510 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/603 2023-12-02T05:13:11.510 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:11.512 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:11.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:11.531 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-12-02T05:13:11.707 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:11.711 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:11.711 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:11.824 INFO:teuthology.orchestra.run.smithi001.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/604 2023-12-02T05:13:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/604 2023-12-02T05:13:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:11.830 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:11.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:11.839 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-12-02T05:13:12.017 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:12.021 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:12.021 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:12.132 INFO:teuthology.orchestra.run.smithi001.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:12.135 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/605 2023-12-02T05:13:12.135 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/605 2023-12-02T05:13:12.135 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:12.139 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:12.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:12.146 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-12-02T05:13:12.320 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:12.324 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:12.324 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:12.433 INFO:teuthology.orchestra.run.smithi001.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:12.437 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/606 2023-12-02T05:13:12.437 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/606 2023-12-02T05:13:12.437 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:12.439 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:12.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:12.450 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-12-02T05:13:12.625 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:12.629 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:12.629 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:12.738 INFO:teuthology.orchestra.run.smithi001.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:12.742 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/607 2023-12-02T05:13:12.742 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/607 2023-12-02T05:13:12.742 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:12.744 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:12.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:12.753 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-12-02T05:13:12.930 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:12.934 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:12.934 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:13.047 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/608 2023-12-02T05:13:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/608 2023-12-02T05:13:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:13.050 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:13.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:13.070 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-12-02T05:13:13.247 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:13.251 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:13.251 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:13.629 INFO:teuthology.orchestra.run.smithi001.stdout:generic/609 0s 2023-12-02T05:13:13.634 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/609 2023-12-02T05:13:13.634 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:13.637 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:13.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:13.645 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-12-02T05:13:14.096 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:14.101 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:14.101 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:14.223 INFO:teuthology.orchestra.run.smithi001.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:14.227 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/610 2023-12-02T05:13:14.227 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/610 2023-12-02T05:13:14.227 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:14.229 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:14.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:14.239 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-12-02T05:13:14.414 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:14.418 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:14.418 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:14.529 INFO:teuthology.orchestra.run.smithi001.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:14.532 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/611 2023-12-02T05:13:14.533 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/611 2023-12-02T05:13:14.533 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:14.535 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:14.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:14.544 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-12-02T05:13:14.716 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:14.720 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:14.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:14.881 INFO:teuthology.orchestra.run.smithi001.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T05:13:14.884 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/612 2023-12-02T05:13:14.884 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/612 2023-12-02T05:13:14.885 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:14.887 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:14.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:14.896 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-12-02T05:13:15.345 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:15.350 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:15.495 INFO:teuthology.orchestra.run.smithi001.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:15.498 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/613 2023-12-02T05:13:15.498 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/613 2023-12-02T05:13:15.498 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:15.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:15.509 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-12-02T05:13:15.682 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:15.686 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:15.796 INFO:teuthology.orchestra.run.smithi001.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:15.799 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/614 2023-12-02T05:13:15.799 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/614 2023-12-02T05:13:15.799 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:15.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:15.810 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-12-02T05:13:15.983 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:15.988 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:16.097 INFO:teuthology.orchestra.run.smithi001.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:16.100 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/615 2023-12-02T05:13:16.100 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/615 2023-12-02T05:13:16.100 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:16.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:16.112 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-12-02T05:13:16.287 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:16.291 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:16.404 INFO:teuthology.orchestra.run.smithi001.stdout:generic/616 [not run] kernel does not support IO_URING 2023-12-02T05:13:16.408 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/616 2023-12-02T05:13:16.408 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/616 2023-12-02T05:13:16.408 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:16.410 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:16.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:16.419 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-12-02T05:13:16.592 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:16.597 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:16.597 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:16.753 INFO:teuthology.orchestra.run.smithi001.stdout:generic/617 [not run] kernel does not support IO_URING 2023-12-02T05:13:16.756 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/617 2023-12-02T05:13:16.756 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/617 2023-12-02T05:13:16.756 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:16.759 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:16.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:16.776 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-12-02T05:13:16.949 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:16.953 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:16.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:17.064 INFO:teuthology.orchestra.run.smithi001.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:17.067 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/618 2023-12-02T05:13:17.067 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/618 2023-12-02T05:13:17.067 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:17.070 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:17.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:17.079 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-12-02T05:13:17.254 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:17.258 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:17.258 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:17.367 INFO:teuthology.orchestra.run.smithi001.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:17.371 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/619 2023-12-02T05:13:17.371 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/619 2023-12-02T05:13:17.371 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:17.373 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:17.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:17.382 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-12-02T05:13:17.557 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:17.561 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:17.561 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:17.709 INFO:teuthology.orchestra.run.smithi001.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:17.713 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/620 2023-12-02T05:13:17.713 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/620 2023-12-02T05:13:17.713 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:17.715 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:17.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:17.731 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-12-02T05:13:17.906 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:17.910 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.049 INFO:teuthology.orchestra.run.smithi001.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:18.052 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/621 2023-12-02T05:13:18.052 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/621 2023-12-02T05:13:18.052 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:18.055 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:18.063 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-12-02T05:13:18.240 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:18.243 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:18.243 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.354 INFO:teuthology.orchestra.run.smithi001.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:18.357 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/622 2023-12-02T05:13:18.357 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/622 2023-12-02T05:13:18.358 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:18.360 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:18.368 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-12-02T05:13:18.545 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:18.549 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:18.549 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.662 INFO:teuthology.orchestra.run.smithi001.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:18.665 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/623 2023-12-02T05:13:18.665 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/623 2023-12-02T05:13:18.665 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:18.668 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:18.676 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-12-02T05:13:18.851 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:18.855 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:18.855 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.968 INFO:teuthology.orchestra.run.smithi001.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:18.972 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/624 2023-12-02T05:13:18.972 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/624 2023-12-02T05:13:18.972 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:18.974 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:18.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:18.983 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-12-02T05:13:19.157 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:19.161 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:19.161 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:19.271 INFO:teuthology.orchestra.run.smithi001.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:19.274 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/625 2023-12-02T05:13:19.274 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/625 2023-12-02T05:13:19.275 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:19.277 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:19.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:19.296 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-12-02T05:13:19.471 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:19.475 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:19.475 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:19.587 INFO:teuthology.orchestra.run.smithi001.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:19.591 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/626 2023-12-02T05:13:19.591 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/626 2023-12-02T05:13:19.591 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:19.593 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:19.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:19.602 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-12-02T05:13:19.776 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:19.781 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:19.781 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:19.897 INFO:teuthology.orchestra.run.smithi001.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:19.901 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/627 2023-12-02T05:13:19.901 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/627 2023-12-02T05:13:19.901 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:19.903 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:19.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:19.911 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-12-02T05:13:20.087 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:20.091 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:20.091 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:20.298 INFO:teuthology.orchestra.run.smithi001.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:20.301 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/628 2023-12-02T05:13:20.301 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/628 2023-12-02T05:13:20.301 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:20.304 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:20.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:20.321 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-12-02T05:13:20.495 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:20.499 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:20.499 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:20.704 INFO:teuthology.orchestra.run.smithi001.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:20.707 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/629 2023-12-02T05:13:20.707 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/629 2023-12-02T05:13:20.708 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:20.710 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:20.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:20.718 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-12-02T05:13:20.894 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:20.898 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:20.898 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:21.007 INFO:teuthology.orchestra.run.smithi001.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:21.010 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/630 2023-12-02T05:13:21.011 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/630 2023-12-02T05:13:21.011 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:21.013 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:21.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:21.021 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-12-02T05:13:21.196 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:21.200 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:21.200 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:21.315 INFO:teuthology.orchestra.run.smithi001.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:21.319 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/631 2023-12-02T05:13:21.319 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/631 2023-12-02T05:13:21.319 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:21.321 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:21.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:21.339 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-12-02T05:13:21.513 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:21.517 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:21.517 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:23.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:13:23.033 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:13:24.321 INFO:teuthology.orchestra.run.smithi001.stdout:generic/632 3s 2023-12-02T05:13:24.327 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/632 2023-12-02T05:13:24.327 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:24.329 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:24.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:24.339 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-12-02T05:13:24.519 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:24.524 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:24.524 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:24.817 INFO:teuthology.orchestra.run.smithi001.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/633.out.bad) 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: --- tests/generic/633.out 2023-12-02 01:30:49.100043671 +0000 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: +++ /tmp/tmp.q8QLSYR2gwxfstests-dev/results//generic/633.out.bad 2023-12-02 05:13:24.815876393 +0000 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: @@ -1,2 +1,5 @@ 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: QA output created by 633 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: Silence is golden 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2023-12-02T05:13:24.840 INFO:teuthology.orchestra.run.smithi001.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2023-12-02T05:13:24.848 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/633 2023-12-02T05:13:24.849 INFO:teuthology.orchestra.run.smithi001.stdout:Failures: generic/633 2023-12-02T05:13:24.849 INFO:teuthology.orchestra.run.smithi001.stdout:Failed 1 of 1 tests 2023-12-02T05:13:24.855 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:24.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T05:13:24.876 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-02T05:13:24.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-02T05:13:24.876 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-12-02T05:13:25.256 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:25.261 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:25.262 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:25.379 INFO:teuthology.orchestra.run.smithi001.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:25.383 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/634 2023-12-02T05:13:25.383 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/634 2023-12-02T05:13:25.383 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:25.385 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:25.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:25.411 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-12-02T05:13:25.583 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:25.587 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:25.587 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:25.695 INFO:teuthology.orchestra.run.smithi001.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:25.699 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/635 2023-12-02T05:13:25.699 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/635 2023-12-02T05:13:25.699 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:25.701 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:25.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:25.709 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-12-02T05:13:25.884 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:25.888 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:25.888 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:25.997 INFO:teuthology.orchestra.run.smithi001.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:26.001 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/636 2023-12-02T05:13:26.001 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/636 2023-12-02T05:13:26.001 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:26.003 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:26.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:26.012 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-12-02T05:13:26.185 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:26.188 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:26.189 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:27.197 INFO:teuthology.orchestra.run.smithi001.stdout:generic/637 1s 2023-12-02T05:13:27.202 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/637 2023-12-02T05:13:27.202 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:27.205 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:27.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:27.214 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-12-02T05:13:27.738 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:27.742 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:27.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:generic/638 0s 2023-12-02T05:13:27.916 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/638 2023-12-02T05:13:27.916 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:27.918 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:27.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:27.928 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-12-02T05:13:28.101 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:28.105 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:28.105 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:30.750 INFO:teuthology.orchestra.run.smithi001.stdout:generic/639 2s 2023-12-02T05:13:30.757 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/639 2023-12-02T05:13:30.757 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:30.760 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:30.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:30.770 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-12-02T05:13:30.953 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:30.957 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:30.957 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:31.077 INFO:teuthology.orchestra.run.smithi001.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:31.081 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/640 2023-12-02T05:13:31.081 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/640 2023-12-02T05:13:31.081 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:31.083 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:31.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:31.091 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-12-02T05:13:31.266 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:31.270 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:31.270 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:31.379 INFO:teuthology.orchestra.run.smithi001.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:31.383 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/641 2023-12-02T05:13:31.383 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/641 2023-12-02T05:13:31.383 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:31.385 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:31.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:31.394 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-12-02T05:13:31.571 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:31.575 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:31.575 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:31.689 INFO:teuthology.orchestra.run.smithi001.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:31.692 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/642 2023-12-02T05:13:31.692 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/642 2023-12-02T05:13:31.692 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:31.695 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:31.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:31.704 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-12-02T05:13:31.880 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:31.884 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:31.885 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:31.995 INFO:teuthology.orchestra.run.smithi001.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:31.998 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/643 2023-12-02T05:13:31.998 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/643 2023-12-02T05:13:31.999 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:32.001 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:32.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:32.009 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-12-02T05:13:32.183 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:32.188 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:32.188 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:32.298 INFO:teuthology.orchestra.run.smithi001.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-12-02T05:13:32.301 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/644 2023-12-02T05:13:32.301 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/644 2023-12-02T05:13:32.302 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:32.304 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:32.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:32.312 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-12-02T05:13:32.485 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:32.489 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:32.489 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:32.601 INFO:teuthology.orchestra.run.smithi001.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-12-02T05:13:32.604 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/645 2023-12-02T05:13:32.604 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/645 2023-12-02T05:13:32.604 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:32.606 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:32.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:32.615 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-12-02T05:13:32.792 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:32.796 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:32.796 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:32.917 INFO:teuthology.orchestra.run.smithi001.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:32.920 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/646 2023-12-02T05:13:32.920 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/646 2023-12-02T05:13:32.920 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:32.923 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:32.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:32.931 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-12-02T05:13:33.107 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:33.111 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:33.112 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:33.391 INFO:teuthology.orchestra.run.smithi001.stdout:generic/647 0s 2023-12-02T05:13:33.396 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/647 2023-12-02T05:13:33.396 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:33.399 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:33.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:33.407 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-12-02T05:13:33.837 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:33.842 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:33.843 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-12-02T05:13:33.976 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/648 2023-12-02T05:13:33.976 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/648 2023-12-02T05:13:33.976 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:33.978 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:33.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:33.987 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-12-02T05:13:34.188 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:34.192 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:34.192 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:34.360 INFO:teuthology.orchestra.run.smithi001.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-02T05:13:34.364 INFO:teuthology.orchestra.run.smithi001.stdout:Ran: generic/649 2023-12-02T05:13:34.364 INFO:teuthology.orchestra.run.smithi001.stdout:Not run: generic/649 2023-12-02T05:13:34.364 INFO:teuthology.orchestra.run.smithi001.stdout:Passed all 1 tests 2023-12-02T05:13:34.366 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:34.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-02T05:13:34.375 DEBUG:teuthology.orchestra.run.smithi001:> (cd /tmp/tmp.q8QLSYR2gwxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-12-02T05:13:34.829 INFO:teuthology.orchestra.run.smithi001.stdout:FSTYP -- ceph-fuse 2023-12-02T05:13:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM -- Linux/x86_64 smithi001 5.14.0-388.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 21 10:17:52 UTC 2023 2023-12-02T05:13:34.834 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-02T05:13:53.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:13:53.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:14:23.313 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:14:23.318 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:14:53.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:14:53.533 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:15:23.730 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:15:23.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:15:53.889 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:15:53.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:16:24.064 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:16:24.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:16:54.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:16:54.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:17:24.633 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:17:24.638 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:17:54.774 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:17:54.782 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:18:24.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:18:24.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:18:55.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:18:55.153 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:19:25.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:19:25.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:19:56.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:19:56.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:20:26.509 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:20:26.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:20:56.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:20:56.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:21:26.972 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:21:26.976 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:21:57.117 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:21:57.123 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:22:27.325 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:22:27.330 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:22:57.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:22:57.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:22:57.599 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T05:22:57.598+0000 7fe5f5cbe640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103287) UID: 0 2023-12-02T05:22:57.599 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T05:22:57.598+0000 7f1e0ff26640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103287) UID: 0 2023-12-02T05:22:57.600 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T05:22:57.598+0000 7efe6d89c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103287) UID: 0 2023-12-02T05:22:57.600 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T05:22:57.598+0000 7f172a478640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103287) UID: 0 2023-12-02T05:25:05.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:25:05.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:25:36.124 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:25:36.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:26:06.309 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:26:06.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:26:36.572 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:26:36.576 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:27:06.712 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:27:06.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:27:36.900 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:27:36.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:28:07.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:28:07.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:28:37.303 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:28:37.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:29:07.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:29:07.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:29:37.657 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:29:37.661 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:29:45.332 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T05:29:45.331+0000 7f04d40a2640 -1 bdev(0x556f5e1b0e00 /var/lib/ceph/osd/ceph-2/block) _aio_thread got r=-5 ((5) Input/output error) 2023-12-02T05:29:45.337 INFO:tasks.ceph.osd.2.smithi001.stderr:2023-12-02T05:29:45.331+0000 7f04d30a0640 -1 bdev(0x556f5e1b1c00 /var/lib/ceph/osd/ceph-2/block) _aio_thread got r=-5 ((5) Input/output error) 2023-12-02T05:29:45.346 INFO:tasks.ceph.osd.2.smithi001.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7631-gbed76814/rpm/el9/BUILD/ceph-18.0.0-7631-gbed76814/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f04d40a2640 time 2023-12-02T05:29:45.343374+0000 2023-12-02T05:29:45.346 INFO:tasks.ceph.osd.2.smithi001.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7631-gbed76814/rpm/el9/BUILD/ceph-18.0.0-7631-gbed76814/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-02T05:29:45.346 INFO:tasks.ceph.osd.2.smithi001.stderr: ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev) 2023-12-02T05:29:45.346 INFO:tasks.ceph.osd.2.smithi001.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x556f5a646e7b] 2023-12-02T05:29:45.347 INFO:tasks.ceph.osd.2.smithi001.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x556f5af95d06] 2023-12-02T05:29:45.347 INFO:tasks.ceph.osd.2.smithi001.stderr: 3: ceph-osd(+0xd9fef1) [0x556f5af76ef1] 2023-12-02T05:29:45.347 INFO:tasks.ceph.osd.2.smithi001.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f04e169f802] 2023-12-02T05:29:45.347 INFO:tasks.ceph.osd.2.smithi001.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f04e163f450] 2023-12-02T05:29:45.347 INFO:tasks.ceph.osd.2.smithi001.stderr:*** Caught signal (Aborted) ** 2023-12-02T05:29:45.347 INFO:tasks.ceph.osd.2.smithi001.stderr: in thread 7f04d40a2640 thread_name:bstore_aio 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7631-gbed76814/rpm/el9/BUILD/ceph-18.0.0-7631-gbed76814/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f04d30a0640 time 2023-12-02T05:29:45.346984+0000 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7631-gbed76814/rpm/el9/BUILD/ceph-18.0.0-7631-gbed76814/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr: ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev) 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x556f5a646e7b] 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x556f5af95d06] 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr: 3: ceph-osd(+0xd9fef1) [0x556f5af76ef1] 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f04e169f802] 2023-12-02T05:29:45.349 INFO:tasks.ceph.osd.2.smithi001.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f04e163f450] 2023-12-02T05:29:55.485 INFO:tasks.ceph.osd.2.smithi001.stderr:daemon-helper: command crashed with signal 6 2023-12-02T05:30:02.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-02T05:30:07.877 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:30:07.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:30:09.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~7s 2023-12-02T05:30:15.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~13s 2023-12-02T05:30:22.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2023-12-02T05:30:29.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~26s 2023-12-02T05:30:35.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~33s 2023-12-02T05:30:38.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:30:38.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:30:42.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2023-12-02T05:30:48.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~46s 2023-12-02T05:30:55.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2023-12-02T05:31:02.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-12-02T05:31:08.377 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:31:08.383 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:31:08.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~66s 2023-12-02T05:31:15.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~73s 2023-12-02T05:31:22.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~79s 2023-12-02T05:31:28.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~86s 2023-12-02T05:31:35.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~93s 2023-12-02T05:31:38.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:31:38.556 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:31:41.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2023-12-02T05:31:48.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~106s 2023-12-02T05:31:55.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~112s 2023-12-02T05:32:01.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~119s 2023-12-02T05:32:08.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~126s 2023-12-02T05:32:08.731 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:32:08.737 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:32:14.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~132s 2023-12-02T05:32:21.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~139s 2023-12-02T05:32:28.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2023-12-02T05:32:34.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2023-12-02T05:32:38.870 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:32:38.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:32:41.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~159s 2023-12-02T05:32:48.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2023-12-02T05:32:54.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~172s 2023-12-02T05:33:01.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~179s 2023-12-02T05:33:07.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2023-12-02T05:33:09.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:33:09.039 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:33:14.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~192s 2023-12-02T05:33:21.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~198s 2023-12-02T05:33:27.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2023-12-02T05:33:34.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~212s 2023-12-02T05:33:39.250 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:33:39.259 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:33:40.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~218s 2023-12-02T05:33:47.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2023-12-02T05:33:54.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~231s 2023-12-02T05:34:00.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~238s 2023-12-02T05:34:07.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2023-12-02T05:34:09.615 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:34:09.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:34:13.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~251s 2023-12-02T05:34:20.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~258s 2023-12-02T05:34:27.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~264s 2023-12-02T05:34:33.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~271s 2023-12-02T05:34:39.777 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:34:39.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:34:40.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~278s 2023-12-02T05:34:47.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~284s 2023-12-02T05:34:53.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~291s 2023-12-02T05:35:00.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~298s 2023-12-02T05:35:06.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~304s 2023-12-02T05:35:06.860 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-02T05:35:06.860 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T05:35:06.861 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T05:35:06.963 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057148,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17551 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.iMk1cH1heVtest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-12-02T05:35:06.963 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi001.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-12-02T05:35:06.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T05:35:06.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T05:35:06.964 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-02T05:35:07.044 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2023-12-02T05:35:07.044 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T05:35:07.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057148,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17551 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.iMk1cH1heVtest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-12-02T05:35:07.095 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi001.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-12-02T05:35:07.095 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2023-12-02T05:35:07.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T05:35:07.096 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-02T05:35:07.145 INFO:teuthology.orchestra.run.smithi001.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-02T05:35:07.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T05:35:07.146 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T05:35:07.146 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T05:35:07.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056380,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16231 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-02T05:35:07.244 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi167.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-12-02T05:35:07.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T05:35:07.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T05:35:07.244 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-02T05:35:07.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T05:35:07.309 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-02T05:35:07.309 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-12-02T05:35:07.309 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-02T05:35:07.365 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056380,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16231 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-02T05:35:07.365 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi167.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-12-02T05:35:07.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-12-02T05:35:07.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-02T05:35:07.366 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-02T05:35:07.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-02T05:35:07.422 INFO:teuthology.orchestra.run.smithi167.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-02T05:35:09.034 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-02T05:35:09.035 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-02T05:35:09.035 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-02T05:35:09.036 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-02T05:35:09.036 INFO:tasks.ceph.osd.5:Sent signal 15 2023-12-02T05:35:09.036 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-02T05:35:09.036 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-02T05:35:09.037 INFO:tasks.ceph.mds.a:Sent signal 15 2023-12-02T05:35:09.037 INFO:tasks.ceph.mds.c:Sent signal 15 2023-12-02T05:35:09.037 INFO:tasks.ceph.mds.b:Sent signal 15 2023-12-02T05:35:09.037 INFO:tasks.ceph.mds.d:Sent signal 15 2023-12-02T05:35:09.038 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-02T05:35:09.038 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-02T05:35:09.038 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-02T05:35:09.038 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-02T05:35:09.038 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-02T05:35:09.039 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T05:35:09.035+0000 7fe5f5cbe640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 89546) UID: 0 2023-12-02T05:35:09.039 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T05:35:09.035+0000 7fe5f5cbe640 -1 osd.4 35 *** Got signal Terminated *** 2023-12-02T05:35:09.039 INFO:tasks.ceph.osd.4.smithi167.stderr:2023-12-02T05:35:09.035+0000 7fe5f5cbe640 -1 osd.4 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-02T05:35:09.040 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T05:35:09.036+0000 7f1e0ff26640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 89545) UID: 0 2023-12-02T05:35:09.040 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T05:35:09.036+0000 7f1e0ff26640 -1 osd.5 35 *** Got signal Terminated *** 2023-12-02T05:35:09.040 INFO:tasks.ceph.osd.5.smithi167.stderr:2023-12-02T05:35:09.036+0000 7f1e0ff26640 -1 osd.5 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-02T05:35:09.041 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T05:35:09.036+0000 7f172a478640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 89550) UID: 0 2023-12-02T05:35:09.041 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T05:35:09.036+0000 7f172a478640 -1 osd.6 35 *** Got signal Terminated *** 2023-12-02T05:35:09.041 INFO:tasks.ceph.osd.6.smithi167.stderr:2023-12-02T05:35:09.036+0000 7f172a478640 -1 osd.6 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-02T05:35:09.042 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T05:35:09.036+0000 7efe6d89c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 89552) UID: 0 2023-12-02T05:35:09.042 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T05:35:09.036+0000 7efe6d89c640 -1 osd.7 35 *** Got signal Terminated *** 2023-12-02T05:35:09.042 INFO:tasks.ceph.osd.7.smithi167.stderr:2023-12-02T05:35:09.036+0000 7efe6d89c640 -1 osd.7 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-02T05:35:09.042 INFO:tasks.ceph.mds.b.smithi167.stderr:2023-12-02T05:35:09.037+0000 7f57bb104640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 95956) UID: 0 2023-12-02T05:35:09.043 INFO:tasks.ceph.mds.b.smithi167.stderr:2023-12-02T05:35:09.037+0000 7f57bb104640 -1 mds.b *** got signal Terminated *** 2023-12-02T05:35:09.043 INFO:tasks.ceph.mds.d.smithi167.stderr:2023-12-02T05:35:09.037+0000 7f98cf401640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 95955) UID: 0 2023-12-02T05:35:09.043 INFO:tasks.ceph.mds.d.smithi167.stderr:2023-12-02T05:35:09.037+0000 7f98cf401640 -1 mds.d *** got signal Terminated *** 2023-12-02T05:35:09.044 INFO:tasks.ceph.mon.b.smithi167.stderr:2023-12-02T05:35:09.037+0000 7fd666422640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 88976) UID: 0 2023-12-02T05:35:09.044 INFO:tasks.ceph.mon.b.smithi167.stderr:2023-12-02T05:35:09.037+0000 7fd666422640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-02T05:35:09.044 INFO:tasks.ceph.mon.c.smithi167.stderr:2023-12-02T05:35:09.038+0000 7f75d93d8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 88979) UID: 0 2023-12-02T05:35:09.045 INFO:tasks.ceph.mon.c.smithi167.stderr:2023-12-02T05:35:09.038+0000 7f75d93d8640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-02T05:35:09.046 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T05:35:09.035+0000 7f56f3f48640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 89423) UID: 0 2023-12-02T05:35:09.046 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T05:35:09.035+0000 7f56f3f48640 -1 osd.1 35 *** Got signal Terminated *** 2023-12-02T05:35:09.047 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T05:35:09.040+0000 7f32704a2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 101178) UID: 0 2023-12-02T05:35:09.048 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T05:35:09.042+0000 7fbb5a4e4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 101179) UID: 0 2023-12-02T05:35:09.048 INFO:tasks.ceph.mds.c.smithi001.stderr:2023-12-02T05:35:09.042+0000 7fbb5a4e4640 -1 mds.c *** got signal Terminated *** 2023-12-02T05:35:09.048 INFO:tasks.ceph.mds.a.smithi001.stderr:2023-12-02T05:35:09.040+0000 7f32704a2640 -1 mds.a *** got signal Terminated *** 2023-12-02T05:35:09.051 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T05:35:09.050+0000 7f9970cf3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 89416) UID: 0 2023-12-02T05:35:09.051 INFO:tasks.ceph.osd.1.smithi001.stderr:2023-12-02T05:35:09.035+0000 7f56f3f48640 -1 osd.1 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-02T05:35:09.053 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T05:35:09.050+0000 7f9970cf3640 -1 osd.0 35 *** Got signal Terminated *** 2023-12-02T05:35:09.055 INFO:tasks.ceph.osd.0.smithi001.stderr:2023-12-02T05:35:09.050+0000 7f9970cf3640 -1 osd.0 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-02T05:35:09.058 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T05:35:09.056+0000 7fdc7a283640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 89427) UID: 0 2023-12-02T05:35:09.059 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-12-02T05:35:09.043+0000 7fa99001b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 89140) UID: 0 2023-12-02T05:35:09.061 INFO:tasks.ceph.mon.a.smithi001.stderr:2023-12-02T05:35:09.043+0000 7fa99001b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-02T05:35:09.064 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T05:35:09.056+0000 7fdc7a283640 -1 osd.3 35 *** Got signal Terminated *** 2023-12-02T05:35:09.064 INFO:tasks.ceph.osd.3.smithi001.stderr:2023-12-02T05:35:09.056+0000 7fdc7a283640 -1 osd.3 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-02T05:35:09.240 INFO:tasks.ceph.mgr.x.smithi167.stderr:daemon-helper: command crashed with signal 15 2023-12-02T05:35:10.001 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:35:10.009 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:35:40.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:35:40.232 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:36:10.349 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:36:10.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:36:40.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:36:40.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:37:10.605 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:37:10.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:37:40.745 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:37:40.750 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:38:10.876 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:38:10.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:38:41.016 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:38:41.020 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:39:11.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:39:11.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:39:41.290 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:39:41.295 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:40:11.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:40:11.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:40:41.558 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:40:41.563 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:41:11.713 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:41:11.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:41:41.868 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:41:41.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:42:12.014 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:42:12.018 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:42:42.142 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:42:42.148 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:43:12.308 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:43:12.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:43:42.430 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:43:42.435 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:44:12.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:44:12.571 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:44:42.693 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:44:42.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:45:12.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:45:12.837 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:45:42.956 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:45:42.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:46:13.086 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:46:13.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:46:43.224 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:46:43.228 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:47:13.362 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:47:13.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:47:43.492 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:47:43.496 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:48:13.637 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:48:13.642 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:48:43.752 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:48:43.756 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:49:13.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:49:13.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:49:44.007 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:49:44.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:50:14.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:50:14.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:50:44.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:50:44.259 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:51:14.404 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:51:14.408 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:51:44.536 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:51:44.540 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:52:14.685 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:52:14.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:52:44.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:52:44.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:53:15.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:53:15.016 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:53:45.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:53:45.153 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:54:15.257 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:54:15.261 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:54:45.381 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:54:45.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:55:15.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:55:15.502 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:55:45.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:55:45.623 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:56:15.742 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:56:15.748 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:56:45.874 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:56:45.878 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:57:15.996 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:57:16.000 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:57:46.122 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:57:46.126 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:58:16.242 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:58:16.246 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:58:46.349 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:58:46.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:59:16.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:59:16.476 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:59:46.595 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T05:59:46.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:00:16.719 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:00:16.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:00:46.850 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:00:46.854 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:01:17.028 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:01:17.033 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:01:47.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:01:47.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:02:17.302 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:02:17.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:02:47.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:02:47.456 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:03:17.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:03:17.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:03:47.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:03:47.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:04:17.860 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:04:17.864 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:04:47.997 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:04:48.001 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:05:18.114 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:05:18.118 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:05:48.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:05:48.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:06:18.394 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:06:18.399 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:06:48.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:06:48.550 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:07:18.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:07:18.684 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:07:48.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:07:48.808 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:08:18.930 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:08:18.934 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:08:49.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:08:49.064 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:09:19.198 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:09:19.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:09:49.312 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:09:49.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:10:19.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:10:19.454 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:10:49.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:10:49.783 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:11:19.926 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:11:19.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:11:50.081 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:11:50.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:12:20.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:12:20.231 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:12:50.356 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:12:50.360 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:13:20.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:13:20.535 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:13:50.666 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:13:50.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:14:20.787 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:14:20.792 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:14:50.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:14:50.921 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:15:21.042 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:15:21.046 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:15:51.194 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:15:51.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:16:21.313 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:16:21.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:16:51.453 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:16:51.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:17:21.599 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:17:21.603 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:17:51.754 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:17:51.759 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:18:21.909 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:18:21.913 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:18:52.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:18:52.045 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:19:22.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:19:22.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:19:52.299 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:19:52.303 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:20:22.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:20:22.450 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:20:52.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:20:52.566 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:21:22.713 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:21:22.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:21:52.840 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:21:52.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:22:22.989 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:22:22.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:22:53.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:22:53.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:23:23.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:23:23.237 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:23:53.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:23:53.362 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:24:23.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:24:23.504 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:24:53.638 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:24:53.643 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:25:23.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:25:23.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:25:53.915 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:25:53.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:26:24.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:26:24.036 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:26:54.182 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:26:54.187 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:27:24.302 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:27:24.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:27:54.442 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:27:54.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:28:24.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:28:24.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:28:54.710 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:28:54.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:29:24.881 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:29:24.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:29:55.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:29:55.015 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:30:25.140 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:30:25.144 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:30:55.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:30:55.268 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:31:25.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:31:25.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:31:55.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:31:55.551 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:32:25.675 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:32:25.679 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:32:55.813 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:32:55.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:33:25.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:33:25.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:33:56.085 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:33:56.089 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:34:26.230 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:34:26.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:34:56.349 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:34:56.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:35:26.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:35:26.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:35:56.668 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:35:56.674 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:36:26.841 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:36:26.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:36:57.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:36:57.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:37:27.141 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:37:27.145 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:37:57.305 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:37:57.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:38:27.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:38:27.438 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:38:57.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:38:57.570 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:39:27.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:39:27.685 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:39:57.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:39:57.819 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:40:27.934 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:40:27.939 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:40:58.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:40:58.098 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:41:28.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:41:28.226 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:41:58.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:41:58.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:42:28.477 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:42:28.481 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:42:58.644 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:42:58.649 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:43:28.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:43:28.787 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:43:58.911 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:43:58.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:44:29.042 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:44:29.046 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:44:59.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:44:59.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:45:29.326 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:45:29.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:45:59.453 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:45:59.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:46:29.587 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:46:29.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:46:59.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:46:59.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:47:29.854 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:47:29.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:47:59.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:47:59.982 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:48:30.117 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:48:30.121 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:49:00.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:49:00.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:49:30.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:49:30.411 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:50:00.553 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:50:00.557 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:50:30.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:50:30.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:51:00.891 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:51:00.896 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:51:31.020 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:51:31.025 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:52:01.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:52:01.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:52:31.291 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:52:31.298 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:53:01.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:53:01.445 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:53:31.562 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:53:31.566 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:54:01.708 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:54:01.712 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:54:31.846 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:54:31.851 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:55:01.992 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:55:01.997 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:55:32.115 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:55:32.119 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:56:02.268 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:56:02.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:56:32.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:56:32.420 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:57:02.532 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:57:02.536 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:57:32.666 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:57:32.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:58:02.793 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:58:02.798 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:58:32.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:58:32.948 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:59:03.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:59:03.078 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:59:33.212 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T06:59:33.217 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:00:03.336 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:00:03.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:00:33.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:00:33.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:01:03.600 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:01:03.605 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:01:33.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:01:33.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:02:03.876 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:02:03.881 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:02:34.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:02:34.035 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:03:04.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:03:04.190 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:03:34.315 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:03:34.319 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:04:04.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:04:04.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:04:34.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:04:34.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:05:04.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:05:04.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:05:34.847 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:05:34.851 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:06:04.989 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:06:04.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:06:35.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:06:35.174 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:07:05.308 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:07:05.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:07:35.453 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:07:35.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:08:05.592 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:08:05.596 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:08:35.721 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:08:35.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:09:05.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:09:05.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:09:36.007 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:09:36.011 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:10:06.129 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:10:06.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:10:36.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:10:36.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:11:06.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:11:06.381 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:11:36.526 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:11:36.530 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:12:06.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:12:06.651 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:12:36.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:12:36.767 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:13:06.876 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:13:06.881 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:13:37.025 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:13:37.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:14:07.147 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:14:07.152 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:14:37.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:14:37.275 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:15:07.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:15:07.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:15:37.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:15:37.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:16:07.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:16:07.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:16:37.829 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:16:37.833 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:17:07.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:17:07.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:17:38.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:17:38.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:18:08.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:18:08.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:18:38.379 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:18:38.383 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:19:08.511 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:19:08.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:19:38.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:19:38.649 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:20:08.783 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:20:08.787 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:20:38.913 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:20:38.917 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:21:09.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:21:09.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:21:39.191 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:21:39.196 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:22:09.331 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:22:09.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:22:39.487 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:22:39.492 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:23:09.602 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:23:09.607 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:23:39.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:23:39.766 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:24:09.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:24:09.895 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:24:40.055 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:24:40.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:25:10.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:25:10.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:25:40.332 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:25:40.336 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:26:10.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:26:10.474 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:26:40.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:26:40.621 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:27:10.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:27:10.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:27:40.935 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:27:40.940 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:28:11.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:28:11.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:28:41.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:28:41.178 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:29:11.305 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:29:11.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:29:41.428 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:29:41.433 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:30:11.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:30:11.590 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:30:41.700 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:30:41.705 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:31:11.830 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:31:11.835 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:31:41.946 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:31:41.954 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:32:12.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:32:12.104 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:32:42.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:32:42.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:33:12.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:33:12.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:33:42.513 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:33:42.518 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:34:12.643 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:34:12.647 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:34:42.773 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:34:42.777 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:35:12.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:35:12.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:35:43.050 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:35:43.055 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:36:13.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:36:13.209 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:36:43.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:36:43.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:37:13.458 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:37:13.462 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:37:43.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:37:43.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:38:13.734 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:38:13.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:38:43.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:38:43.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:39:14.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:39:14.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:39:44.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:39:44.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:40:14.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:40:14.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:40:44.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:40:44.375 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:41:14.520 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:41:14.524 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:41:44.650 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:41:44.654 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:42:14.813 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:42:14.819 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:42:44.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:42:44.959 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:43:15.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:43:15.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:43:45.436 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:43:45.441 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:44:15.574 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:44:15.578 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:44:45.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:44:45.708 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:45:15.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:45:15.855 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:45:46.005 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:45:46.011 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:46:16.167 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:46:16.171 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:46:46.290 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:46:46.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:47:16.419 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:47:16.423 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:47:46.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:47:46.546 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:48:16.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:48:16.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:48:46.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:48:46.813 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:49:16.936 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:49:16.940 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:49:47.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:49:47.082 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:50:17.206 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:50:17.211 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:50:47.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:50:47.349 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:51:17.478 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:51:17.483 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:51:47.605 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:51:47.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:52:17.760 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:52:17.765 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:52:47.925 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:52:47.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:53:18.054 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:53:18.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:53:48.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:53:48.182 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:54:18.308 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:54:18.313 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:54:48.432 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:54:48.436 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:55:18.564 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:55:18.568 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:55:48.695 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:55:48.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:56:18.826 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:56:18.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:56:48.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:56:48.953 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:57:19.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:57:19.077 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:57:49.212 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:57:49.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:58:19.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:58:19.347 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:58:49.467 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:58:49.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:59:19.590 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:59:19.596 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:59:49.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T07:59:49.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:00:19.845 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:00:19.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:00:49.984 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:00:49.988 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:01:20.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:01:20.114 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:01:50.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:01:50.282 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:02:20.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:02:20.597 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:02:50.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:02:50.743 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:03:20.902 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:03:20.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:03:51.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:03:51.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:04:21.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:04:21.215 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:04:51.362 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:04:51.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:05:21.495 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:05:21.499 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:05:51.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:05:51.630 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:06:21.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:06:21.767 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:06:51.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:06:51.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:07:22.023 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:07:22.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:07:52.150 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:07:52.154 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:08:22.300 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:08:22.305 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:08:52.447 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:08:52.452 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:09:22.626 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:09:22.631 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:09:52.781 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:09:52.785 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:10:22.936 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:10:22.941 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:10:53.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:10:53.072 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:11:23.188 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:11:23.192 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:11:53.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:11:53.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:12:23.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:12:23.498 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:12:53.652 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:12:53.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:13:23.781 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:13:23.785 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:13:53.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:13:53.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:14:24.067 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:14:24.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:14:54.205 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:14:54.209 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:15:24.351 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:15:24.355 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:15:54.480 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:15:54.484 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:16:24.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:16:24.631 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:16:54.841 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:16:54.846 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:17:24.956 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:17:24.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:17:55.079 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:17:55.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:18:25.206 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:18:25.210 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:18:55.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:18:55.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:19:25.532 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:19:25.537 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:19:55.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:19:55.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:20:25.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:20:25.957 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:20:56.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:20:56.081 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:21:26.208 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:21:26.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:21:56.348 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:21:56.352 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:22:26.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:22:26.476 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:22:56.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:22:56.590 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:23:26.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:23:26.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:23:56.869 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:23:56.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:24:27.004 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:24:27.009 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:24:57.161 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:24:57.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:25:27.293 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:25:27.298 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:25:57.557 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:25:57.561 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:26:27.671 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:26:27.675 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:26:57.821 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:26:57.826 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:27:27.993 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:27:27.997 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:27:58.122 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:27:58.126 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:28:28.260 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:28:28.265 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:28:58.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:28:58.382 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:29:28.512 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:29:28.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:29:58.633 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:29:58.637 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:30:28.772 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:30:28.778 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:30:58.930 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:30:58.934 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:31:29.057 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:31:29.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:31:59.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:31:59.241 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:32:29.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:32:29.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:32:59.505 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:32:59.509 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:33:29.629 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:33:29.634 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:33:59.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:33:59.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:34:29.920 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:34:29.924 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:35:00.057 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:35:00.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:35:30.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:35:30.182 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:36:00.334 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:36:00.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:36:30.466 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:36:30.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:37:00.611 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:37:00.615 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:37:30.746 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:37:30.751 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:38:00.878 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:38:00.883 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:38:31.025 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:38:31.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:39:01.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:39:01.184 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:39:31.326 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:39:31.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:40:01.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:40:01.464 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:40:31.609 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:40:31.614 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:41:01.741 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:41:01.746 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:41:31.896 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:41:31.901 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:42:02.023 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:42:02.027 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:42:32.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:42:32.157 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:43:02.267 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:43:02.271 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:43:32.424 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:43:32.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:44:02.713 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:44:02.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:44:32.850 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:44:32.855 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:45:02.976 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:45:02.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:45:33.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:45:33.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:46:03.241 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:46:03.245 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:46:33.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:46:33.382 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:47:03.533 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:47:03.538 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:47:33.667 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:47:33.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:48:03.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:48:03.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:48:33.954 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:48:33.961 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:49:04.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:49:04.115 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:49:34.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:49:34.237 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:50:04.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:50:04.418 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:50:34.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:50:34.551 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:51:04.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:51:04.685 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:51:34.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:51:34.840 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:52:04.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:52:04.972 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:52:35.120 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:52:35.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:53:05.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:53:05.256 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:53:35.405 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:53:35.409 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:54:05.527 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:54:05.531 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:54:35.658 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:54:35.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:55:05.773 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:55:05.778 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:55:35.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:55:35.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:56:06.037 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:56:06.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:56:36.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:56:36.214 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:57:06.341 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:57:06.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:57:36.482 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:57:36.488 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:58:06.607 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:58:06.611 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:58:36.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:58:36.741 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:59:06.892 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:59:06.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:59:37.024 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T08:59:37.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:00:07.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:00:07.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:00:37.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:00:37.298 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:01:07.428 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:01:07.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:01:37.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:01:37.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:02:07.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:02:07.727 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:02:37.845 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:02:37.850 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:03:07.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:03:07.973 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:03:38.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:03:38.087 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:04:08.198 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:04:08.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:04:38.329 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:04:38.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:05:08.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:05:08.456 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:05:38.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:05:38.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:06:08.706 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:06:08.710 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:06:38.830 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:06:38.835 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:07:08.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:07:08.957 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:07:39.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:07:39.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:08:09.199 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:08:09.203 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:08:39.331 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:08:39.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:09:09.454 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:09:09.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:09:39.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:09:39.590 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:10:09.700 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:10:09.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:10:39.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:10:39.842 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:11:09.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:11:09.971 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:11:40.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:11:40.102 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:12:10.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:12:10.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:12:40.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:12:40.354 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:13:10.495 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:13:10.499 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:13:40.629 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:13:40.638 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:14:10.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:14:10.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:14:40.926 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:14:40.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:15:11.049 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:15:11.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:15:41.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:15:41.190 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:16:11.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:16:11.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:16:41.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:16:41.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:17:11.590 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:17:11.595 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:17:41.731 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:17:41.735 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:18:11.845 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:18:11.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:18:41.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:18:41.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:19:12.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:19:12.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:19:42.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:19:42.245 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:20:12.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:20:12.384 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:20:42.528 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:20:42.533 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:21:12.700 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:21:12.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:21:42.824 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:21:42.828 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:22:12.946 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:22:12.951 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:22:43.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:22:43.082 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:23:13.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:23:13.214 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:23:43.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:23:43.351 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:24:13.456 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:24:13.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:24:43.589 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:24:43.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:25:13.719 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:25:13.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:25:43.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:25:43.855 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:26:13.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:26:13.987 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:26:44.114 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:26:44.120 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:27:14.238 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:27:14.243 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:27:44.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:27:44.373 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:28:14.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:28:14.504 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:28:44.641 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:28:44.645 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:29:14.770 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:29:14.778 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:29:44.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:29:44.937 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:30:15.080 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:30:15.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:30:45.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:30:45.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:31:15.373 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:31:15.377 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:31:45.503 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:31:45.508 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:32:15.635 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:32:15.639 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:32:45.778 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:32:46.281 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:33:16.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:33:16.419 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:33:46.549 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:33:46.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:34:16.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:34:16.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:34:46.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:34:46.837 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:35:16.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:35:16.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:35:47.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:35:47.209 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:36:17.337 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:36:17.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:36:47.468 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:36:47.473 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:37:17.589 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:37:17.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:37:47.721 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:37:47.727 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:38:17.874 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:38:17.878 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:38:48.009 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:38:48.014 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:39:18.150 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:39:18.154 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:39:48.280 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:39:48.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:40:18.401 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:40:18.405 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:40:48.539 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:40:48.543 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:41:18.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:41:18.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:41:48.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:41:48.837 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:42:18.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:42:18.957 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:42:49.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:42:49.097 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:43:19.225 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:43:19.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:43:49.386 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:43:49.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:44:19.504 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:44:19.508 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:44:49.636 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:44:49.641 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:45:19.884 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:45:19.888 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:45:50.015 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:45:50.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:46:20.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:46:20.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:46:50.314 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:46:50.318 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:47:20.461 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:47:20.465 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:47:50.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:47:50.658 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:48:20.796 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:48:20.801 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:48:50.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:48:50.951 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:49:21.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:49:21.089 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:49:51.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:49:51.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:50:21.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:50:21.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:50:51.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:50:51.686 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:51:21.821 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:51:21.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:51:51.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:51:51.987 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:52:22.146 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:52:22.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:52:52.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:52:52.291 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:53:22.453 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:53:22.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:53:52.602 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:53:52.607 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:54:22.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:54:22.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:54:52.870 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:54:52.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:55:22.992 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:55:22.996 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:55:53.147 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:55:53.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:56:23.263 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:56:23.267 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:56:53.395 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:56:53.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:57:23.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:57:23.522 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:57:53.658 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:57:53.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:58:23.788 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:58:23.792 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:58:53.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:58:53.938 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:59:24.063 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:59:24.067 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:59:54.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T09:59:54.189 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:00:24.315 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:00:24.319 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:00:54.447 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:00:54.451 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:01:24.563 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:01:24.567 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:01:54.693 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:01:54.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:02:24.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:02:24.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:02:54.965 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:02:54.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:03:25.095 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:03:25.099 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:03:55.244 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:03:55.248 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:04:25.371 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:04:25.376 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:04:55.506 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:04:55.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:05:25.656 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:05:25.660 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:05:55.803 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:05:55.808 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:06:25.925 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:06:25.929 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:06:56.053 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:06:56.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:07:26.196 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:07:26.200 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:07:56.386 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:07:56.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:08:26.508 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:08:26.512 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:08:56.640 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:08:56.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:09:26.811 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:09:26.816 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:09:56.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:09:56.954 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:10:27.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:10:27.089 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:10:57.208 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:10:57.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:11:27.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:11:27.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:11:57.587 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:11:57.592 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:12:27.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:12:27.727 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:12:57.850 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:12:57.855 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:13:27.990 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:13:27.994 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:13:58.130 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:13:58.134 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:14:28.260 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:14:28.264 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:14:58.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:14:58.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:15:28.711 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:15:28.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:15:58.838 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:15:58.843 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:16:28.962 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:16:28.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:16:59.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:16:59.097 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:17:29.230 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:17:29.235 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:17:59.377 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:17:59.381 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:18:29.495 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:18:29.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:18:59.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:18:59.649 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:19:29.766 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:19:29.770 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:19:59.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:19:59.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:20:30.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:20:30.034 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:21:00.161 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:21:00.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:21:30.276 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:21:30.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:22:00.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:22:00.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:22:30.563 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:22:30.567 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:23:00.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:23:00.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:23:30.822 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:23:30.826 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:24:01.015 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:24:01.019 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:24:31.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:24:31.154 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:25:01.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:25:01.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:25:31.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:25:31.438 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:26:01.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:26:01.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:26:31.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:26:31.709 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:27:01.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:27:01.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:27:31.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:27:31.963 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:28:02.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:28:02.089 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:28:32.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:28:32.242 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:29:02.392 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:29:02.401 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:29:32.643 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:29:32.647 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:30:02.774 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:30:02.779 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:30:32.898 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:30:32.902 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:31:03.261 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:31:03.265 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:31:33.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:31:33.381 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:32:03.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:32:03.530 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:32:33.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:32:33.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:33:03.967 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:33:03.972 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:33:34.103 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:33:34.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:34:04.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:34:04.248 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:34:34.365 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:34:34.369 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:35:04.491 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:35:04.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:35:34.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:35:34.651 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:36:04.777 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:36:04.782 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:36:34.914 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:36:34.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:37:05.040 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:37:05.044 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:37:35.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:37:35.178 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:38:05.302 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:38:05.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:38:35.467 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:38:35.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:39:05.599 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:39:05.603 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:39:35.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:39:35.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:40:05.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:40:05.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:40:36.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:40:36.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:41:06.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:41:06.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:41:36.312 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:41:36.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:42:06.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:42:06.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:42:36.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:42:36.579 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:43:06.727 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:43:06.731 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:43:36.846 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:43:36.850 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:44:07.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:44:07.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:44:37.143 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:44:37.147 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:45:07.288 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:45:07.291 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:45:37.405 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:45:37.409 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:46:07.548 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:46:07.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:46:37.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:46:37.696 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:47:07.841 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:47:07.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:47:37.981 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:47:37.985 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:48:08.103 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:48:08.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:48:38.247 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:48:38.251 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:49:08.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:49:08.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:49:38.514 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:49:38.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:50:08.661 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:50:08.667 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:50:38.795 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:50:38.799 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:51:08.934 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:51:08.939 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:51:39.049 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:51:39.054 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:52:09.187 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:52:09.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:52:39.312 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:52:39.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:53:09.442 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:53:09.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:53:39.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:53:39.590 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:54:09.739 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:54:09.743 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:54:39.877 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:54:39.881 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:55:10.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:55:10.036 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:55:40.161 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:55:40.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:56:10.297 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:56:10.301 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:56:40.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:56:40.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:57:10.592 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:57:10.596 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:57:40.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:57:40.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:58:10.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:58:10.860 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:58:40.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:58:40.975 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:59:11.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:59:11.106 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:59:41.216 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T10:59:41.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:00:11.356 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:00:11.360 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:00:41.479 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:00:41.486 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:01:11.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:01:11.627 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:01:41.742 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:01:41.747 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:02:11.872 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:02:11.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:02:42.005 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:02:42.009 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:03:12.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:03:12.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:03:42.276 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:03:42.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:04:12.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:04:12.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:04:42.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:04:42.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:05:12.661 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:05:12.665 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:05:42.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:05:42.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:06:12.934 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:06:12.938 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:06:43.072 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:06:43.076 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:07:13.218 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:07:13.222 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:07:43.366 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:07:43.371 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:08:13.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:08:13.504 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:08:43.632 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:08:43.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:09:13.795 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:09:13.799 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:09:43.944 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:09:43.952 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:10:14.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:10:14.092 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:10:44.245 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:10:44.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:11:14.381 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:11:14.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:11:44.527 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:11:44.531 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:12:14.661 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:12:14.667 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:12:44.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:12:44.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:13:14.982 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:13:14.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:13:45.138 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:13:45.142 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:14:15.267 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:14:15.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:14:45.397 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:14:45.401 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:15:15.534 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:15:15.538 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:15:45.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:15:45.684 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:16:15.828 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:16:15.832 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:16:45.982 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:16:45.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:17:16.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:17:16.104 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:17:46.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:17:46.226 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:18:16.363 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:18:16.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:18:46.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:18:46.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:19:16.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:19:16.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:19:46.760 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:19:46.764 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:20:16.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:20:16.911 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:20:47.070 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:20:47.074 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:21:17.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:21:17.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:21:47.357 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:21:47.361 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:22:17.485 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:22:17.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:22:47.622 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:22:47.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:23:17.760 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:23:17.764 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:23:47.898 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:23:47.902 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:24:18.036 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:24:18.040 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:24:48.181 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:24:48.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:25:18.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:25:18.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:25:48.483 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:25:48.487 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:26:18.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:26:18.650 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:26:48.800 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:26:48.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:27:18.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:27:18.932 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:27:49.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:27:49.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:28:19.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:28:19.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:28:49.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:28:49.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:29:19.461 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:29:19.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:29:49.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:29:49.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:30:19.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:30:19.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:30:49.839 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:30:49.843 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:31:19.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:31:19.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:31:50.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:31:50.097 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:32:20.224 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:32:20.228 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:32:50.339 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:32:50.343 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:33:20.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:33:20.474 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:33:50.593 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:33:50.598 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:34:20.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:34:20.730 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:34:50.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:34:50.853 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:35:20.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:35:20.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:35:51.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:35:51.106 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:36:21.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:36:21.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:36:51.340 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:36:51.344 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:37:21.488 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:37:21.492 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:37:51.611 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:37:51.615 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:38:21.734 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:38:21.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:38:51.857 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:38:51.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:39:21.989 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:39:21.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:39:52.103 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:39:52.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:40:22.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:40:22.257 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:40:52.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:40:52.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:41:22.513 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:41:22.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:41:52.649 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:41:52.653 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:42:22.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:42:22.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:42:52.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:42:52.933 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:43:23.074 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:43:23.078 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:43:53.234 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:43:53.238 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:44:23.397 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:44:23.402 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:44:53.543 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:44:53.548 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:45:23.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:45:23.677 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:45:53.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:45:53.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:46:23.965 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:46:23.969 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:46:54.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:46:54.115 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:47:24.258 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:47:24.262 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:47:54.404 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:47:54.409 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:48:24.537 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:48:24.541 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:48:54.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:48:54.684 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:49:24.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:49:24.813 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:49:54.956 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:49:54.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:50:25.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:50:25.100 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:50:55.257 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:50:55.262 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:51:25.391 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:51:25.395 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:51:55.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:51:55.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:52:25.654 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:52:25.658 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:52:55.801 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:52:55.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:53:25.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:53:25.952 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:53:56.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:53:56.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:54:26.239 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:54:26.243 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:54:56.386 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:54:56.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:55:26.512 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:55:26.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:55:56.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:55:56.677 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:56:26.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:56:26.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:56:56.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:56:56.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:57:27.117 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:57:27.122 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:57:57.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:57:57.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:58:27.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:58:27.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:58:57.556 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:58:57.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:59:27.687 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:59:27.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:59:57.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T11:59:57.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:00:27.954 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:00:27.959 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:00:58.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:00:58.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:01:28.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:01:28.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:01:58.395 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:01:58.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:02:28.526 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:02:28.530 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:02:58.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:02:58.658 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:03:28.783 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:03:28.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:03:58.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:03:58.908 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:04:29.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:04:29.046 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:04:59.189 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:04:59.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:05:29.323 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:05:29.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:05:59.455 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:05:59.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:06:29.593 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:06:29.598 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:06:59.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:06:59.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:07:29.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:07:29.854 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:07:59.972 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:07:59.977 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:08:30.112 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:08:30.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:09:00.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:09:00.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:09:30.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:09:30.362 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:10:00.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:10:00.476 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:10:30.595 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:10:30.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:11:00.711 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:11:00.716 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:11:30.847 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:11:30.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:12:00.993 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:12:00.997 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:12:31.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:12:31.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:13:01.295 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:13:01.298 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:13:31.426 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:13:31.430 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:14:01.548 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:14:01.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:14:31.698 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:14:31.702 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:15:01.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:15:01.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:15:31.951 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:15:31.957 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:16:02.066 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:16:02.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:16:32.189 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:16:32.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:17:02.313 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:17:02.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:17:32.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:17:32.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:18:02.615 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:18:02.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:18:32.747 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:18:32.751 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:19:02.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:19:02.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:19:33.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:19:33.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:20:03.116 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:20:03.120 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:20:33.266 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:20:33.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:21:03.387 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:21:03.391 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:21:33.510 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:21:33.514 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:22:03.633 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:22:03.638 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:22:33.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:22:33.779 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:23:03.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:23:03.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:23:34.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:23:34.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:24:04.306 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:24:04.311 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:24:34.461 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:24:34.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:25:04.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:25:04.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:25:34.728 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:25:34.733 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:26:04.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:26:04.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:26:35.004 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:26:35.008 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:27:05.150 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:27:05.154 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:27:35.280 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:27:35.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:28:05.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:28:05.454 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:28:35.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:28:35.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:29:05.706 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:29:05.710 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:29:35.839 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:29:35.843 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:30:05.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:30:05.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:30:36.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:30:36.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:31:06.246 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:31:06.250 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:31:36.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:31:36.381 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:32:06.521 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:32:06.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:32:36.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:32:36.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:33:06.801 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:33:06.807 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:33:36.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:33:36.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:34:07.068 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:34:07.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:34:37.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:34:37.208 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:35:07.335 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:35:07.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:35:37.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:35:37.474 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:36:07.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:36:07.625 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:36:37.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:36:37.767 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:37:07.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:37:07.921 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:37:38.049 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:37:38.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:38:08.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:38:08.189 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:38:38.323 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:38:38.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:39:08.480 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:39:08.484 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:39:38.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:39:38.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:40:08.789 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:40:08.793 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:40:38.908 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:40:38.913 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:41:09.030 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:41:09.034 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:41:39.184 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:41:39.188 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:42:09.322 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:42:09.326 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:42:39.485 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:42:39.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:43:09.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:43:09.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:43:39.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:43:39.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:44:09.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:44:09.913 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:44:40.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:44:40.110 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:45:10.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:45:10.244 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:45:40.374 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:45:40.378 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:46:10.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:46:10.505 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:46:40.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:46:40.651 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:47:10.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:47:10.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:47:40.900 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:47:40.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:48:11.014 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:48:11.019 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:48:41.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:48:41.169 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:49:11.285 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:49:11.289 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:49:41.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:49:41.420 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:50:11.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:50:11.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:50:41.696 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:50:41.702 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:51:11.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:51:11.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:51:41.960 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:51:41.964 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:52:12.087 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:52:12.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:52:42.214 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:52:42.218 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:53:12.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:53:12.359 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:53:42.486 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:53:42.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:54:12.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:54:12.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:54:42.764 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:54:42.768 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:55:12.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:55:12.911 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:55:43.044 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:55:43.048 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:56:13.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:56:13.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:56:43.289 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:56:43.293 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:57:13.404 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:57:13.408 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:57:43.544 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:57:43.548 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:58:13.658 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:58:13.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:58:43.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:58:43.786 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:59:13.896 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:59:13.900 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:59:44.044 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T12:59:44.049 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:00:14.167 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:00:14.172 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:00:44.307 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:00:44.311 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:01:14.421 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:01:14.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:01:44.561 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:01:44.565 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:02:14.700 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:02:14.705 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:02:44.831 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:02:44.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:03:14.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:03:14.959 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:03:45.086 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:03:45.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:04:15.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:04:15.206 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:04:45.344 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:04:45.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:05:15.516 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:05:15.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:05:45.654 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:05:45.660 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:06:15.791 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:06:15.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:06:45.926 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:06:45.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:07:16.058 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:07:16.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:07:46.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:07:46.208 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:08:16.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:08:16.355 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:08:46.513 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:08:46.518 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:09:16.651 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:09:16.655 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:09:46.789 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:09:46.793 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:10:16.936 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:10:16.940 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:10:47.067 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:10:47.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:11:17.220 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:11:17.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:11:47.367 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:11:47.371 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:12:17.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:12:17.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:12:47.668 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:12:47.672 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:13:17.815 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:13:17.819 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:13:47.952 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:13:47.956 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:14:18.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:14:18.077 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:14:48.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:14:48.223 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:15:18.399 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:15:18.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:15:48.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:15:48.533 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:16:18.682 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:16:18.686 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:16:48.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:16:48.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:17:18.958 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:17:18.962 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:17:49.122 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:17:49.126 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-02T13:18:14.162 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-12-02T13:18:14.163 DEBUG:teuthology.task.console_log:Killing console logger for smithi001 2023-12-02T13:18:14.163 DEBUG:teuthology.task.console_log:Killing console logger for smithi167 2023-12-02T13:18:14.163 DEBUG:teuthology.exit:Finished running handlers